-- Logs begin at Wed 2022-07-20 16:48:47 UTC, end at Wed 2022-07-20 18:15:51 UTC. -- Jul 20 17:34:38.995286 dv-cinder-849846-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 20 17:34:39.008782 dv-cinder-849846-3-smb devstack@keystone.service[87013]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 20 17:34:39.010842 dv-cinder-849846-3-smb devstack@keystone.service[87013]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 17:34:39 2022] *** Jul 20 17:34:39.010842 dv-cinder-849846-3-smb devstack@keystone.service[87013]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 17:34:39.010842 dv-cinder-849846-3-smb devstack@keystone.service[87013]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 17:34:39.010842 dv-cinder-849846-3-smb devstack@keystone.service[87013]: nodename: dv-cinder-849846-3-smb Jul 20 17:34:39.010842 dv-cinder-849846-3-smb devstack@keystone.service[87013]: machine: x86_64 Jul 20 17:34:39.010842 dv-cinder-849846-3-smb devstack@keystone.service[87013]: clock source: unix Jul 20 17:34:39.010842 dv-cinder-849846-3-smb devstack@keystone.service[87013]: pcre jit disabled Jul 20 17:34:39.010842 dv-cinder-849846-3-smb devstack@keystone.service[87013]: detected number of CPU cores: 4 Jul 20 17:34:39.010842 dv-cinder-849846-3-smb devstack@keystone.service[87013]: current working directory: / Jul 20 17:34:39.010842 dv-cinder-849846-3-smb devstack@keystone.service[87013]: detected binary path: /usr/bin/uwsgi-core Jul 20 17:34:39.010842 dv-cinder-849846-3-smb devstack@keystone.service[87013]: your processes number limit is 47680 Jul 20 17:34:39.011544 dv-cinder-849846-3-smb devstack@keystone.service[87013]: your memory page size is 4096 bytes Jul 20 17:34:39.011544 dv-cinder-849846-3-smb devstack@keystone.service[87013]: detected max file descriptor number: 2048 Jul 20 17:34:39.011544 dv-cinder-849846-3-smb devstack@keystone.service[87013]: lock engine: pthread robust mutexes Jul 20 17:34:39.011544 dv-cinder-849846-3-smb devstack@keystone.service[87013]: thunder lock: enabled Jul 20 17:34:39.011544 dv-cinder-849846-3-smb devstack@keystone.service[87013]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 20 17:34:39.011544 dv-cinder-849846-3-smb devstack@keystone.service[87013]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 17:34:39.058676 dv-cinder-849846-3-smb devstack@keystone.service[87013]: Python main interpreter initialized at 0x55befbc7b9c0 Jul 20 17:34:39.058676 dv-cinder-849846-3-smb devstack@keystone.service[87013]: python threads support enabled Jul 20 17:34:39.058676 dv-cinder-849846-3-smb devstack@keystone.service[87013]: your server socket listen backlog is limited to 100 connections Jul 20 17:34:39.058676 dv-cinder-849846-3-smb devstack@keystone.service[87013]: your mercy for graceful operations on workers is 90 seconds Jul 20 17:34:39.059067 dv-cinder-849846-3-smb devstack@keystone.service[87013]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 17:34:39.059145 dv-cinder-849846-3-smb devstack@keystone.service[87013]: *** Operational MODE: preforking *** Jul 20 17:34:39.059408 dv-cinder-849846-3-smb devstack@keystone.service[87013]: *** uWSGI is running in multiple interpreter mode *** Jul 20 17:34:39.059408 dv-cinder-849846-3-smb devstack@keystone.service[87013]: spawned uWSGI master process (pid: 87013) Jul 20 17:34:39.059637 dv-cinder-849846-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 20 17:34:39.062305 dv-cinder-849846-3-smb devstack@keystone.service[87013]: spawned uWSGI worker 1 (pid: 87026, cores: 1) Jul 20 17:34:39.062305 dv-cinder-849846-3-smb devstack@keystone.service[87013]: spawned uWSGI worker 2 (pid: 87027, cores: 1) Jul 20 17:34:39.062305 dv-cinder-849846-3-smb devstack@keystone.service[87013]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 17:34:44.953945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 17:34:44.953945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: from cryptography.utils import int_from_bytes Jul 20 17:34:44.954744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 17:34:44.954744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: from cryptography.utils import int_from_bytes Jul 20 17:34:44.955665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 17:34:44.955665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: from cryptography.utils import int_from_bytes Jul 20 17:34:44.956114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 17:34:44.956114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: from cryptography.utils import int_from_bytes Jul 20 17:34:45.006304 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 17:34:45.006556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 17:34:45.006650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 17:34:45.006795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 17:34:45.006880 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] command line args: [] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 17:34:45.007017 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] command line args: [] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 17:34:45.007195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 17:34:45.007291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 17:34:45.007445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ================================================================================ {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 17:34:45.007531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ================================================================================ {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 17:34:45.007726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] admin_token = **** {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.007820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] admin_token = **** {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.007979 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] config_dir = [] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.008170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.008257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] config_dir = [] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.008411 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] config_source = [] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.008526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.008607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] debug = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.008769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] config_source = [] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.008859 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.009100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] debug = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.009228 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.009348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.009514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.009638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.009760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.009873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.009990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.010110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] list_limit = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.010223 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.010346 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] log_config_append = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.010459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.010612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] log_dir = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.010860 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.010983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] log_file = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.011096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] list_limit = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.011219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.011338 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] log_config_append = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.011458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.011571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.011683 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.011804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] log_dir = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.011804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] log_file = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.012030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.012181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.012317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.012460 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.012643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.012835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.012973 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.013055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.013160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.013237 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.013992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.014084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.014165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.014283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.014398 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.014481 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.014554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.014668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.014668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.014849 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.015001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.015144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.015226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.015312 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.015390 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.015390 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.015604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.015686 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.015686 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] publish_errors = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.015913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.015999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.016076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] publish_errors = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.016217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.016295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.016416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.019116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.019229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.019307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.019399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.019482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.019560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] standard_threads = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.019637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.019713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.019784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] standard_threads = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.019854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.020014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.020240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.020240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] use_journal = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.020433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.020549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] use_json = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.020635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.020716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] use_stderr = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.020787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] use_journal = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.020887 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] use_syslog = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.020963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] use_json = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.020963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] use_stderr = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.021211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.021300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] use_syslog = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.021374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.021535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 17:34:45.021625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.021703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.021774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.021855 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.021927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.021996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.022064 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.022139 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.022215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.022296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.022438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.022518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.022588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.022699 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.022775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.022843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.022913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.023028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.023101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.023214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.023288 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.023450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.023577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.023716 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.023790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.023860 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.024024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.024127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.024207 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.024278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.024348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.024417 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.028554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.030893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.031047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.031185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.031271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.031644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.031817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.031921 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.032025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.032201 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.032330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.032467 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.032665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.032816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.032945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.033072 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.033198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.033324 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.033468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.033594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.033733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.033860 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.033987 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.034110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.034247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.034380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.034505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.034635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.034759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.034879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.035013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.035143 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.035264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.035382 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.035558 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.035695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.035879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.036055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.036217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.036392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.036584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.036751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.036953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.037119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.037291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.037487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.037684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.037826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.037968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.038104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.038245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.038372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.038372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.038625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.038751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.038880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.039000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.039127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.039260 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.039392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.039520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.039656 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.039788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.039920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.040048 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.040174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.040295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.040515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.040645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.040848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.040980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.041107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.041232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.041374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.041497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.041615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.041743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.041896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.041971 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.042100 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.042179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.042239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.042381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.042505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.042630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.042770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.042983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.043109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.043233 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.043416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.043564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.043702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.043879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.044064 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.044331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.045307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.046062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.046213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.046456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.046582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.046684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.046781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.046878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.046985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.047084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.047084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.047260 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.047355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.047458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.047571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.047682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.047790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.047898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.047997 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.048093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.048188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.048283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.048388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.048570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.048755 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.048896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.049020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.049153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.049290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.049418 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.049543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.049669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.049792 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.049918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.050061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.050190 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.050313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.050442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.050573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.050717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.050883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.051010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.051133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.051267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.051392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.051517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.051658 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.051790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.051922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.052053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.052225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.052359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.052559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.052690 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.052818 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.052947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.053079 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.053208 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.054608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.054816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.055032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.055161 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.055288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.055423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.055563 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.055691 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.055816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.055940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.056064 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.056202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.056309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.056385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.056600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.056731 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.056858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.057007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.057136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.057263 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.057392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.057519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.057647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] auth.external = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.057767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] auth.external = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.057845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.057916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.058064 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.058188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.058188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.058394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.058478 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] auth.password = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.058613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] auth.password = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.058691 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] auth.token = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.058808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] auth.token = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.058900 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.059026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.059155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.059301 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.059429 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.059566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.059693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.059820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.061014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.062171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.062312 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.062443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.062573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.062702 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.062831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] credential.caching = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.062973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] credential.caching = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.063102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.063233 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.063363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.063492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.063621 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.063762 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.063890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.064018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.064159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.064291 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.064431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.064706 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.064850 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.064982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.065113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.065244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.065380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.065519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.065647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.065776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.065901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.066036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.066165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.066369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.066510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.066638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.066638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.066878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.067073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.067213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.067335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] federation.caching = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.067430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] federation.caching = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.067504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.067578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.067703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.067791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.067922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.068013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.068139 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.068270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.068398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.068567 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.068697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.068823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.068953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.069082 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.069208 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.069350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.069482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.069605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.069605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.069834 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.069971 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.070100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.070239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.caching = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.070369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.caching = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.070495 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.070621 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.070758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.070887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.071014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.071139 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.071264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.071349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.071488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.071567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.071689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.071857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.071987 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.072116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.072256 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.072381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.072575 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.072722 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.072852 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.072980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.073118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.073246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.073372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.073500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.073625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.073751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.073890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.074017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.074148 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.074268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.074388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.074513 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.074654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.074783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.074911 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.075040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.075167 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.075293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.075434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.075434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.077279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.077422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.077553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.077682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.077892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.078012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.078127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.078240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.078349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.078458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.078585 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.078693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.078803 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.078913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.079020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.079146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.079289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.079414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.079549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.079675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.079803 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.079931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.080072 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.080202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.080326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.080466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.080627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.080747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.080886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.081007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.081130 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.081243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.081356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.081484 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.081626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.081756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.081884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.082008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.082144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.082270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.082416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.082537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.082648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.082760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.082886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.083017 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.083161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.083295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.083295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.083515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.083641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.083770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.083907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.084035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.084145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.084252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.084361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.084537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.084685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.084814 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.084942 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.085071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.085071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.085354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.085481 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.085604 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.085604 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.085836 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.085836 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.086080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.086207 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.086336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.086336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.086569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.086695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.086836 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.086964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.087094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.087217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.087336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.087336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.087585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.087717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.087829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.087954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.088084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.088215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.088353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.088550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.088684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.088811 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.088937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.089062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.094865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.095164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.095311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.095311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.095554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.095684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.095841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.095974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.096105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.096237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.096361 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.096621 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.096879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.097015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.097143 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.097271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.097395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.097520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.097664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.097664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.097899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.098028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.098157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.098283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.098426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.098556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.098687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.098819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.098949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.098949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.099200 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.099200 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.099436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.099568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.099701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.099835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.099981 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.100111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.100240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.100380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.100546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] resource.caching = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.100748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.100898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.101012 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] resource.caching = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.101122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.101250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.101379 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.101502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.101640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.101768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.101906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.102035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.102163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.102294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.102437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.102564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.102693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.102820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.103070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.103211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] role.caching = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.103468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.103606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] role.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.103732 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] role.caching = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.103862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.103990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] role.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.104129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.104259 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.104383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.104536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.104664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.104793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.104944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.105079 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.105211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.105326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.105438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.105565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.105687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.105827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.105956 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.106091 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.106204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.106401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.106519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.106650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.106837 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.107452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.107581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.107720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.107849 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.107973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.107973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.108187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.108187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.108405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.108550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.108665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.108785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.108913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.109042 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.109191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.109326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.109456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.109586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.109717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.109844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.109984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.110113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.110242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.110369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.110497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.110625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.110740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.110852 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.110977 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.111103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.111232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.111372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.111505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.111643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.111770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.111886 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.111997 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.112271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.112443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.112737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.112866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.112995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.113123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.113269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] token.caching = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.113396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.113525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.113651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] token.caching = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.113651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.113893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.114058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.114218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.114348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.114475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.114609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.114739 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.114881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.115008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.115136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.115276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.115409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.115542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.115689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.115821 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.115951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.116064 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.116189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.116302 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.116423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.116579 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.116706 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.116837 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.116967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.117088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.117236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.117370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.117496 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.117625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.117754 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.117882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.118025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.118155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.connection = **** {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.118296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.connection = **** {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.118446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.118697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.118824 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.118930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.119049 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.119169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.119312 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.119443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.119573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.119706 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.119838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.119968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.120111 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.120222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.120410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.120631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.120765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.120880 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.128323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.128587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.128733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.128867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.129003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.129137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.129296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.129427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.129558 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.129687 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.129817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.129817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.130062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.130197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.130325 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.130455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.130589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.130721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87027) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 17:34:45.130868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 17:34:45.130868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 17:34:45.131858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.132016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.132154 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.132312 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.132447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.132694 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.142114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.142384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.174432 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.174702 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.174832 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.174972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.400337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.400630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.488835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.489202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.490782 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.491158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.604168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.604401 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.604654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.604780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.604909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.605066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.605183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.605309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.605528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.605645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.605867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.605995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.650394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.650631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.650766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.650895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.651043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.651165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.651287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.651408 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.651599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.651729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.651936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.652050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.652274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.652391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.672810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.675121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.694144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.694471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.694592 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.694823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.694967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.695169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.695284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.695510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.695624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.695847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.695962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.696188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87026) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.696337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.696541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87027) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 17:34:45.726268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.726599 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 17:34:45.727124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.727443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 17:34:45.727852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.727969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.728214 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 17:34:45.728327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.728688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.728806 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.729066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 17:34:45.729201 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.729466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.729880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.730283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.730691 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.750270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.750715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.751137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.751576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.753775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.754222 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.754642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.755077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.766624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.769953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.772552 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.772995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.773433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.774086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.774535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.774946 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.775373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.775770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.775910 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.776193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.776299 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.776645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.776749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.777073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.777292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.777723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.778129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.779080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.779599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.780121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.780605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.781042 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.829188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.830488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.831962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.832396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.833291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.833728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.842374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.842805 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.843233 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.843467 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.843904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.844337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.856309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.857376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.857997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.858444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.865607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.866062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.866476 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.866602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.866913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.867032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.867342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.867462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.867764 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.867881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.868184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.868520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.868692 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.868815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.869036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.869460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.902881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.903230 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.905465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.905918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.912540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.914375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.918998 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.920004 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.921341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.921799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.929133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.931805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.935583 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.938305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.942261 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.942738 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.943205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.943645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.944091 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.944555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.945041 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.945499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.945961 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.946409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.946864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.947300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.980764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.981381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.982334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.982756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.984203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:45.984848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.985263 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.985687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:45.997028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.000132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.000395 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.000571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.003496 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.004034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.006097 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.006546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.006989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.007435 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.007889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.009694 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.010143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.010584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.011024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.011453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.033481 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.033941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.034378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.034823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.035262 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.035710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.036142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.037175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.037636 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.038061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.038492 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.038940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.039392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.040076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.071713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.077485 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.078769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.083315 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.084409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.086117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.088870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.089308 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.089745 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.090195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.093320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.096031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.096468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.096945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.103108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.105877 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.111058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.112336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.112826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.113265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.113710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.113975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.119621 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.120082 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.120543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.120967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.131490 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.131955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.132389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.138887 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.139538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.139678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.147837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87026) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.148291 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.148752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.149194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.149625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.150066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.150514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.150989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.151442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.151884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.152321 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.152778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.153257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.154423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87026) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.154611 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87027) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 17:34:46.155060 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.155644 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.156080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.156782 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.157219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.157676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.158114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.158555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.159003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.159451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.159872 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.160301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.160783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87027) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 17:34:46.225694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55befbc7b9c0 pid: 87026 (default app) Jul 20 17:34:46.231924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f486028-8154-4498-a68a-7530285edc85 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:34:46.232411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f486028-8154-4498-a68a-7530285edc85 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:34:46.232893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f486028-8154-4498-a68a-7530285edc85 None None] PATH_INFO: `/v3` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:34:46.233216 dv-cinder-849846-3-smb devstack@keystone.service[87027]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55befbc7b9c0 pid: 87027 (default app) Jul 20 17:34:46.237620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Wed Jul 20 17:34:46 2022] GET /identity/v3/ => generated 255 bytes in 11 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:34:55.605248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82838d-1603-4cca-88fc-f2f9fa11c871 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:34:55.605783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82838d-1603-4cca-88fc-f2f9fa11c871 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:34:55.605910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82838d-1603-4cca-88fc-f2f9fa11c871 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:34:55.610609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:34:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:34:55.616741 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13275ac-caa3-41cc-9911-795765f349ac None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:34:55.617216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13275ac-caa3-41cc-9911-795765f349ac None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:34:55.617371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13275ac-caa3-41cc-9911-795765f349ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:34:55.689077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: INFO dbcounter [None req-a13275ac-caa3-41cc-9911-795765f349ac None None] Registered counter for database keystone Jul 20 17:34:55.714294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG oslo_db.sqlalchemy.engines [None req-a13275ac-caa3-41cc-9911-795765f349ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:34:55.721321 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writer thread running {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:34:55.910903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG passlib.handlers.bcrypt [None req-a13275ac-caa3-41cc-9911-795765f349ac None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87026) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 17:34:55.911318 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG passlib.handlers.bcrypt [None req-a13275ac-caa3-41cc-9911-795765f349ac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87026) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 17:34:55.967886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-a13275ac-caa3-41cc-9911-795765f349ac None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:34:55.969533 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a13275ac-caa3-41cc-9911-795765f349ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:34:56.102255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:34:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 17:34:56.310089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82838d-1603-4cca-88fc-f2f9fa11c871 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:34:56.381015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: INFO dbcounter [None req-1c82838d-1603-4cca-88fc-f2f9fa11c871 None None] Registered counter for database keystone Jul 20 17:34:56.401743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG oslo_db.sqlalchemy.engines [None req-1c82838d-1603-4cca-88fc-f2f9fa11c871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87027) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 17:34:56.409662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writer thread running {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 17:34:56.537915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82838d-1603-4cca-88fc-f2f9fa11c871 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:34:56.542148 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1fceb-44a0-4716-911d-9703774d8cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:34:56.542812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1fceb-44a0-4716-911d-9703774d8cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:34:56.543095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1fceb-44a0-4716-911d-9703774d8cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:34:56.543371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1fceb-44a0-4716-911d-9703774d8cd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:34:56.552577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1fceb-44a0-4716-911d-9703774d8cd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:34:56.605447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cdc1fceb-44a0-4716-911d-9703774d8cd8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 17:34:56.606079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1fceb-44a0-4716-911d-9703774d8cd8 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:34:56.616214 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Jul 20 17:34:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 17:34:56.622547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13275ac-caa3-41cc-9911-795765f349ac None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:34:56.638070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13275ac-caa3-41cc-9911-795765f349ac None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:34:56.642832 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afdc3f-6303-4fc0-84bb-434badcebabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:34:56.644007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afdc3f-6303-4fc0-84bb-434badcebabf admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:34:56.644300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afdc3f-6303-4fc0-84bb-434badcebabf admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:34:56.644617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afdc3f-6303-4fc0-84bb-434badcebabf admin admin] PATH_INFO: `/v3/projects/8f637912c585421ea114b8fb6faea1e7` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:34:56.646195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afdc3f-6303-4fc0-84bb-434badcebabf admin admin] RBAC: Authorizing `identity:get_project(project_id=8f637912c585421ea114b8fb6faea1e7)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:34:56.700876 dv-cinder-849846-3-smb devstack@keystone.service[87026]: WARNING keystone.common.rbac_enforcer.enforcer [None req-38afdc3f-6303-4fc0-84bb-434badcebabf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 17:34:56.701338 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afdc3f-6303-4fc0-84bb-434badcebabf admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:34:56.706225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Jul 20 17:34:56 2022] GET /identity/v3/projects/8f637912c585421ea114b8fb6faea1e7 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:34:58.998121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb243f31-1b03-4ca0-945c-d417d72f0893 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:34:58.998699 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb243f31-1b03-4ca0-945c-d417d72f0893 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:34:58.998699 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb243f31-1b03-4ca0-945c-d417d72f0893 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:34:59.003158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:34:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:34:59.009869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545f6a-5c41-4427-af0a-595794d6754d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:34:59.010448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545f6a-5c41-4427-af0a-595794d6754d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:34:59.010448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545f6a-5c41-4427-af0a-595794d6754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:34:59.032048 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-b6545f6a-5c41-4427-af0a-595794d6754d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:34:59.033812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b6545f6a-5c41-4427-af0a-595794d6754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:34:59.042394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:34:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 20 17:34:59.067248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb243f31-1b03-4ca0-945c-d417d72f0893 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:34:59.081037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb243f31-1b03-4ca0-945c-d417d72f0893 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:34:59.086209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0a2fa-db9d-4dc1-9c35-b4fe7683aed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:34:59.086990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0a2fa-db9d-4dc1-9c35-b4fe7683aed8 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:34:59.087369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0a2fa-db9d-4dc1-9c35-b4fe7683aed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:34:59.087729 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0a2fa-db9d-4dc1-9c35-b4fe7683aed8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:34:59.098075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0a2fa-db9d-4dc1-9c35-b4fe7683aed8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:34:59.100070 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0a2fa-db9d-4dc1-9c35-b4fe7683aed8 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:34:59.113743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Jul 20 17:34:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 17:34:59.120083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6545f6a-5c41-4427-af0a-595794d6754d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:34:59.131648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6545f6a-5c41-4427-af0a-595794d6754d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:34:59.136654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035dee5-67d1-4735-b914-c146b3a8a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:34:59.138305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035dee5-67d1-4735-b914-c146b3a8a4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:34:59.138669 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035dee5-67d1-4735-b914-c146b3a8a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:34:59.138999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035dee5-67d1-4735-b914-c146b3a8a4e3 admin admin] PATH_INFO: `/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:34:59.140771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d035dee5-67d1-4735-b914-c146b3a8a4e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=3bfdcdc4e8594f169e8c27a8c1db7913)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:34:59.142876 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d035dee5-67d1-4735-b914-c146b3a8a4e3 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:34:59.144804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Wed Jul 20 17:34:59 2022] GET /identity/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:02.068196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0af40-6e41-440f-b009-1c8fb731522e None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:02.068810 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0af40-6e41-440f-b009-1c8fb731522e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:02.068810 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0af40-6e41-440f-b009-1c8fb731522e None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:02.070169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:02.077064 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e7f97-b8b3-49fa-b06d-3102356d35e4 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:02.077851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e7f97-b8b3-49fa-b06d-3102356d35e4 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:02.077998 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e7f97-b8b3-49fa-b06d-3102356d35e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:02.095973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-ff7e7f97-b8b3-49fa-b06d-3102356d35e4 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:02.097227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ff7e7f97-b8b3-49fa-b06d-3102356d35e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:02.116206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98a402-1eae-4c5c-bcb1-07bf35574cb5 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:02.116505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98a402-1eae-4c5c-bcb1-07bf35574cb5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:02.116807 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98a402-1eae-4c5c-bcb1-07bf35574cb5 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:02.118373 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:35:02.124734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1d619-7d32-449a-88d1-30515fe1d36f None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:02.125021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1d619-7d32-449a-88d1-30515fe1d36f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:02.125303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1d619-7d32-449a-88d1-30515fe1d36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:02.169388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG passlib.handlers.bcrypt [None req-aca1d619-7d32-449a-88d1-30515fe1d36f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87027) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 17:35:02.169833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG passlib.handlers.bcrypt [None req-aca1d619-7d32-449a-88d1-30515fe1d36f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87027) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 17:35:02.187268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:02.209841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e7f97-b8b3-49fa-b06d-3102356d35e4 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:02.218610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-aca1d619-7d32-449a-88d1-30515fe1d36f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:02.220253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-aca1d619-7d32-449a-88d1-30515fe1d36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:02.237718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:02.328157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e7f97-b8b3-49fa-b06d-3102356d35e4 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:02.337041 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:02.365238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1d619-7d32-449a-88d1-30515fe1d36f None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:02.367660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76a91f-e4f5-429f-aa07-5df8e65dcfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:02.368337 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76a91f-e4f5-429f-aa07-5df8e65dcfeb None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:02.368663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76a91f-e4f5-429f-aa07-5df8e65dcfeb None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:02.368953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76a91f-e4f5-429f-aa07-5df8e65dcfeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:02.459473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76a91f-e4f5-429f-aa07-5df8e65dcfeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:02.461117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76a91f-e4f5-429f-aa07-5df8e65dcfeb None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:02.487575 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:02.504448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1d619-7d32-449a-88d1-30515fe1d36f None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:02.507692 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:02.549755 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da88df2-ab68-416c-ab01-fa08ef9986a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:02.551136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da88df2-ab68-416c-ab01-fa08ef9986a1 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:02.551522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da88df2-ab68-416c-ab01-fa08ef9986a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:02.551886 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da88df2-ab68-416c-ab01-fa08ef9986a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:02.565548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da88df2-ab68-416c-ab01-fa08ef9986a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-3da88df2-ab68-416c-ab01-fa08ef9986a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:02.578610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:02.579758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:02.580677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:02.580677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:02.580677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:02.580677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:02.580677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:02.580677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:02.580677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:02.580677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:02.580677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:02.580677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:02.580677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:02.580677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:02.582737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 8/14] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:35:02.584160 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 7/15] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 17:35:02.589018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da88df2-ab68-416c-ab01-fa08ef9986a1 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:02.594403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76a91f-e4f5-429f-aa07-5df8e65dcfeb None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:02.710213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76a91f-e4f5-429f-aa07-5df8e65dcfeb None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:02.725704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da88df2-ab68-416c-ab01-fa08ef9986a1 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:02.737698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:02.751538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0d69c-b4bd-40b8-9d42-a4997e7e60d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:02.752444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d69c-b4bd-40b8-9d42-a4997e7e60d5 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:02.753062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d69c-b4bd-40b8-9d42-a4997e7e60d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:02.753407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d69c-b4bd-40b8-9d42-a4997e7e60d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:02.768714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0d69c-b4bd-40b8-9d42-a4997e7e60d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:02.770574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0d69c-b4bd-40b8-9d42-a4997e7e60d5 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:02.770781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7efb07-8dd2-4b2a-b6b5-9bfd4904c222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:02.771466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7efb07-8dd2-4b2a-b6b5-9bfd4904c222 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:02.771743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7efb07-8dd2-4b2a-b6b5-9bfd4904c222 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:02.772015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7efb07-8dd2-4b2a-b6b5-9bfd4904c222 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:02.772828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7efb07-8dd2-4b2a-b6b5-9bfd4904c222 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:02.773143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7efb07-8dd2-4b2a-b6b5-9bfd4904c222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:02.774597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7efb07-8dd2-4b2a-b6b5-9bfd4904c222 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:02.789057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 9/16] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:02.795124 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7efb07-8dd2-4b2a-b6b5-9bfd4904c222 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-11d0d69c-b4bd-40b8-9d42-a4997e7e60d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:35:02.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:02.803439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:02.804705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:35:02.804705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:35:02.804705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:35:02.804705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:02.804705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 8/17] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:35:02.804705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0d69c-b4bd-40b8-9d42-a4997e7e60d5 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:02.830142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:02.911580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7efb07-8dd2-4b2a-b6b5-9bfd4904c222 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:02.922356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0d69c-b4bd-40b8-9d42-a4997e7e60d5 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:02.953258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654aa29-a9cf-40b2-bb4f-bb1ae4c12302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:02.954164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654aa29-a9cf-40b2-bb4f-bb1ae4c12302 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:02.954448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654aa29-a9cf-40b2-bb4f-bb1ae4c12302 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:02.954721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654aa29-a9cf-40b2-bb4f-bb1ae4c12302 None admin] PATH_INFO: `/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:02.956361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654aa29-a9cf-40b2-bb4f-bb1ae4c12302 None admin] RBAC: Authorizing `identity:get_user(user_id=3bfdcdc4e8594f169e8c27a8c1db7913)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:02.957914 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654aa29-a9cf-40b2-bb4f-bb1ae4c12302 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:02.959602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:02 2022] GET /identity/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:02.965308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654aa29-a9cf-40b2-bb4f-bb1ae4c12302 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:02.965464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa73328-5494-4da6-bd82-f5dacc5fb83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:02.966014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa73328-5494-4da6-bd82-f5dacc5fb83e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:02.966285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa73328-5494-4da6-bd82-f5dacc5fb83e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:02.966561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa73328-5494-4da6-bd82-f5dacc5fb83e None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:02.967387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa73328-5494-4da6-bd82-f5dacc5fb83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:02.967619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa73328-5494-4da6-bd82-f5dacc5fb83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:02.969080 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa73328-5494-4da6-bd82-f5dacc5fb83e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:02.987687 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:03.110021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:03.118310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654aa29-a9cf-40b2-bb4f-bb1ae4c12302 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:03.158594 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e08cd-b5aa-4d07-bcac-7839b7fad2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:03.159194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e08cd-b5aa-4d07-bcac-7839b7fad2f9 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:03.160196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e08cd-b5aa-4d07-bcac-7839b7fad2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:03.160499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e08cd-b5aa-4d07-bcac-7839b7fad2f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:03.161776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e08cd-b5aa-4d07-bcac-7839b7fad2f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:03.163253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e08cd-b5aa-4d07-bcac-7839b7fad2f9 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:03.169248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:03.177582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa73328-5494-4da6-bd82-f5dacc5fb83e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:03.221956 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:03.303992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa73328-5494-4da6-bd82-f5dacc5fb83e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:03.345613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3684c-296e-42d9-aafe-8502ab6478c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:03.346301 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3684c-296e-42d9-aafe-8502ab6478c8 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:03.346643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3684c-296e-42d9-aafe-8502ab6478c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:03.346944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3684c-296e-42d9-aafe-8502ab6478c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:03.347729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3684c-296e-42d9-aafe-8502ab6478c8 None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.domain.id=default, user.id=3bfdcdc4e8594f169e8c27a8c1db7913) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:03.348044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3684c-296e-42d9-aafe-8502ab6478c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:03.349568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3684c-296e-42d9-aafe-8502ab6478c8 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:03.358643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Jul 20 17:35:03 2022] GET /identity/v3/role_assignments?user.id=3bfdcdc4e8594f169e8c27a8c1db7913&scope.domain.id=default&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 233 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:05.813697 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279658e8-c320-4ac9-b5a9-303dbdc4404e None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:05.815289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279658e8-c320-4ac9-b5a9-303dbdc4404e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:05.816053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279658e8-c320-4ac9-b5a9-303dbdc4404e None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:05.819359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:05.825468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42568926-9a6c-4a2a-82b7-78ffbe781b96 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:05.826210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42568926-9a6c-4a2a-82b7-78ffbe781b96 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:05.826210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42568926-9a6c-4a2a-82b7-78ffbe781b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:05.854665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-42568926-9a6c-4a2a-82b7-78ffbe781b96 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:05.857056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-42568926-9a6c-4a2a-82b7-78ffbe781b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:05.972888 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 11/23] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:06.017540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279658e8-c320-4ac9-b5a9-303dbdc4404e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:06.082937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff99fd8-53b1-4fb3-a147-84a753ed5d25 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:06.083190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff99fd8-53b1-4fb3-a147-84a753ed5d25 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:06.083482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff99fd8-53b1-4fb3-a147-84a753ed5d25 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:06.085116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:35:06.090537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7e4b5-604d-4fbd-af65-fbe679fc5d67 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:06.090911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7e4b5-604d-4fbd-af65-fbe679fc5d67 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:06.091290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7e4b5-604d-4fbd-af65-fbe679fc5d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:06.118922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-11a7e4b5-604d-4fbd-af65-fbe679fc5d67 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:06.120202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-11a7e4b5-604d-4fbd-af65-fbe679fc5d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:06.176207 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:06.248285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279658e8-c320-4ac9-b5a9-303dbdc4404e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:06.302421 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 13/25] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:06.303598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc94db7-4846-4a10-9c10-7d65a401db50 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:06.303863 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc94db7-4846-4a10-9c10-7d65a401db50 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:06.304107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc94db7-4846-4a10-9c10-7d65a401db50 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:06.305837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 14/26] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:06.316623 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf5d1b-1988-4284-ac88-ec9fde9aa942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:06.318048 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e83d-e78e-4611-b90e-14fdf42dc353 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:06.318342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e83d-e78e-4611-b90e-14fdf42dc353 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:06.318618 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e83d-e78e-4611-b90e-14fdf42dc353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:06.319199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5d1b-1988-4284-ac88-ec9fde9aa942 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:06.320139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5d1b-1988-4284-ac88-ec9fde9aa942 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:06.320996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5d1b-1988-4284-ac88-ec9fde9aa942 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:06.322842 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf5d1b-1988-4284-ac88-ec9fde9aa942 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:06.329085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf5d1b-1988-4284-ac88-ec9fde9aa942 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:06.364130 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-0129e83d-e78e-4611-b90e-14fdf42dc353 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:06.366549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0129e83d-e78e-4611-b90e-14fdf42dc353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:06.472402 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 15/27] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:06.473317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129e83d-e78e-4611-b90e-14fdf42dc353 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:06.584698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:06.609469 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129e83d-e78e-4611-b90e-14fdf42dc353 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:06.636797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 13/28] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jul 20 17:35:06 2022] POST /identity/v3/roles => generated 219 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:06.638603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47812453-65f6-4859-b915-2aca31075cb5 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:06.638891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47812453-65f6-4859-b915-2aca31075cb5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:06.639173 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47812453-65f6-4859-b915-2aca31075cb5 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:06.640912 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 14/29] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:06.642212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47812453-65f6-4859-b915-2aca31075cb5 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:06.675683 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:06.683455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7cd9f-0a69-44f7-b073-b275296bb421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:06.685543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7cd9f-0a69-44f7-b073-b275296bb421 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:06.686184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7cd9f-0a69-44f7-b073-b275296bb421 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:06.686937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7cd9f-0a69-44f7-b073-b275296bb421 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:06.689088 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7cd9f-0a69-44f7-b073-b275296bb421 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:06.691990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7cd9f-0a69-44f7-b073-b275296bb421 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:06.808566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47812453-65f6-4859-b915-2aca31075cb5 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:06.868384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b25ee-4c9b-4691-8839-bacf51a4f5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:06.869716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b25ee-4c9b-4691-8839-bacf51a4f5c8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:06.870199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b25ee-4c9b-4691-8839-bacf51a4f5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:06.870672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b25ee-4c9b-4691-8839-bacf51a4f5c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:06.910514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b25ee-4c9b-4691-8839-bacf51a4f5c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:06.915739 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b25ee-4c9b-4691-8839-bacf51a4f5c8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-050b25ee-4c9b-4691-8839-bacf51a4f5c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:35:06.951723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:06.953746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:06.956219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:35:06.956219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:35:06.956219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:35:06.956219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:06.956219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 15/30] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:06.957021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096c038-28d4-489c-acf5-6f8c156c95eb None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:06.957531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096c038-28d4-489c-acf5-6f8c156c95eb None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:06.958028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096c038-28d4-489c-acf5-6f8c156c95eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:06.991036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-0096c038-28d4-489c-acf5-6f8c156c95eb None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:06.994000 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0096c038-28d4-489c-acf5-6f8c156c95eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:07.076050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 16/31] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jul 20 17:35:06 2022] POST /identity/v3/roles => generated 225 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:07.079065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7cd9f-0a69-44f7-b073-b275296bb421 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:07.130227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 16/32] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:07.175976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096c038-28d4-489c-acf5-6f8c156c95eb None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:07.176853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:07.332964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7cd9f-0a69-44f7-b073-b275296bb421 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:07.374989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096c038-28d4-489c-acf5-6f8c156c95eb None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:07.434751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e262d-d685-49ef-879e-30e63eb72731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:07.435776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e262d-d685-49ef-879e-30e63eb72731 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:07.436307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e262d-d685-49ef-879e-30e63eb72731 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:07.436858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e262d-d685-49ef-879e-30e63eb72731 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:07.439274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e262d-d685-49ef-879e-30e63eb72731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:07.441796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e262d-d685-49ef-879e-30e63eb72731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:07.444600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e262d-d685-49ef-879e-30e63eb72731 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:07.472917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 17/33] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:07.479512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e262d-d685-49ef-879e-30e63eb72731 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:07.479922 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f92ed-a24e-4bf5-b9fa-a16227111198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:07.483590 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f92ed-a24e-4bf5-b9fa-a16227111198 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:07.484141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f92ed-a24e-4bf5-b9fa-a16227111198 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:07.484748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f92ed-a24e-4bf5-b9fa-a16227111198 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:07.495468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:07.513463 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f92ed-a24e-4bf5-b9fa-a16227111198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-416f92ed-a24e-4bf5-b9fa-a16227111198 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:07.532211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:07.533938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:07.536895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 17/34] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:35:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:07.548552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f92ed-a24e-4bf5-b9fa-a16227111198 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:07.691912 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:07.709655 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e262d-d685-49ef-879e-30e63eb72731 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:07.776459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f92ed-a24e-4bf5-b9fa-a16227111198 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:07.847005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d8197-10a9-425e-a9f7-6d2c58d14761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:07.848186 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d8197-10a9-425e-a9f7-6d2c58d14761 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:07.848736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d8197-10a9-425e-a9f7-6d2c58d14761 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:07.849240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d8197-10a9-425e-a9f7-6d2c58d14761 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:07.850684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d8197-10a9-425e-a9f7-6d2c58d14761 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:07.851259 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d8197-10a9-425e-a9f7-6d2c58d14761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:07.853999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d8197-10a9-425e-a9f7-6d2c58d14761 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:07.880295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 18/35] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:07.880295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f1bd5-3eb7-42a2-b52f-9081535aa5ac None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:07.880295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f1bd5-3eb7-42a2-b52f-9081535aa5ac None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:07.880295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f1bd5-3eb7-42a2-b52f-9081535aa5ac None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:07.880295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:07.885152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f1bd5-3eb7-42a2-b52f-9081535aa5ac None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:07.897498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f627d-da95-425c-b69c-e9b1b2f18277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:07.898180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f627d-da95-425c-b69c-e9b1b2f18277 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:07.898463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f627d-da95-425c-b69c-e9b1b2f18277 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:07.898745 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f627d-da95-425c-b69c-e9b1b2f18277 None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:07.899488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f627d-da95-425c-b69c-e9b1b2f18277 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:07.901035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f627d-da95-425c-b69c-e9b1b2f18277 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:08.027838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f1bd5-3eb7-42a2-b52f-9081535aa5ac None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:08.052298 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:35:07 2022] POST /identity/v3/projects => generated 301 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:08.053751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc194d53-bf48-44e6-a909-a1bdcbc68460 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:08.054045 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc194d53-bf48-44e6-a909-a1bdcbc68460 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:08.054331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc194d53-bf48-44e6-a909-a1bdcbc68460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:08.064318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:08.074673 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e3e8f-85d4-40e3-b234-ad012c033ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:08.075644 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e3e8f-85d4-40e3-b234-ad012c033ff4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:08.075949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e3e8f-85d4-40e3-b234-ad012c033ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:08.076233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e3e8f-85d4-40e3-b234-ad012c033ff4 None admin] PATH_INFO: `/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:08.078357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e3e8f-85d4-40e3-b234-ad012c033ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=3bfdcdc4e8594f169e8c27a8c1db7913)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:08.079601 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e3e8f-85d4-40e3-b234-ad012c033ff4 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:08.081737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:07 2022] GET /identity/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913 => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:08.082959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9737566-0fa1-46d7-8285-af128e3e473c None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:08.083232 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9737566-0fa1-46d7-8285-af128e3e473c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:08.083585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9737566-0fa1-46d7-8285-af128e3e473c None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:08.085253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 21/39] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:08.090494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9737566-0fa1-46d7-8285-af128e3e473c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:08.095821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-bc194d53-bf48-44e6-a909-a1bdcbc68460 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:08.098605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bc194d53-bf48-44e6-a909-a1bdcbc68460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:08.174999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:08.189046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 19/40] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:08.196903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032c55d-4f65-4aac-9f5d-eddfd5548533 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:08.196903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032c55d-4f65-4aac-9f5d-eddfd5548533 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:08.196903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032c55d-4f65-4aac-9f5d-eddfd5548533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:08.217404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e032c55d-4f65-4aac-9f5d-eddfd5548533 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:08.218644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e032c55d-4f65-4aac-9f5d-eddfd5548533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:08.231849 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9737566-0fa1-46d7-8285-af128e3e473c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:08.275040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fefbf-1c19-41d2-914b-5e1d686b42aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:08.275881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fefbf-1c19-41d2-914b-5e1d686b42aa None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:08.276166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fefbf-1c19-41d2-914b-5e1d686b42aa None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:08.276545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fefbf-1c19-41d2-914b-5e1d686b42aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:08.278350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fefbf-1c19-41d2-914b-5e1d686b42aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:08.279903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fefbf-1c19-41d2-914b-5e1d686b42aa None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:08.282091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 22/41] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:08.284528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fefbf-1c19-41d2-914b-5e1d686b42aa None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:08.304931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 20/42] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:08.305828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032c55d-4f65-4aac-9f5d-eddfd5548533 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:08.388375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:08.432899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032c55d-4f65-4aac-9f5d-eddfd5548533 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:08.448292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fefbf-1c19-41d2-914b-5e1d686b42aa None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:08.458296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:08.478320 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2ae3a-adf2-4d3c-8880-4bf5884f00b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:08.479770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2ae3a-adf2-4d3c-8880-4bf5884f00b0 None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:08.480116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2ae3a-adf2-4d3c-8880-4bf5884f00b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:08.481165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2ae3a-adf2-4d3c-8880-4bf5884f00b0 None admin] PATH_INFO: `/v3/domains/default/users/3bfdcdc4e8594f169e8c27a8c1db7913/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:08.484386 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2ae3a-adf2-4d3c-8880-4bf5884f00b0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3bfdcdc4e8594f169e8c27a8c1db7913, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:08.486538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2ae3a-adf2-4d3c-8880-4bf5884f00b0 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:08.491800 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd5e74-14a6-4b99-a454-2430cd3cd97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:08.492750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd5e74-14a6-4b99-a454-2430cd3cd97e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:08.492965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd5e74-14a6-4b99-a454-2430cd3cd97e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:08.493247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd5e74-14a6-4b99-a454-2430cd3cd97e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:08.494479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd5e74-14a6-4b99-a454-2430cd3cd97e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:08.495963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd5e74-14a6-4b99-a454-2430cd3cd97e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:08.498313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 23/43] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:08.499200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd5e74-14a6-4b99-a454-2430cd3cd97e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:08.604845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 21/44] 10.222.0.27 () {58 vars in 1361 bytes} [Wed Jul 20 17:35:08 2022] PUT /identity/v3/domains/default/users/3bfdcdc4e8594f169e8c27a8c1db7913/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:35:08.606179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2ae3a-adf2-4d3c-8880-4bf5884f00b0 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:08.619553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd5e74-14a6-4b99-a454-2430cd3cd97e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:08.673199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:08.679653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c326057-0eba-4eef-9c81-9c205e4bd658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:08.680367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c326057-0eba-4eef-9c81-9c205e4bd658 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:08.680693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c326057-0eba-4eef-9c81-9c205e4bd658 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:08.681046 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c326057-0eba-4eef-9c81-9c205e4bd658 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:08.681775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c326057-0eba-4eef-9c81-9c205e4bd658 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:08.683247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c326057-0eba-4eef-9c81-9c205e4bd658 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:08.802845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2ae3a-adf2-4d3c-8880-4bf5884f00b0 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:08.812799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 24/45] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jul 20 17:35:08 2022] POST /identity/v3/roles => generated 223 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:08.874476 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf551105-eec8-463d-934a-6624bca0ad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:08.875134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551105-eec8-463d-934a-6624bca0ad25 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:08.875429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551105-eec8-463d-934a-6624bca0ad25 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:08.875721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551105-eec8-463d-934a-6624bca0ad25 None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:08.876577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf551105-eec8-463d-934a-6624bca0ad25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:08.878781 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf551105-eec8-463d-934a-6624bca0ad25 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:08.997596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 22/46] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:35:08 2022] POST /identity/v3/projects => generated 312 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:10.876153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a710d3-6d28-4c36-990b-005562dcc42b None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:10.876787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a710d3-6d28-4c36-990b-005562dcc42b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:10.877135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a710d3-6d28-4c36-990b-005562dcc42b None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:10.879774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 25/47] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:10.889206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b8d6f-7085-4faf-812e-527d92da3d10 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:10.890035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b8d6f-7085-4faf-812e-527d92da3d10 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:10.890191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b8d6f-7085-4faf-812e-527d92da3d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:10.911303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-448b8d6f-7085-4faf-812e-527d92da3d10 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:10.912787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-448b8d6f-7085-4faf-812e-527d92da3d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:10.942541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:10.989882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:11.014709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a710d3-6d28-4c36-990b-005562dcc42b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:11.163716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a710d3-6d28-4c36-990b-005562dcc42b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:11.171678 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d316f-47bf-4f5a-99df-4264bb844df9 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:11.171972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d316f-47bf-4f5a-99df-4264bb844df9 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:11.172258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d316f-47bf-4f5a-99df-4264bb844df9 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:11.173778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 24/49] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:35:11.179362 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96a0df-1682-43e6-9aa9-0f100dc9a086 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:11.179649 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96a0df-1682-43e6-9aa9-0f100dc9a086 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:11.179940 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96a0df-1682-43e6-9aa9-0f100dc9a086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:11.198155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-4b96a0df-1682-43e6-9aa9-0f100dc9a086 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:11.199428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4b96a0df-1682-43e6-9aa9-0f100dc9a086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:11.218333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a308a-f917-4223-869d-f2f74450499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:11.219288 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a308a-f917-4223-869d-f2f74450499b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:11.219647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a308a-f917-4223-869d-f2f74450499b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:11.220043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a308a-f917-4223-869d-f2f74450499b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:11.234469 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a308a-f917-4223-869d-f2f74450499b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-519a308a-f917-4223-869d-f2f74450499b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:11.246803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:11.248332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:11.249632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 26/50] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:11.256520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a308a-f917-4223-869d-f2f74450499b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:11.284829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 25/51] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:11.311195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96a0df-1682-43e6-9aa9-0f100dc9a086 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:11.451579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:11.452445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:11.462565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96a0df-1682-43e6-9aa9-0f100dc9a086 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:11.504973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a496c2-66fe-4069-9b79-db6ebdcee25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:11.505789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a496c2-66fe-4069-9b79-db6ebdcee25e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:11.506080 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a496c2-66fe-4069-9b79-db6ebdcee25e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:11.506396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a496c2-66fe-4069-9b79-db6ebdcee25e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:11.507637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a496c2-66fe-4069-9b79-db6ebdcee25e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:11.509213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a496c2-66fe-4069-9b79-db6ebdcee25e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:11.510992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 26/52] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:11.518290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a496c2-66fe-4069-9b79-db6ebdcee25e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:11.538259 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a308a-f917-4223-869d-f2f74450499b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:11.581899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f718c-e419-4b52-9823-24643c2b72ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:11.582941 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f718c-e419-4b52-9823-24643c2b72ad None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:11.583365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f718c-e419-4b52-9823-24643c2b72ad None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:11.583771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f718c-e419-4b52-9823-24643c2b72ad None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:11.584687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f718c-e419-4b52-9823-24643c2b72ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:11.585254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f718c-e419-4b52-9823-24643c2b72ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:11.587194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f718c-e419-4b52-9823-24643c2b72ad None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:11.598653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 27/53] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:11.608149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f718c-e419-4b52-9823-24643c2b72ad None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:11.673894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a496c2-66fe-4069-9b79-db6ebdcee25e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:11.713109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464ba9-d470-4bce-bd03-539f038e0154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:11.713813 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464ba9-d470-4bce-bd03-539f038e0154 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:11.714168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464ba9-d470-4bce-bd03-539f038e0154 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:11.714515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464ba9-d470-4bce-bd03-539f038e0154 None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:11.715731 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464ba9-d470-4bce-bd03-539f038e0154 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:11.717322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464ba9-d470-4bce-bd03-539f038e0154 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:11.718325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f718c-e419-4b52-9823-24643c2b72ad None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:11.734230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:11.755840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e37f1-dab8-4d6a-84f5-b779f7b243d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:11.756903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e37f1-dab8-4d6a-84f5-b779f7b243d3 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:11.757188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e37f1-dab8-4d6a-84f5-b779f7b243d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:11.757465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e37f1-dab8-4d6a-84f5-b779f7b243d3 None admin] PATH_INFO: `/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:11.758709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e37f1-dab8-4d6a-84f5-b779f7b243d3 None admin] RBAC: Authorizing `identity:get_user(user_id=3bfdcdc4e8594f169e8c27a8c1db7913)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:11.760152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e37f1-dab8-4d6a-84f5-b779f7b243d3 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:11.762382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 28/54] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:11 2022] GET /identity/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:11.768283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e37f1-dab8-4d6a-84f5-b779f7b243d3 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:11.818013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 27/55] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Jul 20 17:35:11 2022] POST /identity/v3/projects => generated 298 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:35:11.883338 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e37f1-dab8-4d6a-84f5-b779f7b243d3 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:11.926006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a70a6-a26c-47b6-aa54-d37fe6a95cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:11.926885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a70a6-a26c-47b6-aa54-d37fe6a95cd6 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:11.927179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a70a6-a26c-47b6-aa54-d37fe6a95cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:11.927466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a70a6-a26c-47b6-aa54-d37fe6a95cd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:11.929073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a70a6-a26c-47b6-aa54-d37fe6a95cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:11.930676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a70a6-a26c-47b6-aa54-d37fe6a95cd6 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:11.932668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 29/56] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:11.940252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464ba9-d470-4bce-bd03-539f038e0154 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:11.973817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:12.138559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464ba9-d470-4bce-bd03-539f038e0154 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:12.198398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f2c37-ca35-4a90-8e41-6c192e241fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:12.199411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2c37-ca35-4a90-8e41-6c192e241fb1 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:12.199705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2c37-ca35-4a90-8e41-6c192e241fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:12.199838 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f2c37-ca35-4a90-8e41-6c192e241fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:12.201215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f2c37-ca35-4a90-8e41-6c192e241fb1 None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.domain.id=default, user.id=3bfdcdc4e8594f169e8c27a8c1db7913) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:12.201622 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f2c37-ca35-4a90-8e41-6c192e241fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:12.203330 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f2c37-ca35-4a90-8e41-6c192e241fb1 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:12.210846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Jul 20 17:35:11 2022] GET /identity/v3/role_assignments?user.id=3bfdcdc4e8594f169e8c27a8c1db7913&scope.domain.id=default&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 530 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:13.966564 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec010a-5ddb-43a8-8e5f-13a25fb146ba None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:13.967164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec010a-5ddb-43a8-8e5f-13a25fb146ba None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:13.967164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec010a-5ddb-43a8-8e5f-13a25fb146ba None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:13.968546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 30/58] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:13.975590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ca453-90fa-4104-9a6e-e44ff69c62c4 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:13.976152 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ca453-90fa-4104-9a6e-e44ff69c62c4 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:13.976286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ca453-90fa-4104-9a6e-e44ff69c62c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:13.994421 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-a64ca453-90fa-4104-9a6e-e44ff69c62c4 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:13.995710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a64ca453-90fa-4104-9a6e-e44ff69c62c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:14.071298 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:14.096041 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec010a-5ddb-43a8-8e5f-13a25fb146ba None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:14.153928 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:14.206614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec010a-5ddb-43a8-8e5f-13a25fb146ba None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:14.242426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46f95d-ac75-4091-875f-74c182928f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:14.243144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f95d-ac75-4091-875f-74c182928f10 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:14.243432 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f95d-ac75-4091-875f-74c182928f10 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:14.243710 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f95d-ac75-4091-875f-74c182928f10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:14.244925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46f95d-ac75-4091-875f-74c182928f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:14.246430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46f95d-ac75-4091-875f-74c182928f10 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:14.248163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 31/60] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:14.253945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ca453-90fa-4104-9a6e-e44ff69c62c4 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:14.262377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:14.360559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ca453-90fa-4104-9a6e-e44ff69c62c4 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:14.399197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24173d-42a9-4bc7-9129-ca901434c2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:14.399888 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24173d-42a9-4bc7-9129-ca901434c2a1 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:14.400179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24173d-42a9-4bc7-9129-ca901434c2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:14.400464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24173d-42a9-4bc7-9129-ca901434c2a1 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:14.401233 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24173d-42a9-4bc7-9129-ca901434c2a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:14.403224 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24173d-42a9-4bc7-9129-ca901434c2a1 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:14.513461 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 30/61] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:35:14 2022] POST /identity/v3/users => generated 275 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:17.862772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff28607-dad8-4a41-b5b2-b4a023fdeb24 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:17.863795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff28607-dad8-4a41-b5b2-b4a023fdeb24 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:17.864323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff28607-dad8-4a41-b5b2-b4a023fdeb24 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:17.866321 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 32/62] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:17.872459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b97c1-a352-4819-b8a1-6bfa9133cc1c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:17.873408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b97c1-a352-4819-b8a1-6bfa9133cc1c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:17.873884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b97c1-a352-4819-b8a1-6bfa9133cc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:17.896315 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c76b97c1-a352-4819-b8a1-6bfa9133cc1c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:17.897915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c76b97c1-a352-4819-b8a1-6bfa9133cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:17.981440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:17.990343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 31/63] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:18.030320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff28607-dad8-4a41-b5b2-b4a023fdeb24 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:18.156053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44281b-d67a-4b84-8e0f-14af7b39f616 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:18.156495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44281b-d67a-4b84-8e0f-14af7b39f616 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:18.156982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44281b-d67a-4b84-8e0f-14af7b39f616 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:18.159708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 32/64] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:18.165918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751a4d6-f0a0-4d16-a6fe-6886cf5c50e6 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:18.166403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751a4d6-f0a0-4d16-a6fe-6886cf5c50e6 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:18.167082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751a4d6-f0a0-4d16-a6fe-6886cf5c50e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:18.219870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e751a4d6-f0a0-4d16-a6fe-6886cf5c50e6 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:18.223296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e751a4d6-f0a0-4d16-a6fe-6886cf5c50e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:18.338227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff28607-dad8-4a41-b5b2-b4a023fdeb24 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:18.377050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:18.383895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 33/65] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:18.418828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7772f79-238a-45ad-bc62-9603e354ebf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:18.419560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7772f79-238a-45ad-bc62-9603e354ebf5 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:18.419850 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7772f79-238a-45ad-bc62-9603e354ebf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:18.420128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7772f79-238a-45ad-bc62-9603e354ebf5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:18.434161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751a4d6-f0a0-4d16-a6fe-6886cf5c50e6 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:18.436416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7772f79-238a-45ad-bc62-9603e354ebf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-e7772f79-238a-45ad-bc62-9603e354ebf5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:18.444289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:18.445366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:18.446306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:18.446306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:18.446306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:18.446306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:18.446306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:18.446306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:18.446306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:18.446306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:18.446306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:18.446306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:18.446306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:18.446306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:18.448371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 33/66] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:18.459403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7772f79-238a-45ad-bc62-9603e354ebf5 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:18.630235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7772f79-238a-45ad-bc62-9603e354ebf5 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:18.644277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751a4d6-f0a0-4d16-a6fe-6886cf5c50e6 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:18.665430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af526ad2-d678-4e61-97a4-3d842b6a655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:18.666123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af526ad2-d678-4e61-97a4-3d842b6a655d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:18.666412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af526ad2-d678-4e61-97a4-3d842b6a655d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:18.666693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af526ad2-d678-4e61-97a4-3d842b6a655d None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:18.668385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af526ad2-d678-4e61-97a4-3d842b6a655d None admin] RBAC: Adding query filter params (name=member) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:18.668733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af526ad2-d678-4e61-97a4-3d842b6a655d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:18.670198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af526ad2-d678-4e61-97a4-3d842b6a655d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:18.679862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 34/67] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:18.681051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60ee78-004d-40a0-8277-d13e528d7c2b None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:18.681343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60ee78-004d-40a0-8277-d13e528d7c2b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:18.681632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60ee78-004d-40a0-8277-d13e528d7c2b None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:18.683241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 35/68] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:18.684557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d235c-1dd3-44e4-a29a-f5de05ddf3c7 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:18.684851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d235c-1dd3-44e4-a29a-f5de05ddf3c7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:18.685134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d235c-1dd3-44e4-a29a-f5de05ddf3c7 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:18.689934 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:18.691032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 36/69] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:18.692469 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee88a37-9ff5-4a6b-93fa-9abcd5f752b8 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:18.692788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee88a37-9ff5-4a6b-93fa-9abcd5f752b8 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:18.693078 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee88a37-9ff5-4a6b-93fa-9abcd5f752b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:18.704666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf89dff-39d3-4e18-b8ab-3b132220d422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:18.711659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf89dff-39d3-4e18-b8ab-3b132220d422 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:18.711659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf89dff-39d3-4e18-b8ab-3b132220d422 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:18.711659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf89dff-39d3-4e18-b8ab-3b132220d422 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:18.713448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-fee88a37-9ff5-4a6b-93fa-9abcd5f752b8 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:18.715245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-fee88a37-9ff5-4a6b-93fa-9abcd5f752b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:18.721313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf89dff-39d3-4e18-b8ab-3b132220d422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-fdf89dff-39d3-4e18-b8ab-3b132220d422 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:18.732779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:18.733695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:18.734457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 34/70] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:35:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:18.735086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf89dff-39d3-4e18-b8ab-3b132220d422 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:18.760874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:18.812508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 37/71] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:18.812508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616f957-8dbe-4c66-8e34-41c6c6a01065 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:18.812508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616f957-8dbe-4c66-8e34-41c6c6a01065 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:18.812508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616f957-8dbe-4c66-8e34-41c6c6a01065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:18.838961 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a616f957-8dbe-4c66-8e34-41c6c6a01065 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:18.841975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a616f957-8dbe-4c66-8e34-41c6c6a01065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:18.913752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf89dff-39d3-4e18-b8ab-3b132220d422 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:18.964724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 38/72] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:18.964724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616f957-8dbe-4c66-8e34-41c6c6a01065 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:18.980403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31140e-ba11-48c9-bc3b-c7848b2702af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:18.982021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31140e-ba11-48c9-bc3b-c7848b2702af None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:18.982568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31140e-ba11-48c9-bc3b-c7848b2702af None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:18.983080 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31140e-ba11-48c9-bc3b-c7848b2702af None admin] PATH_INFO: `/v3/users/bfffc73d00654d0cb9d9f3571a6a926d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:19.006971 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31140e-ba11-48c9-bc3b-c7848b2702af None admin] RBAC: Authorizing `identity:get_user(user_id=bfffc73d00654d0cb9d9f3571a6a926d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:19.009473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31140e-ba11-48c9-bc3b-c7848b2702af None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:19.017703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 35/73] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:18 2022] GET /identity/v3/users/bfffc73d00654d0cb9d9f3571a6a926d => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:19.017703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31140e-ba11-48c9-bc3b-c7848b2702af None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:19.090507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:19.120963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:19.125962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616f957-8dbe-4c66-8e34-41c6c6a01065 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:19.170344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31140e-ba11-48c9-bc3b-c7848b2702af None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:19.171674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d880-e718-4189-be22-c8e52f2ccb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:19.172795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d880-e718-4189-be22-c8e52f2ccb7d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:19.173273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d880-e718-4189-be22-c8e52f2ccb7d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:19.173751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d880-e718-4189-be22-c8e52f2ccb7d None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:19.174975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d880-e718-4189-be22-c8e52f2ccb7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:19.175509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d880-e718-4189-be22-c8e52f2ccb7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:19.177652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d880-e718-4189-be22-c8e52f2ccb7d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:19.191115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 39/74] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:35:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:19.192449 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d880-e718-4189-be22-c8e52f2ccb7d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:19.222143 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c99df9-b3ec-44ce-b431-bdc4ab9f12ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:19.222859 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c99df9-b3ec-44ce-b431-bdc4ab9f12ec None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:19.223142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c99df9-b3ec-44ce-b431-bdc4ab9f12ec None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:19.223418 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c99df9-b3ec-44ce-b431-bdc4ab9f12ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:19.234320 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c99df9-b3ec-44ce-b431-bdc4ab9f12ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-f4c99df9-b3ec-44ce-b431-bdc4ab9f12ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:19.242292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:19.243827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 36/75] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:19.245351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c99df9-b3ec-44ce-b431-bdc4ab9f12ec None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:19.310687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d880-e718-4189-be22-c8e52f2ccb7d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:19.352175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89e8f0-fda5-49ba-bf75-e4e825a92b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:19.353188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89e8f0-fda5-49ba-bf75-e4e825a92b77 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:19.353523 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89e8f0-fda5-49ba-bf75-e4e825a92b77 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:19.353938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89e8f0-fda5-49ba-bf75-e4e825a92b77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:19.357212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:19.360176 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c99df9-b3ec-44ce-b431-bdc4ab9f12ec None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:19.367682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89e8f0-fda5-49ba-bf75-e4e825a92b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-2e89e8f0-fda5-49ba-bf75-e4e825a92b77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:19.376266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:19.378213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 40/76] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:35:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:19.379715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962ac33-1866-4fd0-ab96-90e113fef1be None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:19.381963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962ac33-1866-4fd0-ab96-90e113fef1be None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:19.381963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962ac33-1866-4fd0-ab96-90e113fef1be None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:19.381963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 41/77] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:19.381963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962ac33-1866-4fd0-ab96-90e113fef1be None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:19.409089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:19.410701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5348-bd69-469b-99af-0eee4ee8bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:19.411492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5348-bd69-469b-99af-0eee4ee8bf80 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:19.411836 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5348-bd69-469b-99af-0eee4ee8bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:19.412177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5348-bd69-469b-99af-0eee4ee8bf80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:19.487494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5348-bd69-469b-99af-0eee4ee8bf80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:19.488965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5348-bd69-469b-99af-0eee4ee8bf80 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:19.499112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962ac33-1866-4fd0-ab96-90e113fef1be None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:19.537251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e4d7c-54c7-46bd-9b5f-610c6be5f130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:19.538137 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e4d7c-54c7-46bd-9b5f-610c6be5f130 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:19.538423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e4d7c-54c7-46bd-9b5f-610c6be5f130 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:19.538709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e4d7c-54c7-46bd-9b5f-610c6be5f130 None admin] PATH_INFO: `/v3/users/bfffc73d00654d0cb9d9f3571a6a926d` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:19.539974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e4d7c-54c7-46bd-9b5f-610c6be5f130 None admin] RBAC: Authorizing `identity:get_user(user_id=bfffc73d00654d0cb9d9f3571a6a926d)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:19.541532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e4d7c-54c7-46bd-9b5f-610c6be5f130 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:19.543588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 42/78] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:19 2022] GET /identity/v3/users/bfffc73d00654d0cb9d9f3571a6a926d => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:19.544409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e4d7c-54c7-46bd-9b5f-610c6be5f130 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:19.613839 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:19.618176 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 37/79] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:19.619618 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5348-bd69-469b-99af-0eee4ee8bf80 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:19.669635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:19.688689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e4d7c-54c7-46bd-9b5f-610c6be5f130 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:19.740354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680c960-c0f1-4e30-b7b5-9c1570054203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:19.741117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c960-c0f1-4e30-b7b5-9c1570054203 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:19.741724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c960-c0f1-4e30-b7b5-9c1570054203 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:19.742065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c960-c0f1-4e30-b7b5-9c1570054203 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:19.743098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680c960-c0f1-4e30-b7b5-9c1570054203 None admin] RBAC: Adding query filter params (name=member) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:19.743502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680c960-c0f1-4e30-b7b5-9c1570054203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:19.745149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680c960-c0f1-4e30-b7b5-9c1570054203 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:19.755995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 43/80] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:19.757731 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682d172-7bfa-4e75-b2dd-0cc3581aca5c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:19.758168 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682d172-7bfa-4e75-b2dd-0cc3581aca5c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:19.758642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682d172-7bfa-4e75-b2dd-0cc3581aca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:19.772297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5348-bd69-469b-99af-0eee4ee8bf80 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:19.783728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-d682d172-7bfa-4e75-b2dd-0cc3581aca5c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:19.785583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d682d172-7bfa-4e75-b2dd-0cc3581aca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:19.828420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad53d0e-5d29-40ac-8217-697918b4f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:19.829242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad53d0e-5d29-40ac-8217-697918b4f943 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:19.829595 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad53d0e-5d29-40ac-8217-697918b4f943 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:19.829999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad53d0e-5d29-40ac-8217-697918b4f943 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:19.830950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad53d0e-5d29-40ac-8217-697918b4f943 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:19.831384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad53d0e-5d29-40ac-8217-697918b4f943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:19.833062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad53d0e-5d29-40ac-8217-697918b4f943 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:19.849077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 38/81] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:19.850109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad53d0e-5d29-40ac-8217-697918b4f943 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:19.900759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 44/82] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:19.900759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682d172-7bfa-4e75-b2dd-0cc3581aca5c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:19.958455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:20.001031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:20.006493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad53d0e-5d29-40ac-8217-697918b4f943 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:20.029910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682d172-7bfa-4e75-b2dd-0cc3581aca5c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:20.060132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee1f77-acbb-4e11-aea2-c462a5a739a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:20.061210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee1f77-acbb-4e11-aea2-c462a5a739a8 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:20.061674 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee1f77-acbb-4e11-aea2-c462a5a739a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:20.062130 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee1f77-acbb-4e11-aea2-c462a5a739a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:20.082832 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406c901-0921-4cea-bf83-48638350da01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:20.083861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c901-0921-4cea-bf83-48638350da01 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:20.084212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c901-0921-4cea-bf83-48638350da01 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:20.084625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406c901-0921-4cea-bf83-48638350da01 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:20.086096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406c901-0921-4cea-bf83-48638350da01 None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:20.087786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406c901-0921-4cea-bf83-48638350da01 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:20.090258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 45/83] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:19 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:20.091352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406c901-0921-4cea-bf83-48638350da01 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:20.169693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee1f77-acbb-4e11-aea2-c462a5a739a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:20.172298 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee1f77-acbb-4e11-aea2-c462a5a739a8 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:20.231712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406c901-0921-4cea-bf83-48638350da01 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:20.260231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:20.287584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd6c8f-a801-4bd0-8ac7-21c9cd981910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:20.289061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd6c8f-a801-4bd0-8ac7-21c9cd981910 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:20.289520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd6c8f-a801-4bd0-8ac7-21c9cd981910 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:20.289961 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd6c8f-a801-4bd0-8ac7-21c9cd981910 None admin] PATH_INFO: `/v3/users/bfffc73d00654d0cb9d9f3571a6a926d` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:20.291988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd6c8f-a801-4bd0-8ac7-21c9cd981910 None admin] RBAC: Authorizing `identity:get_user(user_id=bfffc73d00654d0cb9d9f3571a6a926d)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:20.294590 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd6c8f-a801-4bd0-8ac7-21c9cd981910 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:20.303019 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 46/84] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:20 2022] GET /identity/v3/users/bfffc73d00654d0cb9d9f3571a6a926d => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:20.303019 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd6c8f-a801-4bd0-8ac7-21c9cd981910 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:20.331592 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 39/85] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:20.331592 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee1f77-acbb-4e11-aea2-c462a5a739a8 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:20.333824 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:20.451092 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd6c8f-a801-4bd0-8ac7-21c9cd981910 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:20.468605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee1f77-acbb-4e11-aea2-c462a5a739a8 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:20.492949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2a07e-022e-4028-9c3b-eedd73bfa115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:20.494010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2a07e-022e-4028-9c3b-eedd73bfa115 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:20.494380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2a07e-022e-4028-9c3b-eedd73bfa115 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:20.494747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2a07e-022e-4028-9c3b-eedd73bfa115 None admin] PATH_INFO: `/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:20.496802 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2a07e-022e-4028-9c3b-eedd73bfa115 None admin] RBAC: Authorizing `identity:get_user(user_id=3bfdcdc4e8594f169e8c27a8c1db7913)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:20.498713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2a07e-022e-4028-9c3b-eedd73bfa115 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:20.500579 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 47/86] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:20 2022] GET /identity/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:20.501752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2a07e-022e-4028-9c3b-eedd73bfa115 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:20.513206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa071b4a-d5a6-466b-a097-602e29427054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:20.514235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa071b4a-d5a6-466b-a097-602e29427054 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:20.514639 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa071b4a-d5a6-466b-a097-602e29427054 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:20.514951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa071b4a-d5a6-466b-a097-602e29427054 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:20.516256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa071b4a-d5a6-466b-a097-602e29427054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:20.518177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa071b4a-d5a6-466b-a097-602e29427054 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:20.519990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 40/87] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:20.520982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa071b4a-d5a6-466b-a097-602e29427054 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:20.561494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:20.615178 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:20.642521 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2a07e-022e-4028-9c3b-eedd73bfa115 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:20.663611 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa071b4a-d5a6-466b-a097-602e29427054 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:20.695196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ec4f8-f810-4cb9-9e8f-49664fb5aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:20.696003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ec4f8-f810-4cb9-9e8f-49664fb5aa08 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:20.696388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ec4f8-f810-4cb9-9e8f-49664fb5aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:20.696754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ec4f8-f810-4cb9-9e8f-49664fb5aa08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:20.698165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ec4f8-f810-4cb9-9e8f-49664fb5aa08 None admin] RBAC: Adding query filter params (role.id=0f0e06be5d684398a453fa6312e57d41, scope.project.id=0d047530c703494197e4bf5f63aec8df, user.id=bfffc73d00654d0cb9d9f3571a6a926d) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:20.699233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ec4f8-f810-4cb9-9e8f-49664fb5aa08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:20.701802 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ec4f8-f810-4cb9-9e8f-49664fb5aa08 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:20.714659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18def63b-8aff-44ce-8df0-d13038b3c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:20.715238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 48/88] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:20 2022] GET /identity/v3/role_assignments?user.id=bfffc73d00654d0cb9d9f3571a6a926d&scope.project.id=0d047530c703494197e4bf5f63aec8df&role.id=0f0e06be5d684398a453fa6312e57d41 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:20.715580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18def63b-8aff-44ce-8df0-d13038b3c98b None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:20.715984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18def63b-8aff-44ce-8df0-d13038b3c98b None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:20.716368 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18def63b-8aff-44ce-8df0-d13038b3c98b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:20.717065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ec4f8-f810-4cb9-9e8f-49664fb5aa08 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:20.840912 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18def63b-8aff-44ce-8df0-d13038b3c98b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:20.842488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18def63b-8aff-44ce-8df0-d13038b3c98b None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:20.888981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:20.897305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ec4f8-f810-4cb9-9e8f-49664fb5aa08 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:20.956001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cf956-b8e8-45d1-8d6c-7ff1463a57de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:20.956930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cf956-b8e8-45d1-8d6c-7ff1463a57de None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:20.957215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cf956-b8e8-45d1-8d6c-7ff1463a57de None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:20.957496 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cf956-b8e8-45d1-8d6c-7ff1463a57de None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:20.958782 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cf956-b8e8-45d1-8d6c-7ff1463a57de None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:20.960267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cf956-b8e8-45d1-8d6c-7ff1463a57de None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:20.962129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 49/89] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:20 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:20.962976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cf956-b8e8-45d1-8d6c-7ff1463a57de None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:21.007843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:21.030038 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 41/90] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:21.031806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18def63b-8aff-44ce-8df0-d13038b3c98b None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:21.151151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cf956-b8e8-45d1-8d6c-7ff1463a57de None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:21.201313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18def63b-8aff-44ce-8df0-d13038b3c98b None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:21.220616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029c7e7-0786-4587-88af-17dc0b315be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:21.221783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029c7e7-0786-4587-88af-17dc0b315be3 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:21.222272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029c7e7-0786-4587-88af-17dc0b315be3 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:21.222793 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029c7e7-0786-4587-88af-17dc0b315be3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:21.262520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:21.274099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2066b-a7f7-4491-b06e-67d4c0828571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:21.277403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2066b-a7f7-4491-b06e-67d4c0828571 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:21.277403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2066b-a7f7-4491-b06e-67d4c0828571 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:21.277403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2066b-a7f7-4491-b06e-67d4c0828571 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:21.277403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2066b-a7f7-4491-b06e-67d4c0828571 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:21.278140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2066b-a7f7-4491-b06e-67d4c0828571 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:21.342174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029c7e7-0786-4587-88af-17dc0b315be3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:21.343830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029c7e7-0786-4587-88af-17dc0b315be3 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:21.366218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:21.390308 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 42/91] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:35:21 2022] POST /identity/v3/users => generated 289 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:21.391570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2066b-a7f7-4491-b06e-67d4c0828571 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:21.549445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 50/92] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:21.558641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029c7e7-0786-4587-88af-17dc0b315be3 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:21.650503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2066b-a7f7-4491-b06e-67d4c0828571 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:21.719060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1871f-ffa7-4c98-9b47-9374bcf52fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:21.719985 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1871f-ffa7-4c98-9b47-9374bcf52fc5 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:21.720273 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1871f-ffa7-4c98-9b47-9374bcf52fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:21.720611 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1871f-ffa7-4c98-9b47-9374bcf52fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:21.721482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1871f-ffa7-4c98-9b47-9374bcf52fc5 None admin] RBAC: Adding query filter params (role.id=7c97532e07d14d4096b310fb69816951, scope.project.id=0d047530c703494197e4bf5f63aec8df, user.id=bfffc73d00654d0cb9d9f3571a6a926d) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:21.721798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1871f-ffa7-4c98-9b47-9374bcf52fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:21.723304 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1871f-ffa7-4c98-9b47-9374bcf52fc5 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:21.732423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 43/93] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:21 2022] GET /identity/v3/role_assignments?user.id=bfffc73d00654d0cb9d9f3571a6a926d&scope.project.id=0d047530c703494197e4bf5f63aec8df&role.id=7c97532e07d14d4096b310fb69816951 => generated 259 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:21.732744 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1871f-ffa7-4c98-9b47-9374bcf52fc5 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:21.773829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029c7e7-0786-4587-88af-17dc0b315be3 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:21.798742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:21.809472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:21.844515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262deb35-2d7a-4f6b-ae69-6ffe8bfdb7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:21.846619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262deb35-2d7a-4f6b-ae69-6ffe8bfdb7c8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:21.847461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262deb35-2d7a-4f6b-ae69-6ffe8bfdb7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:21.848284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262deb35-2d7a-4f6b-ae69-6ffe8bfdb7c8 None admin] PATH_INFO: `/v3/projects/100322256a7244f283b14fb88c07e762` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:21.851250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262deb35-2d7a-4f6b-ae69-6ffe8bfdb7c8 None admin] RBAC: Authorizing `identity:get_project(project_id=100322256a7244f283b14fb88c07e762)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:21.855421 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262deb35-2d7a-4f6b-ae69-6ffe8bfdb7c8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:21.859337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 51/94] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:21 2022] GET /identity/v3/projects/100322256a7244f283b14fb88c07e762 => generated 312 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:21.864613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1871f-ffa7-4c98-9b47-9374bcf52fc5 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:21.868334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262deb35-2d7a-4f6b-ae69-6ffe8bfdb7c8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:21.909638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dbc0d-6309-4f3b-bd64-a5e140c5c364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:21.910573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dbc0d-6309-4f3b-bd64-a5e140c5c364 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:21.910841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dbc0d-6309-4f3b-bd64-a5e140c5c364 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:21.911128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dbc0d-6309-4f3b-bd64-a5e140c5c364 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:21.912693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dbc0d-6309-4f3b-bd64-a5e140c5c364 None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:21.914307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dbc0d-6309-4f3b-bd64-a5e140c5c364 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:21.916295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 44/95] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:21 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:21.924052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dbc0d-6309-4f3b-bd64-a5e140c5c364 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:22.049503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dbc0d-6309-4f3b-bd64-a5e140c5c364 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:22.061598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262deb35-2d7a-4f6b-ae69-6ffe8bfdb7c8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:22.083505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:22.104284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f3a80-d367-4845-b6ed-06356ee97c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:22.105431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f3a80-d367-4845-b6ed-06356ee97c8d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:22.105944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f3a80-d367-4845-b6ed-06356ee97c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:22.106432 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f3a80-d367-4845-b6ed-06356ee97c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:22.107503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f3a80-d367-4845-b6ed-06356ee97c8d None admin] RBAC: Adding query filter params (role.id=0f0e06be5d684398a453fa6312e57d41, scope.project.id=100322256a7244f283b14fb88c07e762, user.id=bfffc73d00654d0cb9d9f3571a6a926d) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:22.108056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f3a80-d367-4845-b6ed-06356ee97c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:22.109808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f3a80-d367-4845-b6ed-06356ee97c8d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:22.117174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 52/96] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:21 2022] GET /identity/v3/role_assignments?user.id=bfffc73d00654d0cb9d9f3571a6a926d&scope.project.id=100322256a7244f283b14fb88c07e762&role.id=0f0e06be5d684398a453fa6312e57d41 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:22.120574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523aca15-edeb-4f89-9400-b02abef7691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:22.120574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aca15-edeb-4f89-9400-b02abef7691c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:22.120574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aca15-edeb-4f89-9400-b02abef7691c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:22.120574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aca15-edeb-4f89-9400-b02abef7691c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:22.124523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523aca15-edeb-4f89-9400-b02abef7691c None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=0d047530c703494197e4bf5f63aec8df, user.id=3bfdcdc4e8594f169e8c27a8c1db7913) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:22.124523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523aca15-edeb-4f89-9400-b02abef7691c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:22.124969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523aca15-edeb-4f89-9400-b02abef7691c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:22.140685 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 45/97] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:21 2022] GET /identity/v3/role_assignments?user.id=3bfdcdc4e8594f169e8c27a8c1db7913&scope.project.id=0d047530c703494197e4bf5f63aec8df&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:23.577268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb3917-4f05-497e-8534-1afc02053152 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:23.578254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb3917-4f05-497e-8534-1afc02053152 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:23.578753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb3917-4f05-497e-8534-1afc02053152 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:23.580433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 53/98] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:23.590181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7222af-2912-4889-8bd8-50952bf83685 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:23.590687 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7222af-2912-4889-8bd8-50952bf83685 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:23.591132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7222af-2912-4889-8bd8-50952bf83685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:23.611773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-fc7222af-2912-4889-8bd8-50952bf83685 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:23.613423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-fc7222af-2912-4889-8bd8-50952bf83685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:23.705352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 46/99] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:23.778853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb3917-4f05-497e-8534-1afc02053152 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:23.837725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:23.906426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb3917-4f05-497e-8534-1afc02053152 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:23.956759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb88f6-8628-4039-996a-83d6c6abf088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:23.957954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb88f6-8628-4039-996a-83d6c6abf088 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:23.958462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb88f6-8628-4039-996a-83d6c6abf088 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:23.958947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb88f6-8628-4039-996a-83d6c6abf088 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:23.972676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb88f6-8628-4039-996a-83d6c6abf088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-c6eb88f6-8628-4039-996a-83d6c6abf088 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:23.981721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:23.982670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:23.983505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:23.983505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:23.983505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:23.983505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:23.983505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:23.983505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:23.983505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:23.983505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:23.983505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:23.983505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:23.983505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:23.983505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:23.986136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 54/100] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:23.995326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7222af-2912-4889-8bd8-50952bf83685 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:24.129465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7222af-2912-4889-8bd8-50952bf83685 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:24.147246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:24.180050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb7bee-a160-44ba-a3dc-b2bd00b452bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:24.180806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb7bee-a160-44ba-a3dc-b2bd00b452bb None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:24.181099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb7bee-a160-44ba-a3dc-b2bd00b452bb None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:24.181383 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb7bee-a160-44ba-a3dc-b2bd00b452bb None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:24.182189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb7bee-a160-44ba-a3dc-b2bd00b452bb None admin] RBAC: Adding query filter params (name=member) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:24.182541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb7bee-a160-44ba-a3dc-b2bd00b452bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:24.184050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb7bee-a160-44ba-a3dc-b2bd00b452bb None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:24.194685 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 47/101] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:24.206024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb88f6-8628-4039-996a-83d6c6abf088 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:24.411006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb88f6-8628-4039-996a-83d6c6abf088 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:24.472548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:24.484347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b35954-dbc9-4b9f-8d4e-9272ad6c1b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:24.485558 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b35954-dbc9-4b9f-8d4e-9272ad6c1b7c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:24.486022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b35954-dbc9-4b9f-8d4e-9272ad6c1b7c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:24.486468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b35954-dbc9-4b9f-8d4e-9272ad6c1b7c None admin] PATH_INFO: `/v3/users/bfffc73d00654d0cb9d9f3571a6a926d` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:24.488089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b35954-dbc9-4b9f-8d4e-9272ad6c1b7c None admin] RBAC: Authorizing `identity:get_user(user_id=bfffc73d00654d0cb9d9f3571a6a926d)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:24.494061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b35954-dbc9-4b9f-8d4e-9272ad6c1b7c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:24.496557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 55/102] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:24 2022] GET /identity/v3/users/bfffc73d00654d0cb9d9f3571a6a926d => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:24.507094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb7bee-a160-44ba-a3dc-b2bd00b452bb None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:24.681708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb7bee-a160-44ba-a3dc-b2bd00b452bb None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:24.723208 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6caf03-3ed0-4373-a09c-a36dffe293c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:24.724352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6caf03-3ed0-4373-a09c-a36dffe293c0 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:24.724805 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6caf03-3ed0-4373-a09c-a36dffe293c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:24.725227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6caf03-3ed0-4373-a09c-a36dffe293c0 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:24.726767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6caf03-3ed0-4373-a09c-a36dffe293c0 None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:24.728444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6caf03-3ed0-4373-a09c-a36dffe293c0 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:24.731675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 48/103] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:24 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:24.737829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b35954-dbc9-4b9f-8d4e-9272ad6c1b7c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:24.907492 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b35954-dbc9-4b9f-8d4e-9272ad6c1b7c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:24.953928 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b10cb-b177-411c-bcac-5b1663b762a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:24.955597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b10cb-b177-411c-bcac-5b1663b762a5 None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:24.956212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b10cb-b177-411c-bcac-5b1663b762a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:24.956815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b10cb-b177-411c-bcac-5b1663b762a5 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df/users/bfffc73d00654d0cb9d9f3571a6a926d/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:24.959196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b10cb-b177-411c-bcac-5b1663b762a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d047530c703494197e4bf5f63aec8df, user_id=bfffc73d00654d0cb9d9f3571a6a926d, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:24.960951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b10cb-b177-411c-bcac-5b1663b762a5 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:25.038108 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 56/104] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:35:24 2022] PUT /identity/v3/projects/0d047530c703494197e4bf5f63aec8df/users/bfffc73d00654d0cb9d9f3571a6a926d/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:35:25.076525 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88895123-1ae1-4dee-b47a-5ec6a352d2fd None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:25.077053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88895123-1ae1-4dee-b47a-5ec6a352d2fd None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:25.077480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88895123-1ae1-4dee-b47a-5ec6a352d2fd None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:25.079100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 49/105] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:25.091218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb313b-2339-463e-875f-d9008e86c160 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:25.091746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb313b-2339-463e-875f-d9008e86c160 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:25.092179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb313b-2339-463e-875f-d9008e86c160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:25.115591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ceeb313b-2339-463e-875f-d9008e86c160 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:25.117192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ceeb313b-2339-463e-875f-d9008e86c160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:25.162253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:25.218799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 57/106] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:25.257232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88895123-1ae1-4dee-b47a-5ec6a352d2fd None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:25.327200 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:25.405890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88895123-1ae1-4dee-b47a-5ec6a352d2fd None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:25.447236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3deafa-24ac-4e70-a4c4-71f0ac798efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:25.448118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3deafa-24ac-4e70-a4c4-71f0ac798efc None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:25.449077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3deafa-24ac-4e70-a4c4-71f0ac798efc None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:25.449916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3deafa-24ac-4e70-a4c4-71f0ac798efc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:25.458316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eda32-a045-4e5c-bcbb-f7a430e538d5 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:25.458651 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eda32-a045-4e5c-bcbb-f7a430e538d5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:25.458933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eda32-a045-4e5c-bcbb-f7a430e538d5 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:25.460589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 58/107] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:35:25.467608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3deafa-24ac-4e70-a4c4-71f0ac798efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:25.469865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c59a2-7945-45b2-b758-fec14246efcf None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:25.470095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c59a2-7945-45b2-b758-fec14246efcf None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:25.470374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c59a2-7945-45b2-b758-fec14246efcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-da3deafa-24ac-4e70-a4c4-71f0ac798efc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:25.481923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:25.482861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:25.483627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:25.483627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:25.483627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:25.483627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:25.483627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:25.483627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:25.483627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:25.483627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:25.483627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:25.483627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:25.483627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:35:25.483627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:25.487315 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 50/108] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:35:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:25.496823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-718c59a2-7945-45b2-b758-fec14246efcf None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:25.498099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3deafa-24ac-4e70-a4c4-71f0ac798efc None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:25.498220 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-718c59a2-7945-45b2-b758-fec14246efcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:25.650509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 59/109] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:25.766507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75852bf-8b41-4ef2-8997-07f05521e6eb None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:25.767460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75852bf-8b41-4ef2-8997-07f05521e6eb None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:25.768353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75852bf-8b41-4ef2-8997-07f05521e6eb None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:25.771542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 60/110] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:25.773341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75852bf-8b41-4ef2-8997-07f05521e6eb None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:25.798913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3deafa-24ac-4e70-a4c4-71f0ac798efc None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:25.800917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:25.897311 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044e60c-3386-43db-bbdb-0eb879179825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:25.898028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e60c-3386-43db-bbdb-0eb879179825 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:25.898319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e60c-3386-43db-bbdb-0eb879179825 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:25.898601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e60c-3386-43db-bbdb-0eb879179825 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:25.899407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044e60c-3386-43db-bbdb-0eb879179825 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:25.899720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044e60c-3386-43db-bbdb-0eb879179825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:25.901286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044e60c-3386-43db-bbdb-0eb879179825 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:25.911355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 51/111] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:35:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:25.917894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745a8c5-980e-4165-9f82-09370fc9efce None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:25.918431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745a8c5-980e-4165-9f82-09370fc9efce None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:25.918727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745a8c5-980e-4165-9f82-09370fc9efce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:25.960035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-f745a8c5-980e-4165-9f82-09370fc9efce None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:25.962813 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f745a8c5-980e-4165-9f82-09370fc9efce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:26.014266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:26.030031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75852bf-8b41-4ef2-8997-07f05521e6eb None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:26.102300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b64309-8d9b-495f-ae98-0bb6f626196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:26.103659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b64309-8d9b-495f-ae98-0bb6f626196a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:26.104153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b64309-8d9b-495f-ae98-0bb6f626196a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:26.105186 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b64309-8d9b-495f-ae98-0bb6f626196a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:26.121013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 52/112] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:26.121013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745a8c5-980e-4165-9f82-09370fc9efce None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:26.136163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b64309-8d9b-495f-ae98-0bb6f626196a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-b3b64309-8d9b-495f-ae98-0bb6f626196a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:26.156466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:26.157488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:26.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:26.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:26.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:26.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:26.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:26.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:26.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:26.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:26.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:26.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:26.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:26.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:26.159686 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 61/113] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:35:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:26.162033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42709fab-30ac-4cb1-acaf-34f09bfc52e6 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:26.165073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42709fab-30ac-4cb1-acaf-34f09bfc52e6 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:26.165073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42709fab-30ac-4cb1-acaf-34f09bfc52e6 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:26.167840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 62/114] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:26.170499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50334f4-e88d-4194-b297-4038b0b05b67 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:26.170993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50334f4-e88d-4194-b297-4038b0b05b67 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:26.171493 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50334f4-e88d-4194-b297-4038b0b05b67 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:26.175377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 63/115] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:26.177396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50334f4-e88d-4194-b297-4038b0b05b67 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:26.294726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:26.306211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745a8c5-980e-4165-9f82-09370fc9efce None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:26.341296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50334f4-e88d-4194-b297-4038b0b05b67 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:26.373206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e547d58-56bd-4e87-b281-e9f851623b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:26.374755 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547d58-56bd-4e87-b281-e9f851623b59 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:26.375285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547d58-56bd-4e87-b281-e9f851623b59 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:26.375733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547d58-56bd-4e87-b281-e9f851623b59 None admin] PATH_INFO: `/v3/users/bfffc73d00654d0cb9d9f3571a6a926d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:26.377943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e547d58-56bd-4e87-b281-e9f851623b59 None admin] RBAC: Authorizing `identity:get_user(user_id=bfffc73d00654d0cb9d9f3571a6a926d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:26.380093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c67c2b-35eb-4384-a359-380e0b1047c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:26.380914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e547d58-56bd-4e87-b281-e9f851623b59 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:26.381041 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c67c2b-35eb-4384-a359-380e0b1047c9 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:26.381237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c67c2b-35eb-4384-a359-380e0b1047c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:26.381520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c67c2b-35eb-4384-a359-380e0b1047c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:26.389375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 53/116] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:26 2022] GET /identity/v3/users/bfffc73d00654d0cb9d9f3571a6a926d => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:26.389375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e547d58-56bd-4e87-b281-e9f851623b59 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:26.406306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c67c2b-35eb-4384-a359-380e0b1047c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-95c67c2b-35eb-4384-a359-380e0b1047c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:26.422351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:26.423278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:26.424020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:26.424020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:26.424020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:26.424020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:26.424020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:26.424020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:26.424020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:26.424020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:26.424020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:26.424020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:26.424020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:26.424020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:26.424636 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 64/117] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:26.426770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d1100-1cc3-48af-8d34-19ad9d1f1f39 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:26.427266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d1100-1cc3-48af-8d34-19ad9d1f1f39 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:26.427753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d1100-1cc3-48af-8d34-19ad9d1f1f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:26.457779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-436d1100-1cc3-48af-8d34-19ad9d1f1f39 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:26.459788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-436d1100-1cc3-48af-8d34-19ad9d1f1f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:26.481562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:26.527037 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e547d58-56bd-4e87-b281-e9f851623b59 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:26.545176 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 65/118] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:26.546856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f45e7-e893-446c-9f5d-fc11e3f5523a None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:26.547211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f45e7-e893-446c-9f5d-fc11e3f5523a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:26.547559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f45e7-e893-446c-9f5d-fc11e3f5523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:26.566677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-491f45e7-e893-446c-9f5d-fc11e3f5523a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:26.568015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-491f45e7-e893-446c-9f5d-fc11e3f5523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:26.598436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54998011-5362-4477-9147-999c5f698759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:26.599500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54998011-5362-4477-9147-999c5f698759 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:26.600104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54998011-5362-4477-9147-999c5f698759 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:26.600437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54998011-5362-4477-9147-999c5f698759 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:26.601477 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54998011-5362-4477-9147-999c5f698759 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:26.602005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54998011-5362-4477-9147-999c5f698759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:26.603804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54998011-5362-4477-9147-999c5f698759 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:26.615679 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 54/119] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:26.617275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54998011-5362-4477-9147-999c5f698759 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:26.653803 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:26.655839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 66/120] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:26.657099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f45e7-e893-446c-9f5d-fc11e3f5523a None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:26.765790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54998011-5362-4477-9147-999c5f698759 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:26.767696 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:26.807264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0e753-4dbc-4c98-820f-fc65f1dbe444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:26.808933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0e753-4dbc-4c98-820f-fc65f1dbe444 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:26.809226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0e753-4dbc-4c98-820f-fc65f1dbe444 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:26.809507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0e753-4dbc-4c98-820f-fc65f1dbe444 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:26.810828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0e753-4dbc-4c98-820f-fc65f1dbe444 None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:26.812319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0e753-4dbc-4c98-820f-fc65f1dbe444 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:26.814369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 55/121] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:26 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:26.814883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0e753-4dbc-4c98-820f-fc65f1dbe444 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:26.815143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f45e7-e893-446c-9f5d-fc11e3f5523a None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:26.856153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac564e-1916-4f9b-841e-462a50d2c2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:26.856969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac564e-1916-4f9b-841e-462a50d2c2d5 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:26.857250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac564e-1916-4f9b-841e-462a50d2c2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:26.857524 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac564e-1916-4f9b-841e-462a50d2c2d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:26.858285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac564e-1916-4f9b-841e-462a50d2c2d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:26.858596 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac564e-1916-4f9b-841e-462a50d2c2d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:26.859990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac564e-1916-4f9b-841e-462a50d2c2d5 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:26.869323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 67/122] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:26.870737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac564e-1916-4f9b-841e-462a50d2c2d5 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:26.980176 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:26.982901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac564e-1916-4f9b-841e-462a50d2c2d5 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:26.995461 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0e753-4dbc-4c98-820f-fc65f1dbe444 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:27.020049 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac96be8-6716-4316-aafb-5285c2cb5e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:27.020977 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac96be8-6716-4316-aafb-5285c2cb5e7d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:27.021261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac96be8-6716-4316-aafb-5285c2cb5e7d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:27.021536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac96be8-6716-4316-aafb-5285c2cb5e7d None admin] PATH_INFO: `/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:27.022786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac96be8-6716-4316-aafb-5285c2cb5e7d None admin] RBAC: Authorizing `identity:get_user(user_id=3bfdcdc4e8594f169e8c27a8c1db7913)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:27.024354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac96be8-6716-4316-aafb-5285c2cb5e7d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:27.026593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 68/123] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:26 2022] GET /identity/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:27.027396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac96be8-6716-4316-aafb-5285c2cb5e7d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:27.046102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:27.064701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a01cf-8afd-4c7c-90ae-fc632d47d861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:27.064701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a01cf-8afd-4c7c-90ae-fc632d47d861 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:27.064701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a01cf-8afd-4c7c-90ae-fc632d47d861 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:27.065331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a01cf-8afd-4c7c-90ae-fc632d47d861 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:27.084965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a01cf-8afd-4c7c-90ae-fc632d47d861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-296a01cf-8afd-4c7c-90ae-fc632d47d861 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:27.101060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:27.102032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:27.102868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:27.102868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:27.102868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:27.102868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:27.102868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:27.102868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:27.102868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:27.102868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:27.102868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:27.102868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:27.102868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:27.102868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:27.103442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 56/124] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:27.105688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a01cf-8afd-4c7c-90ae-fc632d47d861 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:27.150996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac96be8-6716-4316-aafb-5285c2cb5e7d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:27.221231 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aac37c-10ad-4fa1-8366-7aafc46c149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:27.222796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aac37c-10ad-4fa1-8366-7aafc46c149f None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:27.223414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aac37c-10ad-4fa1-8366-7aafc46c149f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:27.223926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aac37c-10ad-4fa1-8366-7aafc46c149f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:27.226062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a01cf-8afd-4c7c-90ae-fc632d47d861 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:27.226299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aac37c-10ad-4fa1-8366-7aafc46c149f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:27.229525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aac37c-10ad-4fa1-8366-7aafc46c149f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:27.233108 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 69/125] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:27.239115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aac37c-10ad-4fa1-8366-7aafc46c149f None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:27.276233 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c3a4d-fb4b-4054-8e3f-9cf493fade7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:27.277833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3a4d-fb4b-4054-8e3f-9cf493fade7f None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:27.278266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3a4d-fb4b-4054-8e3f-9cf493fade7f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:27.278743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3a4d-fb4b-4054-8e3f-9cf493fade7f None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df/users/bfffc73d00654d0cb9d9f3571a6a926d/roles/7c97532e07d14d4096b310fb69816951` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:27.281988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c3a4d-fb4b-4054-8e3f-9cf493fade7f None admin] RBAC: Authorizing `identity:create_grant(project_id=0d047530c703494197e4bf5f63aec8df, user_id=bfffc73d00654d0cb9d9f3571a6a926d, role_id=7c97532e07d14d4096b310fb69816951)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:27.284272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c3a4d-fb4b-4054-8e3f-9cf493fade7f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:27.331864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:27.357414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aac37c-10ad-4fa1-8366-7aafc46c149f None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:27.395067 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f904a44-e771-4073-93a5-62da45e3fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:27.395970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f904a44-e771-4073-93a5-62da45e3fa70 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:27.396255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f904a44-e771-4073-93a5-62da45e3fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:27.396558 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f904a44-e771-4073-93a5-62da45e3fa70 None admin] PATH_INFO: `/v3/users/bfffc73d00654d0cb9d9f3571a6a926d` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:27.397830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f904a44-e771-4073-93a5-62da45e3fa70 None admin] RBAC: Authorizing `identity:get_user(user_id=bfffc73d00654d0cb9d9f3571a6a926d)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:27.399344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f904a44-e771-4073-93a5-62da45e3fa70 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:27.401171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 70/126] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:27 2022] GET /identity/v3/users/bfffc73d00654d0cb9d9f3571a6a926d => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:27.407398 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f904a44-e771-4073-93a5-62da45e3fa70 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:27.420094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 57/127] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:35:27 2022] PUT /identity/v3/projects/0d047530c703494197e4bf5f63aec8df/users/bfffc73d00654d0cb9d9f3571a6a926d/roles/7c97532e07d14d4096b310fb69816951 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:35:27.421201 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c3a4d-fb4b-4054-8e3f-9cf493fade7f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:27.456821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:27.626249 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f904a44-e771-4073-93a5-62da45e3fa70 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:27.642729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c3a4d-fb4b-4054-8e3f-9cf493fade7f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:27.690036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a6f19-e475-4189-9f47-e29f880d0c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:27.691750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a6f19-e475-4189-9f47-e29f880d0c6d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:27.692446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a6f19-e475-4189-9f47-e29f880d0c6d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:27.693123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a6f19-e475-4189-9f47-e29f880d0c6d None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:27.695552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a6f19-e475-4189-9f47-e29f880d0c6d None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:27.699434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a6f19-e475-4189-9f47-e29f880d0c6d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:27.703227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 71/128] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:27 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:27.705088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a6f19-e475-4189-9f47-e29f880d0c6d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:27.707353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e750aee-4ff0-4732-be83-82f5f71493de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:27.708420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e750aee-4ff0-4732-be83-82f5f71493de None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:27.708931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e750aee-4ff0-4732-be83-82f5f71493de None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:27.709397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e750aee-4ff0-4732-be83-82f5f71493de None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:27.711112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e750aee-4ff0-4732-be83-82f5f71493de None admin] RBAC: Adding query filter params (name=reader) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:27.711636 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e750aee-4ff0-4732-be83-82f5f71493de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:27.716437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e750aee-4ff0-4732-be83-82f5f71493de None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:27.733506 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:27.744515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 58/129] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:27.744515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e750aee-4ff0-4732-be83-82f5f71493de None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:27.896338 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a6f19-e475-4189-9f47-e29f880d0c6d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:27.900342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:27.950864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e750aee-4ff0-4732-be83-82f5f71493de None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:27.951551 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17540b8-a52c-44a3-b60e-cd86e5d06b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:27.952463 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17540b8-a52c-44a3-b60e-cd86e5d06b00 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:27.952943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17540b8-a52c-44a3-b60e-cd86e5d06b00 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:27.953390 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17540b8-a52c-44a3-b60e-cd86e5d06b00 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:27.954656 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17540b8-a52c-44a3-b60e-cd86e5d06b00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:27.957452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17540b8-a52c-44a3-b60e-cd86e5d06b00 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:28.016390 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ddb06-2c85-40fd-95fa-6c4a02ab3009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:28.017978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ddb06-2c85-40fd-95fa-6c4a02ab3009 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:28.018530 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ddb06-2c85-40fd-95fa-6c4a02ab3009 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:28.019091 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ddb06-2c85-40fd-95fa-6c4a02ab3009 None admin] PATH_INFO: `/v3/projects/100322256a7244f283b14fb88c07e762` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:28.021315 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ddb06-2c85-40fd-95fa-6c4a02ab3009 None admin] RBAC: Authorizing `identity:get_project(project_id=100322256a7244f283b14fb88c07e762)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:28.027196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ddb06-2c85-40fd-95fa-6c4a02ab3009 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:28.028179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 59/130] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:27 2022] GET /identity/v3/projects/100322256a7244f283b14fb88c07e762 => generated 312 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:28.029309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ddb06-2c85-40fd-95fa-6c4a02ab3009 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:28.057044 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 72/131] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:35:27 2022] POST /identity/v3/projects => generated 302 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:28.059125 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17540b8-a52c-44a3-b60e-cd86e5d06b00 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:28.180280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ddb06-2c85-40fd-95fa-6c4a02ab3009 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:28.193363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:28.223042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa28cb-b08b-48df-9ff9-98e5b719e9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:28.224287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa28cb-b08b-48df-9ff9-98e5b719e9e9 None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:28.224816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa28cb-b08b-48df-9ff9-98e5b719e9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:28.225399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa28cb-b08b-48df-9ff9-98e5b719e9e9 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df/users/3bfdcdc4e8594f169e8c27a8c1db7913/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:28.227867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa28cb-b08b-48df-9ff9-98e5b719e9e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d047530c703494197e4bf5f63aec8df, user_id=3bfdcdc4e8594f169e8c27a8c1db7913, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:28.230759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa28cb-b08b-48df-9ff9-98e5b719e9e9 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:28.270412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17540b8-a52c-44a3-b60e-cd86e5d06b00 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:28.294771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 60/132] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:35:28 2022] PUT /identity/v3/projects/0d047530c703494197e4bf5f63aec8df/users/3bfdcdc4e8594f169e8c27a8c1db7913/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:35:28.296199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c55ce-7f7c-48e2-9711-43b46c5e3dff None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:28.296583 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c55ce-7f7c-48e2-9711-43b46c5e3dff None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:28.297721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c55ce-7f7c-48e2-9711-43b46c5e3dff None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:28.301632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 61/133] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:28.302598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c55ce-7f7c-48e2-9711-43b46c5e3dff None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:28.306820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:28.335117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a2a28-c447-45af-a21f-cff6d48b05ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:28.336931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2a28-c447-45af-a21f-cff6d48b05ee None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:28.337339 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2a28-c447-45af-a21f-cff6d48b05ee None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:28.339180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2a28-c447-45af-a21f-cff6d48b05ee None admin] PATH_INFO: `/v3/users/c5121395e526465a95b1f8c4576e8d79` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:28.384313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a2a28-c447-45af-a21f-cff6d48b05ee None admin] RBAC: Authorizing `identity:get_user(user_id=c5121395e526465a95b1f8c4576e8d79)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:28.396588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a2a28-c447-45af-a21f-cff6d48b05ee None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:28.400226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 73/134] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:28 2022] GET /identity/v3/users/c5121395e526465a95b1f8c4576e8d79 => generated 289 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:28.403830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78bf6c-9673-4b17-9ae9-be3b98fe450e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:28.404637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78bf6c-9673-4b17-9ae9-be3b98fe450e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:28.405563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78bf6c-9673-4b17-9ae9-be3b98fe450e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:28.442597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-9e78bf6c-9673-4b17-9ae9-be3b98fe450e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:28.444866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9e78bf6c-9673-4b17-9ae9-be3b98fe450e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:28.527375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c55ce-7f7c-48e2-9711-43b46c5e3dff None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:28.592319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 74/135] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:28.594093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78bf6c-9673-4b17-9ae9-be3b98fe450e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:28.599991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40708af-3163-4276-bf48-152a6618faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:28.601274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40708af-3163-4276-bf48-152a6618faa2 None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:28.601816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40708af-3163-4276-bf48-152a6618faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:28.602296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40708af-3163-4276-bf48-152a6618faa2 None admin] PATH_INFO: `/v3/projects/100322256a7244f283b14fb88c07e762/users/bfffc73d00654d0cb9d9f3571a6a926d/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:28.605039 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40708af-3163-4276-bf48-152a6618faa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=100322256a7244f283b14fb88c07e762, user_id=bfffc73d00654d0cb9d9f3571a6a926d, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:28.606905 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40708af-3163-4276-bf48-152a6618faa2 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:28.698876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:28.700308 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 62/136] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:35:28 2022] PUT /identity/v3/projects/100322256a7244f283b14fb88c07e762/users/bfffc73d00654d0cb9d9f3571a6a926d/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:35:28.703075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40708af-3163-4276-bf48-152a6618faa2 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:28.800237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78bf6c-9673-4b17-9ae9-be3b98fe450e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:28.820339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:28.863463 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27a8f-238d-4e81-a6de-a99a244e9558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:28.864577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27a8f-238d-4e81-a6de-a99a244e9558 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:28.865035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27a8f-238d-4e81-a6de-a99a244e9558 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:28.865510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27a8f-238d-4e81-a6de-a99a244e9558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:28.899318 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40708af-3163-4276-bf48-152a6618faa2 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:28.961527 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eff82-5d19-4757-a1bb-c500c46faf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:28.963247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eff82-5d19-4757-a1bb-c500c46faf90 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:28.964336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eff82-5d19-4757-a1bb-c500c46faf90 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:28.964945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eff82-5d19-4757-a1bb-c500c46faf90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:28.984068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eff82-5d19-4757-a1bb-c500c46faf90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-934eff82-5d19-4757-a1bb-c500c46faf90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:29.001436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:29.002381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:29.003127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:29.003127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:29.003127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:29.003127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:29.003127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:29.003127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:29.003127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:29.003127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:29.003127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:29.003127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:29.003127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:29.003127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:29.005718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 63/137] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:29.025325 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eff82-5d19-4757-a1bb-c500c46faf90 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:29.040276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e27a8f-238d-4e81-a6de-a99a244e9558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:29.044324 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e27a8f-238d-4e81-a6de-a99a244e9558 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:29.192654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:29.287304 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eff82-5d19-4757-a1bb-c500c46faf90 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:29.340874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:29.355217 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe56554-b7f0-49e7-9127-cd1eac4d1e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:29.355961 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe56554-b7f0-49e7-9127-cd1eac4d1e4f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:29.356252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe56554-b7f0-49e7-9127-cd1eac4d1e4f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:29.356696 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe56554-b7f0-49e7-9127-cd1eac4d1e4f None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:29.357598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe56554-b7f0-49e7-9127-cd1eac4d1e4f None admin] RBAC: Adding query filter params (name=member) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:29.362497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe56554-b7f0-49e7-9127-cd1eac4d1e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:29.362497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe56554-b7f0-49e7-9127-cd1eac4d1e4f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:29.367572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 75/138] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:29.381827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27a8f-238d-4e81-a6de-a99a244e9558 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:29.382328 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 64/139] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:29.392271 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe56554-b7f0-49e7-9127-cd1eac4d1e4f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:29.546052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe56554-b7f0-49e7-9127-cd1eac4d1e4f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:29.587068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055670d-07fd-46fc-92dd-42864fdf9e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:29.587979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055670d-07fd-46fc-92dd-42864fdf9e53 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:29.588270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055670d-07fd-46fc-92dd-42864fdf9e53 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:29.589288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055670d-07fd-46fc-92dd-42864fdf9e53 None admin] PATH_INFO: `/v3/users/bfffc73d00654d0cb9d9f3571a6a926d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:29.590822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055670d-07fd-46fc-92dd-42864fdf9e53 None admin] RBAC: Authorizing `identity:get_user(user_id=bfffc73d00654d0cb9d9f3571a6a926d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:29.592514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055670d-07fd-46fc-92dd-42864fdf9e53 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:29.594719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 65/140] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:29 2022] GET /identity/v3/users/bfffc73d00654d0cb9d9f3571a6a926d => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:29.602392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055670d-07fd-46fc-92dd-42864fdf9e53 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:29.613820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27a8f-238d-4e81-a6de-a99a244e9558 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:29.658537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903639f7-9c04-4b71-9358-a25b01b078ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:29.660295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903639f7-9c04-4b71-9358-a25b01b078ec None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:29.660782 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903639f7-9c04-4b71-9358-a25b01b078ec None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:29.661230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903639f7-9c04-4b71-9358-a25b01b078ec None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:29.662874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903639f7-9c04-4b71-9358-a25b01b078ec None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:29.665093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903639f7-9c04-4b71-9358-a25b01b078ec None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:29.667766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 76/141] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:29 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:29.676587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903639f7-9c04-4b71-9358-a25b01b078ec None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:29.719056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:29.750169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:29.879039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903639f7-9c04-4b71-9358-a25b01b078ec None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:29.914555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055670d-07fd-46fc-92dd-42864fdf9e53 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:29.941888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb213c-7130-4390-bc78-e79df79c60ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:29.942929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb213c-7130-4390-bc78-e79df79c60ab None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:29.943444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb213c-7130-4390-bc78-e79df79c60ab None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:29.943911 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb213c-7130-4390-bc78-e79df79c60ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:29.944983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb213c-7130-4390-bc78-e79df79c60ab None admin] RBAC: Adding query filter params (role.id=6ea42ab173de4304986be223ef0dcb2c, scope.project.id=0d047530c703494197e4bf5f63aec8df, user.id=c5121395e526465a95b1f8c4576e8d79) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:29.945497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb213c-7130-4390-bc78-e79df79c60ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:29.947408 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb213c-7130-4390-bc78-e79df79c60ab None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:29.955380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 77/142] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:29 2022] GET /identity/v3/role_assignments?user.id=c5121395e526465a95b1f8c4576e8d79&scope.project.id=0d047530c703494197e4bf5f63aec8df&role.id=6ea42ab173de4304986be223ef0dcb2c => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:30.007301 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befb22e-62c2-4873-a27f-974eb75d6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:30.008086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befb22e-62c2-4873-a27f-974eb75d6b55 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:30.008410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befb22e-62c2-4873-a27f-974eb75d6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:30.008576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befb22e-62c2-4873-a27f-974eb75d6b55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:30.113018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befb22e-62c2-4873-a27f-974eb75d6b55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:30.114543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befb22e-62c2-4873-a27f-974eb75d6b55 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:30.132974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199f4f2-e4c4-4dd0-bd20-5235ec5c748d None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:30.134412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199f4f2-e4c4-4dd0-bd20-5235ec5c748d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:30.135154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199f4f2-e4c4-4dd0-bd20-5235ec5c748d None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:30.146627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 78/143] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:30 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:30.158254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35e926-4ba4-4dcb-b6ce-d57832ea97c2 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:30.159457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35e926-4ba4-4dcb-b6ce-d57832ea97c2 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:30.160233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35e926-4ba4-4dcb-b6ce-d57832ea97c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:30.224751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-1a35e926-4ba4-4dcb-b6ce-d57832ea97c2 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:30.227372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-1a35e926-4ba4-4dcb-b6ce-d57832ea97c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:30.239429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:30.339881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 66/144] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:30.345898 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befb22e-62c2-4873-a27f-974eb75d6b55 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:30.406241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 79/145] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:30.476972 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35e926-4ba4-4dcb-b6ce-d57832ea97c2 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:30.509061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:30.548516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befb22e-62c2-4873-a27f-974eb75d6b55 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:30.625738 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eae07b-2d1d-4e0f-8956-01aef34d0f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:30.626633 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eae07b-2d1d-4e0f-8956-01aef34d0f00 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:30.626913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eae07b-2d1d-4e0f-8956-01aef34d0f00 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:30.627190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eae07b-2d1d-4e0f-8956-01aef34d0f00 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:30.628430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eae07b-2d1d-4e0f-8956-01aef34d0f00 None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:30.629939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eae07b-2d1d-4e0f-8956-01aef34d0f00 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:30.631704 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 67/146] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:30 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:30.654421 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eae07b-2d1d-4e0f-8956-01aef34d0f00 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:30.684732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35e926-4ba4-4dcb-b6ce-d57832ea97c2 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:30.698912 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:30.745670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c7ae1-0e26-49a8-bc92-5578a2c15f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:30.746637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c7ae1-0e26-49a8-bc92-5578a2c15f4a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:30.746924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c7ae1-0e26-49a8-bc92-5578a2c15f4a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:30.747196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c7ae1-0e26-49a8-bc92-5578a2c15f4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:30.786354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c7ae1-0e26-49a8-bc92-5578a2c15f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-841c7ae1-0e26-49a8-bc92-5578a2c15f4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:30.798843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:30.800578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:30.802131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 80/147] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:35:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:35:30.815607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c7ae1-0e26-49a8-bc92-5578a2c15f4a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:30.876570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eae07b-2d1d-4e0f-8956-01aef34d0f00 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:30.921437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2700f3-511d-4809-819b-5678e08f4652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:30.923170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2700f3-511d-4809-819b-5678e08f4652 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:30.923463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2700f3-511d-4809-819b-5678e08f4652 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:30.923740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2700f3-511d-4809-819b-5678e08f4652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:30.924626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2700f3-511d-4809-819b-5678e08f4652 None admin] RBAC: Adding query filter params (role.id=0f0e06be5d684398a453fa6312e57d41, scope.project.id=0d047530c703494197e4bf5f63aec8df, user.id=bfffc73d00654d0cb9d9f3571a6a926d) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:30.924943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2700f3-511d-4809-819b-5678e08f4652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:30.926452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2700f3-511d-4809-819b-5678e08f4652 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:30.939921 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 68/148] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:30 2022] GET /identity/v3/role_assignments?user.id=bfffc73d00654d0cb9d9f3571a6a926d&scope.project.id=0d047530c703494197e4bf5f63aec8df&role.id=0f0e06be5d684398a453fa6312e57d41 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:31.006667 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:31.056554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c7ae1-0e26-49a8-bc92-5578a2c15f4a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:31.107840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed8381-d84d-447a-a3b1-df2535d2851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:31.108563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed8381-d84d-447a-a3b1-df2535d2851d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:31.108841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed8381-d84d-447a-a3b1-df2535d2851d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:31.109120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed8381-d84d-447a-a3b1-df2535d2851d None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:31.109890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed8381-d84d-447a-a3b1-df2535d2851d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:31.110203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed8381-d84d-447a-a3b1-df2535d2851d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:31.111691 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed8381-d84d-447a-a3b1-df2535d2851d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:31.128781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 81/149] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:35:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:31.134764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2700f3-511d-4809-819b-5678e08f4652 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:31.265092 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:31.278855 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2700f3-511d-4809-819b-5678e08f4652 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:31.321833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba25d8-eccf-4452-acd3-fe9742df2b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:31.322854 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba25d8-eccf-4452-acd3-fe9742df2b0e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:31.323203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba25d8-eccf-4452-acd3-fe9742df2b0e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:31.323489 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba25d8-eccf-4452-acd3-fe9742df2b0e None admin] PATH_INFO: `/v3/users/bfffc73d00654d0cb9d9f3571a6a926d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:31.325447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba25d8-eccf-4452-acd3-fe9742df2b0e None admin] RBAC: Authorizing `identity:get_user(user_id=bfffc73d00654d0cb9d9f3571a6a926d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:31.327011 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba25d8-eccf-4452-acd3-fe9742df2b0e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:31.330095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 69/150] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:31 2022] GET /identity/v3/users/bfffc73d00654d0cb9d9f3571a6a926d => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:31.339002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed8381-d84d-447a-a3b1-df2535d2851d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:31.508086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed8381-d84d-447a-a3b1-df2535d2851d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:31.558121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1db71-e34b-4762-8055-a7d64d3d7345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:31.558700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1db71-e34b-4762-8055-a7d64d3d7345 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:31.559077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1db71-e34b-4762-8055-a7d64d3d7345 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:31.559370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1db71-e34b-4762-8055-a7d64d3d7345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:31.564872 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:31.679011 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1db71-e34b-4762-8055-a7d64d3d7345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:31.681614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1db71-e34b-4762-8055-a7d64d3d7345 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:31.908243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 82/151] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 17:35:31.918259 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba25d8-eccf-4452-acd3-fe9742df2b0e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:31.939367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fb18a-ab41-471f-b63f-caf464b7b4d2 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:31.939816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fb18a-ab41-471f-b63f-caf464b7b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:31.940272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fb18a-ab41-471f-b63f-caf464b7b4d2 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:31.943106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 83/152] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:35:31.949903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd84a8-1f98-44d4-903c-c18a28bec5d6 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:31.950396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd84a8-1f98-44d4-903c-c18a28bec5d6 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:31.950836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd84a8-1f98-44d4-903c-c18a28bec5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:31.983402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-23fd84a8-1f98-44d4-903c-c18a28bec5d6 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:31.985548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-23fd84a8-1f98-44d4-903c-c18a28bec5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:32.057280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:32.060099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba25d8-eccf-4452-acd3-fe9742df2b0e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:32.102389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07a14a-d288-4efa-bcda-014535ce9ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:32.103650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07a14a-d288-4efa-bcda-014535ce9ae0 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:32.104707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07a14a-d288-4efa-bcda-014535ce9ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:32.105193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07a14a-d288-4efa-bcda-014535ce9ae0 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:32.106790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07a14a-d288-4efa-bcda-014535ce9ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:32.108598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07a14a-d288-4efa-bcda-014535ce9ae0 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:32.110671 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 70/153] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:31 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:32.112360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a793a8-3a46-4976-ba42-5048e3e25a65 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:32.112891 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a793a8-3a46-4976-ba42-5048e3e25a65 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:32.113367 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a793a8-3a46-4976-ba42-5048e3e25a65 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:32.118587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 71/154] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:32.120425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a793a8-3a46-4976-ba42-5048e3e25a65 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:32.128362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 84/155] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:32.132679 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00492c-fb85-47b9-8bdb-ebcd61607a75 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:32.132679 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00492c-fb85-47b9-8bdb-ebcd61607a75 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:32.132679 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00492c-fb85-47b9-8bdb-ebcd61607a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:32.162457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-2d00492c-fb85-47b9-8bdb-ebcd61607a75 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:32.164671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2d00492c-fb85-47b9-8bdb-ebcd61607a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:32.170093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:32.288277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a793a8-3a46-4976-ba42-5048e3e25a65 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:32.323428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 85/156] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:32.328717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00492c-fb85-47b9-8bdb-ebcd61607a75 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:32.351393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d1069-818e-454b-858e-97e9a3f52902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:32.352444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d1069-818e-454b-858e-97e9a3f52902 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:32.352896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d1069-818e-454b-858e-97e9a3f52902 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:32.353319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d1069-818e-454b-858e-97e9a3f52902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:32.355234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d1069-818e-454b-858e-97e9a3f52902 None admin] RBAC: Adding query filter params (role.id=7c97532e07d14d4096b310fb69816951, scope.project.id=0d047530c703494197e4bf5f63aec8df, user.id=bfffc73d00654d0cb9d9f3571a6a926d) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:32.355981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d1069-818e-454b-858e-97e9a3f52902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:32.358286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d1069-818e-454b-858e-97e9a3f52902 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:32.367014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 72/157] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:32 2022] GET /identity/v3/role_assignments?user.id=bfffc73d00654d0cb9d9f3571a6a926d&scope.project.id=0d047530c703494197e4bf5f63aec8df&role.id=7c97532e07d14d4096b310fb69816951 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:32.375660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d1069-818e-454b-858e-97e9a3f52902 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:32.480331 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:32.487990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00492c-fb85-47b9-8bdb-ebcd61607a75 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:32.529126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d686c-2440-4bf4-8be9-5520718e45e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:32.530446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d686c-2440-4bf4-8be9-5520718e45e2 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:32.530873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d686c-2440-4bf4-8be9-5520718e45e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:32.531395 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d686c-2440-4bf4-8be9-5520718e45e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:32.563583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d686c-2440-4bf4-8be9-5520718e45e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:32.565095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-504d686c-2440-4bf4-8be9-5520718e45e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:32.580454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:32.581915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:32.582899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:32.582899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:32.582899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:32.582899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:32.582899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:32.582899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:32.582899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:32.582899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:32.582899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:32.582899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:32.582899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:32.582899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:32.586747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 86/158] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:35:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:32.597616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d686c-2440-4bf4-8be9-5520718e45e2 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:32.617058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d1069-818e-454b-858e-97e9a3f52902 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:32.701049 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb2e3b-1fa2-42d4-9eaf-cf0b95bbbfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:32.702124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb2e3b-1fa2-42d4-9eaf-cf0b95bbbfb8 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:32.702552 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb2e3b-1fa2-42d4-9eaf-cf0b95bbbfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:32.702970 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb2e3b-1fa2-42d4-9eaf-cf0b95bbbfb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:32.705231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb2e3b-1fa2-42d4-9eaf-cf0b95bbbfb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:32.708867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb2e3b-1fa2-42d4-9eaf-cf0b95bbbfb8 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:32.712499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 73/159] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:32.721828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb2e3b-1fa2-42d4-9eaf-cf0b95bbbfb8 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:32.773087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d686c-2440-4bf4-8be9-5520718e45e2 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:32.813937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5ea10-c9b1-46e9-957d-5536f2cd9bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:32.814884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5ea10-c9b1-46e9-957d-5536f2cd9bca None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:32.815313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5ea10-c9b1-46e9-957d-5536f2cd9bca None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:32.815756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5ea10-c9b1-46e9-957d-5536f2cd9bca None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:32.816755 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5ea10-c9b1-46e9-957d-5536f2cd9bca None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:32.817287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5ea10-c9b1-46e9-957d-5536f2cd9bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:32.819108 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5ea10-c9b1-46e9-957d-5536f2cd9bca None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:32.831051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 87/160] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:32.837292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5ea10-c9b1-46e9-957d-5536f2cd9bca None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:32.875455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:32.952831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb2e3b-1fa2-42d4-9eaf-cf0b95bbbfb8 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:32.971421 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5ea10-c9b1-46e9-957d-5536f2cd9bca None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:33.019468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4f69e-4cc0-4d7a-9688-86def0723c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:33.021028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4f69e-4cc0-4d7a-9688-86def0723c43 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:33.021523 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4f69e-4cc0-4d7a-9688-86def0723c43 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:33.022011 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4f69e-4cc0-4d7a-9688-86def0723c43 None admin] PATH_INFO: `/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:33.023655 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f069bfb-2946-4766-a497-e031931debdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:33.024314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f069bfb-2946-4766-a497-e031931debdc None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:33.024467 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4f69e-4cc0-4d7a-9688-86def0723c43 None admin] RBAC: Authorizing `identity:get_user(user_id=3bfdcdc4e8594f169e8c27a8c1db7913)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:33.024698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f069bfb-2946-4766-a497-e031931debdc None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:33.025003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f069bfb-2946-4766-a497-e031931debdc None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:33.025714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f069bfb-2946-4766-a497-e031931debdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:33.027304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4f69e-4cc0-4d7a-9688-86def0723c43 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:33.027480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f069bfb-2946-4766-a497-e031931debdc None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:33.031246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 88/161] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:32 2022] GET /identity/v3/users/3bfdcdc4e8594f169e8c27a8c1db7913 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:33.033482 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39559d02-18e3-48f9-8d9e-b07d1e5e123c None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:33.033984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39559d02-18e3-48f9-8d9e-b07d1e5e123c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:33.034474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39559d02-18e3-48f9-8d9e-b07d1e5e123c None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:33.037196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 89/162] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:33.038663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39559d02-18e3-48f9-8d9e-b07d1e5e123c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:33.136967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 74/163] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:35:32 2022] POST /identity/v3/users => generated 283 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:33.139243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b1d16-85bc-4382-94f7-53020d377ca3 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:33.139758 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b1d16-85bc-4382-94f7-53020d377ca3 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:33.140193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b1d16-85bc-4382-94f7-53020d377ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:33.161962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-f70b1d16-85bc-4382-94f7-53020d377ca3 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:33.163725 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f70b1d16-85bc-4382-94f7-53020d377ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:33.167025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:33.236541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:33.258548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39559d02-18e3-48f9-8d9e-b07d1e5e123c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:33.292752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 75/164] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:33.315039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debda372-e6f3-4d7d-825c-7a1813495817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:33.316206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debda372-e6f3-4d7d-825c-7a1813495817 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:33.316727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debda372-e6f3-4d7d-825c-7a1813495817 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:33.317256 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debda372-e6f3-4d7d-825c-7a1813495817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:33.345222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b1d16-85bc-4382-94f7-53020d377ca3 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:33.461552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debda372-e6f3-4d7d-825c-7a1813495817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:33.466262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debda372-e6f3-4d7d-825c-7a1813495817 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:33.474575 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b1d16-85bc-4382-94f7-53020d377ca3 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:33.531021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1f949-7ef4-41be-865f-5bd4eb3e0ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:33.532370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1f949-7ef4-41be-865f-5bd4eb3e0ac6 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:33.533611 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1f949-7ef4-41be-865f-5bd4eb3e0ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:33.534263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1f949-7ef4-41be-865f-5bd4eb3e0ac6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:33.547956 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:33.555340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1f949-7ef4-41be-865f-5bd4eb3e0ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-12a1f949-7ef4-41be-865f-5bd4eb3e0ac6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:33.564042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:33.565098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:33.566186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:33.566186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:33.566186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:33.566186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:33.566186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:33.566186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:33.566186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:33.566186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:33.566186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:33.566186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:33.566186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:33.566186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:33.566872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 76/165] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:35:33.580447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1f949-7ef4-41be-865f-5bd4eb3e0ac6 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:33.599218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:33.635881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 90/166] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:33.646107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debda372-e6f3-4d7d-825c-7a1813495817 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:33.726808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1f949-7ef4-41be-865f-5bd4eb3e0ac6 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:33.796632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ac500-d894-4f93-9a3c-2b24b9219163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:33.797948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ac500-d894-4f93-9a3c-2b24b9219163 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:33.798449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ac500-d894-4f93-9a3c-2b24b9219163 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:33.798873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ac500-d894-4f93-9a3c-2b24b9219163 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:33.800369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ac500-d894-4f93-9a3c-2b24b9219163 None admin] RBAC: Adding query filter params (name=member) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:33.800974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ac500-d894-4f93-9a3c-2b24b9219163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:33.802603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ac500-d894-4f93-9a3c-2b24b9219163 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:33.824277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 77/167] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:33.826190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ac500-d894-4f93-9a3c-2b24b9219163 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:33.832277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debda372-e6f3-4d7d-825c-7a1813495817 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:33.872963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8f300-d1bc-4110-bb2d-54b534f0eaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:33.873869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8f300-d1bc-4110-bb2d-54b534f0eaed None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:33.874146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8f300-d1bc-4110-bb2d-54b534f0eaed None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:33.874414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8f300-d1bc-4110-bb2d-54b534f0eaed None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:33.875750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8f300-d1bc-4110-bb2d-54b534f0eaed None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:33.877353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8f300-d1bc-4110-bb2d-54b534f0eaed None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:33.880228 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 91/168] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:33 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:33.889076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8f300-d1bc-4110-bb2d-54b534f0eaed None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:33.971728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:33.977851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:34.050328 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ac500-d894-4f93-9a3c-2b24b9219163 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:34.056769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8f300-d1bc-4110-bb2d-54b534f0eaed None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:34.100123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ab76d-9bc7-44ad-b71e-5fa7363418bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:34.101051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ab76d-9bc7-44ad-b71e-5fa7363418bd None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:34.101340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ab76d-9bc7-44ad-b71e-5fa7363418bd None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:34.101609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ab76d-9bc7-44ad-b71e-5fa7363418bd None admin] PATH_INFO: `/v3/users/bfffc73d00654d0cb9d9f3571a6a926d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:34.102909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ab76d-9bc7-44ad-b71e-5fa7363418bd None admin] RBAC: Authorizing `identity:get_user(user_id=bfffc73d00654d0cb9d9f3571a6a926d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:34.105617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd377153-aa2c-4b84-b843-a3218849cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:34.105780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ab76d-9bc7-44ad-b71e-5fa7363418bd None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:34.106593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd377153-aa2c-4b84-b843-a3218849cd69 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:34.107021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd377153-aa2c-4b84-b843-a3218849cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:34.107445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd377153-aa2c-4b84-b843-a3218849cd69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:34.107567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 78/169] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:33 2022] GET /identity/v3/users/bfffc73d00654d0cb9d9f3571a6a926d => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:34.108595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd377153-aa2c-4b84-b843-a3218849cd69 None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=0d047530c703494197e4bf5f63aec8df, user.id=3bfdcdc4e8594f169e8c27a8c1db7913) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:34.109061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd377153-aa2c-4b84-b843-a3218849cd69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:34.110711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd377153-aa2c-4b84-b843-a3218849cd69 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:34.113688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0ac9-00a0-4a3f-9778-343056cf1184 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:34.113977 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0ac9-00a0-4a3f-9778-343056cf1184 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:34.114255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0ac9-00a0-4a3f-9778-343056cf1184 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:34.116117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 79/170] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:34.120524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a0ac9-00a0-4a3f-9778-343056cf1184 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:34.122845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 92/171] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:33 2022] GET /identity/v3/role_assignments?user.id=3bfdcdc4e8594f169e8c27a8c1db7913&scope.project.id=0d047530c703494197e4bf5f63aec8df&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:34.125252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2241d2-b5d6-4c3e-857d-76d019845fba None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:34.125749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2241d2-b5d6-4c3e-857d-76d019845fba None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:34.126201 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2241d2-b5d6-4c3e-857d-76d019845fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:34.145908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-4a2241d2-b5d6-4c3e-857d-76d019845fba None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:34.147414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4a2241d2-b5d6-4c3e-857d-76d019845fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:34.244416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 93/172] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:34.269629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2241d2-b5d6-4c3e-857d-76d019845fba None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:34.274916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a0ac9-00a0-4a3f-9778-343056cf1184 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:34.328237 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:34.336960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:34.342420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b28fa0-8014-4678-8770-7fa09576ce1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:34.343895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b28fa0-8014-4678-8770-7fa09576ce1d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:34.344409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b28fa0-8014-4678-8770-7fa09576ce1d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:34.344857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b28fa0-8014-4678-8770-7fa09576ce1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:34.448049 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2241d2-b5d6-4c3e-857d-76d019845fba None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:34.501635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b28fa0-8014-4678-8770-7fa09576ce1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:34.503617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b28fa0-8014-4678-8770-7fa09576ce1d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:34.524158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5f76a-c107-4a37-87cb-8690c3372567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:34.525332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f76a-c107-4a37-87cb-8690c3372567 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:34.526344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f76a-c107-4a37-87cb-8690c3372567 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:34.526898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5f76a-c107-4a37-87cb-8690c3372567 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:34.548431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5f76a-c107-4a37-87cb-8690c3372567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-97b5f76a-c107-4a37-87cb-8690c3372567 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:34.561079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:34.562039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:34.562816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:34.562816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:34.562816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:34.562816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:34.562816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:34.562816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:34.562816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:34.562816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:34.562816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:34.562816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:34.562816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:34.562816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:34.570668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 94/173] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:34.578949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5f76a-c107-4a37-87cb-8690c3372567 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:34.693362 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 80/174] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:34.701439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b28fa0-8014-4678-8770-7fa09576ce1d None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:34.737496 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:34.828758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5f76a-c107-4a37-87cb-8690c3372567 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:34.841230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:34.846531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b28fa0-8014-4678-8770-7fa09576ce1d None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:34.878718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a0d0a-001e-4cfd-a8d5-201c54bde538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:34.879827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a0d0a-001e-4cfd-a8d5-201c54bde538 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:34.880349 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a0d0a-001e-4cfd-a8d5-201c54bde538 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:34.880849 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a0d0a-001e-4cfd-a8d5-201c54bde538 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:34.884143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a0d0a-001e-4cfd-a8d5-201c54bde538 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:34.884797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a0d0a-001e-4cfd-a8d5-201c54bde538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:34.886830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a0d0a-001e-4cfd-a8d5-201c54bde538 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:34.896438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575def3-22af-4530-baf9-622a01739d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:34.897343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575def3-22af-4530-baf9-622a01739d4d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:34.897620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575def3-22af-4530-baf9-622a01739d4d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:34.897894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575def3-22af-4530-baf9-622a01739d4d None admin] PATH_INFO: `/v3/projects/100322256a7244f283b14fb88c07e762` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:34.899156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575def3-22af-4530-baf9-622a01739d4d None admin] RBAC: Authorizing `identity:get_project(project_id=100322256a7244f283b14fb88c07e762)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:34.899743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 95/175] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:34.906108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575def3-22af-4530-baf9-622a01739d4d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:34.908193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 81/176] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:34 2022] GET /identity/v3/projects/100322256a7244f283b14fb88c07e762 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:34.912590 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a0d0a-001e-4cfd-a8d5-201c54bde538 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:34.914142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575def3-22af-4530-baf9-622a01739d4d None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:35.043268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:35.050665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575def3-22af-4530-baf9-622a01739d4d None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:35.093660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a2886-8576-49a8-a215-da66c91c80a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:35.094758 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a2886-8576-49a8-a215-da66c91c80a3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:35.095570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a2886-8576-49a8-a215-da66c91c80a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:35.096195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a2886-8576-49a8-a215-da66c91c80a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:35.097788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a2886-8576-49a8-a215-da66c91c80a3 None admin] RBAC: Adding query filter params (role.id=0f0e06be5d684398a453fa6312e57d41, scope.project.id=100322256a7244f283b14fb88c07e762, user.id=bfffc73d00654d0cb9d9f3571a6a926d) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:35.098210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a2886-8576-49a8-a215-da66c91c80a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:35.100740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a2886-8576-49a8-a215-da66c91c80a3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:35.109866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 82/177] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:34 2022] GET /identity/v3/role_assignments?user.id=bfffc73d00654d0cb9d9f3571a6a926d&scope.project.id=100322256a7244f283b14fb88c07e762&role.id=0f0e06be5d684398a453fa6312e57d41 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:35.140900 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a0d0a-001e-4cfd-a8d5-201c54bde538 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:35.185710 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb31c78-0de6-4265-a2dd-af8927953217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:35.188628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb31c78-0de6-4265-a2dd-af8927953217 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:35.188628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb31c78-0de6-4265-a2dd-af8927953217 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:35.188628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb31c78-0de6-4265-a2dd-af8927953217 None admin] PATH_INFO: `/v3/users/c5121395e526465a95b1f8c4576e8d79` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:35.188628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb31c78-0de6-4265-a2dd-af8927953217 None admin] RBAC: Authorizing `identity:get_user(user_id=c5121395e526465a95b1f8c4576e8d79)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:35.189960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb31c78-0de6-4265-a2dd-af8927953217 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:35.191872 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 96/178] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:34 2022] GET /identity/v3/users/c5121395e526465a95b1f8c4576e8d79 => generated 289 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:35.197800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a2886-8576-49a8-a215-da66c91c80a3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:35.327366 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a2886-8576-49a8-a215-da66c91c80a3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:35.369352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371e0bf-108a-4910-9cc0-762f873d7ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:35.370495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371e0bf-108a-4910-9cc0-762f873d7ac9 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:35.370781 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371e0bf-108a-4910-9cc0-762f873d7ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:35.371059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371e0bf-108a-4910-9cc0-762f873d7ac9 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:35.372379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371e0bf-108a-4910-9cc0-762f873d7ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:35.373885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371e0bf-108a-4910-9cc0-762f873d7ac9 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:35.375642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 83/179] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:35 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:35.382083 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb31c78-0de6-4265-a2dd-af8927953217 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:35.426361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:35.506808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb31c78-0de6-4265-a2dd-af8927953217 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:35.550105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd43c8-0283-427b-885d-34cbe13eabfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:35.551027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd43c8-0283-427b-885d-34cbe13eabfa None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:35.551311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd43c8-0283-427b-885d-34cbe13eabfa None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:35.551583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd43c8-0283-427b-885d-34cbe13eabfa None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df/users/c5121395e526465a95b1f8c4576e8d79/roles/6ea42ab173de4304986be223ef0dcb2c` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:35.553844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd43c8-0283-427b-885d-34cbe13eabfa None admin] RBAC: Authorizing `identity:create_grant(project_id=0d047530c703494197e4bf5f63aec8df, user_id=c5121395e526465a95b1f8c4576e8d79, role_id=6ea42ab173de4304986be223ef0dcb2c)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:35.555345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd43c8-0283-427b-885d-34cbe13eabfa None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:35.651159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 97/180] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:35:35 2022] PUT /identity/v3/projects/0d047530c703494197e4bf5f63aec8df/users/c5121395e526465a95b1f8c4576e8d79/roles/6ea42ab173de4304986be223ef0dcb2c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:35:36.417833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5a814-8d52-46d9-bb20-063f3013811f None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:36.418347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5a814-8d52-46d9-bb20-063f3013811f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:36.418419 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5a814-8d52-46d9-bb20-063f3013811f None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:36.420074 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 84/181] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:36.425585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8efd10-2d50-4913-b4b3-9f6f7b667b32 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:36.426048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8efd10-2d50-4913-b4b3-9f6f7b667b32 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:36.426248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8efd10-2d50-4913-b4b3-9f6f7b667b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:36.449719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-8a8efd10-2d50-4913-b4b3-9f6f7b667b32 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:36.451107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8a8efd10-2d50-4913-b4b3-9f6f7b667b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:36.536254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 98/182] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:36.561063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5a814-8d52-46d9-bb20-063f3013811f None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:36.600693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:36.675271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439ef6-7111-4fbc-addf-6ef80ef3c795 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:36.675874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439ef6-7111-4fbc-addf-6ef80ef3c795 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:36.676372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439ef6-7111-4fbc-addf-6ef80ef3c795 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:36.678030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 99/183] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:35:36.684585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd865a7-a2ef-4523-90e0-291b5aa7212b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:36.685258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd865a7-a2ef-4523-90e0-291b5aa7212b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:36.685740 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd865a7-a2ef-4523-90e0-291b5aa7212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:36.686973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5a814-8d52-46d9-bb20-063f3013811f None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:36.706797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-cbd865a7-a2ef-4523-90e0-291b5aa7212b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:36.708694 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-cbd865a7-a2ef-4523-90e0-291b5aa7212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:36.734124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f8f10-02be-4ac5-87ce-d8ab8979682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:36.734929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f8f10-02be-4ac5-87ce-d8ab8979682e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:36.735210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f8f10-02be-4ac5-87ce-d8ab8979682e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:36.735481 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f8f10-02be-4ac5-87ce-d8ab8979682e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:36.739663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:36.751849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f8f10-02be-4ac5-87ce-d8ab8979682e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-e47f8f10-02be-4ac5-87ce-d8ab8979682e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:36.759949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:36.761789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:36.762589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 85/184] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:36.763265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9150f-5a40-4da2-9e48-8538daa357c8 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:36.763964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9150f-5a40-4da2-9e48-8538daa357c8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:36.763964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9150f-5a40-4da2-9e48-8538daa357c8 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:36.765275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 86/185] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:36.769426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9150f-5a40-4da2-9e48-8538daa357c8 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:36.797181 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 100/186] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:36.802829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309febb0-5707-45ac-8dc7-498c6fa6006c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:36.803396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309febb0-5707-45ac-8dc7-498c6fa6006c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:36.803786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309febb0-5707-45ac-8dc7-498c6fa6006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:36.827080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-309febb0-5707-45ac-8dc7-498c6fa6006c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:36.828401 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-309febb0-5707-45ac-8dc7-498c6fa6006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:36.875257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:36.890868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9150f-5a40-4da2-9e48-8538daa357c8 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:36.917452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 101/187] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:36.918624 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309febb0-5707-45ac-8dc7-498c6fa6006c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:36.949634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9110ac-2758-4734-9007-e7205a159e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:36.950278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9110ac-2758-4734-9007-e7205a159e18 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:36.951300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9110ac-2758-4734-9007-e7205a159e18 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:36.951300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9110ac-2758-4734-9007-e7205a159e18 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:36.951617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9110ac-2758-4734-9007-e7205a159e18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:36.951938 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9110ac-2758-4734-9007-e7205a159e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:36.953454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9110ac-2758-4734-9007-e7205a159e18 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:36.970032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 87/188] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:36.971026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9110ac-2758-4734-9007-e7205a159e18 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:37.050238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:37.067396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309febb0-5707-45ac-8dc7-498c6fa6006c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:37.115110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9110ac-2758-4734-9007-e7205a159e18 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:37.127212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2afa88-91cf-4607-8cb6-0bb08df6b904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:37.128553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2afa88-91cf-4607-8cb6-0bb08df6b904 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:37.129133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2afa88-91cf-4607-8cb6-0bb08df6b904 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:37.129488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2afa88-91cf-4607-8cb6-0bb08df6b904 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:37.148933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2afa88-91cf-4607-8cb6-0bb08df6b904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-9f2afa88-91cf-4607-8cb6-0bb08df6b904 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:37.161038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:37.162035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:37.162817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 102/189] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:35:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:37.164200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2afa88-91cf-4607-8cb6-0bb08df6b904 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:37.168252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948ebed-39bb-4183-8ffd-02cbb1fedbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:37.170066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948ebed-39bb-4183-8ffd-02cbb1fedbf7 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:37.170066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948ebed-39bb-4183-8ffd-02cbb1fedbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:37.170066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948ebed-39bb-4183-8ffd-02cbb1fedbf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:37.171143 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948ebed-39bb-4183-8ffd-02cbb1fedbf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:37.184283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948ebed-39bb-4183-8ffd-02cbb1fedbf7 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:37.184283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 88/190] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:37.184283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948ebed-39bb-4183-8ffd-02cbb1fedbf7 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:37.219871 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:37.315333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2afa88-91cf-4607-8cb6-0bb08df6b904 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:37.325138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948ebed-39bb-4183-8ffd-02cbb1fedbf7 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:37.365647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dee24-b69e-4867-a238-ad9abe75cd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:37.366331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dee24-b69e-4867-a238-ad9abe75cd50 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:37.366615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dee24-b69e-4867-a238-ad9abe75cd50 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:37.366893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dee24-b69e-4867-a238-ad9abe75cd50 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:37.367658 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dee24-b69e-4867-a238-ad9abe75cd50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:37.367969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dee24-b69e-4867-a238-ad9abe75cd50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:37.370000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dee24-b69e-4867-a238-ad9abe75cd50 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:37.370838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80931111-5de7-4704-8703-7b7a02116b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:37.372063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80931111-5de7-4704-8703-7b7a02116b6f None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:37.372934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80931111-5de7-4704-8703-7b7a02116b6f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:37.373302 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80931111-5de7-4704-8703-7b7a02116b6f None admin] PATH_INFO: `/v3/users/b82717174598401098c6f63d7e75bca7` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:37.379541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 89/191] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:35:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:37.380164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dee24-b69e-4867-a238-ad9abe75cd50 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:37.397548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80931111-5de7-4704-8703-7b7a02116b6f None admin] RBAC: Authorizing `identity:get_user(user_id=b82717174598401098c6f63d7e75bca7)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:37.399311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80931111-5de7-4704-8703-7b7a02116b6f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:37.403387 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 103/192] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:37 2022] GET /identity/v3/users/b82717174598401098c6f63d7e75bca7 => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:37.405662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80931111-5de7-4704-8703-7b7a02116b6f None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:37.409713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:37.501046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:37.540410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dee24-b69e-4867-a238-ad9abe75cd50 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:37.550369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80931111-5de7-4704-8703-7b7a02116b6f None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:37.587393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454167d-cba9-4ba3-8004-c23f064bebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:37.588702 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454167d-cba9-4ba3-8004-c23f064bebdd None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:37.589498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454167d-cba9-4ba3-8004-c23f064bebdd None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:37.589498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454167d-cba9-4ba3-8004-c23f064bebdd None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:37.589993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454167d-cba9-4ba3-8004-c23f064bebdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:37.591630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454167d-cba9-4ba3-8004-c23f064bebdd None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:37.594128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fb5b5-30fb-4212-a734-b9b7b624206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:37.595158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fb5b5-30fb-4212-a734-b9b7b624206c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:37.595820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fb5b5-30fb-4212-a734-b9b7b624206c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:37.595820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fb5b5-30fb-4212-a734-b9b7b624206c None admin] PATH_INFO: `/v3/users/b82717174598401098c6f63d7e75bca7` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:37.597171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fb5b5-30fb-4212-a734-b9b7b624206c None admin] RBAC: Authorizing `identity:get_user(user_id=b82717174598401098c6f63d7e75bca7)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:37.598655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fb5b5-30fb-4212-a734-b9b7b624206c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:37.600418 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 104/193] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:37 2022] GET /identity/v3/users/b82717174598401098c6f63d7e75bca7 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:37.607020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fb5b5-30fb-4212-a734-b9b7b624206c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:37.683525 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 90/194] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:35:37 2022] POST /identity/v3/users => generated 297 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:37.685295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454167d-cba9-4ba3-8004-c23f064bebdd None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:37.717075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:37.782202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fb5b5-30fb-4212-a734-b9b7b624206c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:37.836504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5d03a-5d1f-42e2-8e36-9026bb512644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:37.837196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5d03a-5d1f-42e2-8e36-9026bb512644 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:37.837485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5d03a-5d1f-42e2-8e36-9026bb512644 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:37.837768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5d03a-5d1f-42e2-8e36-9026bb512644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:37.847676 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454167d-cba9-4ba3-8004-c23f064bebdd None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:37.909596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69dcc5-ffd5-4d64-9b03-41bc47459352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:37.910988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69dcc5-ffd5-4d64-9b03-41bc47459352 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:37.911417 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69dcc5-ffd5-4d64-9b03-41bc47459352 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:37.911834 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69dcc5-ffd5-4d64-9b03-41bc47459352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:37.919082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:37.944976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5d03a-5d1f-42e2-8e36-9026bb512644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:37.946437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5d03a-5d1f-42e2-8e36-9026bb512644 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:38.015677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69dcc5-ffd5-4d64-9b03-41bc47459352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:38.017260 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69dcc5-ffd5-4d64-9b03-41bc47459352 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:38.033655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:38.077625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 105/195] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:38.080247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d6227-bf9f-4760-9422-9151470cbcc9 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:38.081041 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d6227-bf9f-4760-9422-9151470cbcc9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:38.081722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d6227-bf9f-4760-9422-9151470cbcc9 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:38.084282 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 106/196] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:38.085902 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d6227-bf9f-4760-9422-9151470cbcc9 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:38.166748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 91/197] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:38.166748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472e576-bbe5-4064-9201-7f8cde164342 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:38.166748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472e576-bbe5-4064-9201-7f8cde164342 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:38.166748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472e576-bbe5-4064-9201-7f8cde164342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:38.184129 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d472e576-bbe5-4064-9201-7f8cde164342 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:38.185524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d472e576-bbe5-4064-9201-7f8cde164342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:38.224902 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:38.248186 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d6227-bf9f-4760-9422-9151470cbcc9 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:38.267614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 92/198] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:38.276851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472e576-bbe5-4064-9201-7f8cde164342 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:38.312958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3c413-dec8-46d6-b975-7fb27f992fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:38.314430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3c413-dec8-46d6-b975-7fb27f992fb8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:38.314986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3c413-dec8-46d6-b975-7fb27f992fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:38.315530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3c413-dec8-46d6-b975-7fb27f992fb8 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:38.317759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3c413-dec8-46d6-b975-7fb27f992fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:38.320410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3c413-dec8-46d6-b975-7fb27f992fb8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:38.324153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 107/199] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:38 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:38.326930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3c413-dec8-46d6-b975-7fb27f992fb8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:38.380271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:38.411764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472e576-bbe5-4064-9201-7f8cde164342 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:38.457491 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cf143-ef7a-4101-a5be-534a28078486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:38.458376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cf143-ef7a-4101-a5be-534a28078486 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:38.458664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cf143-ef7a-4101-a5be-534a28078486 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:38.458940 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cf143-ef7a-4101-a5be-534a28078486 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:38.460392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cf143-ef7a-4101-a5be-534a28078486 None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:38.461898 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cf143-ef7a-4101-a5be-534a28078486 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:38.463676 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 93/200] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:38 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:38.464088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3c413-dec8-46d6-b975-7fb27f992fb8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:38.464590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cf143-ef7a-4101-a5be-534a28078486 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:38.502508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c601c-6871-4fc6-baf8-ad1a19de39b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:38.503265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:38.503696 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c601c-6871-4fc6-baf8-ad1a19de39b4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:38.503696 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c601c-6871-4fc6-baf8-ad1a19de39b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:38.504262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c601c-6871-4fc6-baf8-ad1a19de39b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:38.517175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c601c-6871-4fc6-baf8-ad1a19de39b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-2c2c601c-6871-4fc6-baf8-ad1a19de39b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:38.525054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:38.526022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:38.526813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:38.526813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:38.526813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:38.526813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:38.526813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:38.526813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:38.526813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:38.526813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:38.526813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:38.526813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:38.526813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:38.526813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:38.528438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 108/201] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:38.528438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c601c-6871-4fc6-baf8-ad1a19de39b4 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:38.584651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cf143-ef7a-4101-a5be-534a28078486 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:38.627775 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89a29f-c917-4c4c-b25f-f50ef44d8ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:38.628502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89a29f-c917-4c4c-b25f-f50ef44d8ce7 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:38.628802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89a29f-c917-4c4c-b25f-f50ef44d8ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:38.629078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89a29f-c917-4c4c-b25f-f50ef44d8ce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:38.629949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89a29f-c917-4c4c-b25f-f50ef44d8ce7 None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=b19baba10ae34863868739f9da315ab6, user.id=b82717174598401098c6f63d7e75bca7) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:38.630348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89a29f-c917-4c4c-b25f-f50ef44d8ce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:38.632018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89a29f-c917-4c4c-b25f-f50ef44d8ce7 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:38.639218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:38.640790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 94/202] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:38 2022] GET /identity/v3/role_assignments?user.id=b82717174598401098c6f63d7e75bca7&scope.project.id=b19baba10ae34863868739f9da315ab6&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:38.641853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89a29f-c917-4c4c-b25f-f50ef44d8ce7 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:38.642852 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c601c-6871-4fc6-baf8-ad1a19de39b4 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:38.701702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3b1cd-62a4-4dca-a371-946aff33389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:38.702426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3b1cd-62a4-4dca-a371-946aff33389d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:38.702721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3b1cd-62a4-4dca-a371-946aff33389d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:38.702959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3b1cd-62a4-4dca-a371-946aff33389d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:38.703832 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3b1cd-62a4-4dca-a371-946aff33389d None admin] RBAC: Adding query filter params (role.id=7c97532e07d14d4096b310fb69816951, scope.project.id=b19baba10ae34863868739f9da315ab6, user.id=b82717174598401098c6f63d7e75bca7) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:38.704147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3b1cd-62a4-4dca-a371-946aff33389d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:38.705723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3b1cd-62a4-4dca-a371-946aff33389d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:38.716634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 109/203] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:38 2022] GET /identity/v3/role_assignments?user.id=b82717174598401098c6f63d7e75bca7&scope.project.id=b19baba10ae34863868739f9da315ab6&role.id=7c97532e07d14d4096b310fb69816951 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:38.767801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:38.772849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89a29f-c917-4c4c-b25f-f50ef44d8ce7 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:38.818007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a8cd0-23fd-43a7-ba19-4c412ec349ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:38.819051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8cd0-23fd-43a7-ba19-4c412ec349ea None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:38.819515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8cd0-23fd-43a7-ba19-4c412ec349ea None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:38.819997 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8cd0-23fd-43a7-ba19-4c412ec349ea None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:38.821003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a8cd0-23fd-43a7-ba19-4c412ec349ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:38.821520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a8cd0-23fd-43a7-ba19-4c412ec349ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:38.823242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a8cd0-23fd-43a7-ba19-4c412ec349ea None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:38.833785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 95/204] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:38.850522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3b1cd-62a4-4dca-a371-946aff33389d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:38.994229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3b1cd-62a4-4dca-a371-946aff33389d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:39.044098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5f0b-8588-4c4c-abe7-17e78181448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:39.045034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5f0b-8588-4c4c-abe7-17e78181448d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:39.045317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5f0b-8588-4c4c-abe7-17e78181448d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:39.045594 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc5f0b-8588-4c4c-abe7-17e78181448d None admin] PATH_INFO: `/v3/users/c5121395e526465a95b1f8c4576e8d79` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:39.047015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc5f0b-8588-4c4c-abe7-17e78181448d None admin] RBAC: Authorizing `identity:get_user(user_id=c5121395e526465a95b1f8c4576e8d79)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:39.048568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc5f0b-8588-4c4c-abe7-17e78181448d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:39.050632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 110/205] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:38 2022] GET /identity/v3/users/c5121395e526465a95b1f8c4576e8d79 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:39.056444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a8cd0-23fd-43a7-ba19-4c412ec349ea None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:39.217487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a8cd0-23fd-43a7-ba19-4c412ec349ea None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:39.272137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a926c-017b-4a5d-a955-89fe1f5ad412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:39.273219 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a926c-017b-4a5d-a955-89fe1f5ad412 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:39.273708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a926c-017b-4a5d-a955-89fe1f5ad412 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:39.274185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a926c-017b-4a5d-a955-89fe1f5ad412 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:39.353035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:39.357651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a926c-017b-4a5d-a955-89fe1f5ad412 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:39.359173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a926c-017b-4a5d-a955-89fe1f5ad412 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:39.524528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 96/206] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:39.538353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5f0b-8588-4c4c-abe7-17e78181448d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:39.614970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:39.750764 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc5f0b-8588-4c4c-abe7-17e78181448d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:39.837809 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89319dc-16f1-4655-8a95-04f8f5e306bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:39.839156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89319dc-16f1-4655-8a95-04f8f5e306bb None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:39.839616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89319dc-16f1-4655-8a95-04f8f5e306bb None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:39.840077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89319dc-16f1-4655-8a95-04f8f5e306bb None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:39.842321 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89319dc-16f1-4655-8a95-04f8f5e306bb None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:39.845141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89319dc-16f1-4655-8a95-04f8f5e306bb None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:39.848599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 111/207] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:39 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:39.855007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a926c-017b-4a5d-a955-89fe1f5ad412 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:39.956819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:40.004628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a926c-017b-4a5d-a955-89fe1f5ad412 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:40.041596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85431b27-de20-483e-b436-638f4c602089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:40.042265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431b27-de20-483e-b436-638f4c602089 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:40.042648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431b27-de20-483e-b436-638f4c602089 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:40.042929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431b27-de20-483e-b436-638f4c602089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:40.043781 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85431b27-de20-483e-b436-638f4c602089 None admin] RBAC: Adding query filter params (role.id=6ea42ab173de4304986be223ef0dcb2c, scope.project.id=0d047530c703494197e4bf5f63aec8df, user.id=c5121395e526465a95b1f8c4576e8d79) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:40.044099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85431b27-de20-483e-b436-638f4c602089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:40.045602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85431b27-de20-483e-b436-638f4c602089 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:40.052434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 97/208] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:39 2022] GET /identity/v3/role_assignments?user.id=c5121395e526465a95b1f8c4576e8d79&scope.project.id=0d047530c703494197e4bf5f63aec8df&role.id=6ea42ab173de4304986be223ef0dcb2c => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:40.459587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a089bf-1d57-4613-b042-f144e64ac222 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:40.460089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a089bf-1d57-4613-b042-f144e64ac222 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:40.460602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a089bf-1d57-4613-b042-f144e64ac222 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:40.464247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 112/209] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:40.472648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d131bdf-4c40-4fca-8d88-f3f7fdd93cc8 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:40.472964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d131bdf-4c40-4fca-8d88-f3f7fdd93cc8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:40.473219 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d131bdf-4c40-4fca-8d88-f3f7fdd93cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:40.494906 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-3d131bdf-4c40-4fca-8d88-f3f7fdd93cc8 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:40.496384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3d131bdf-4c40-4fca-8d88-f3f7fdd93cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:40.582780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 98/210] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:40.609541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a089bf-1d57-4613-b042-f144e64ac222 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:40.684857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e377f-a1ec-4d21-aa41-5737e4d48529 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:40.687285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e377f-a1ec-4d21-aa41-5737e4d48529 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:40.687803 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e377f-a1ec-4d21-aa41-5737e4d48529 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:40.690236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 99/211] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:35:40.701178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ba69e-1180-4213-96e6-8a5b58ac2085 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:40.701829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ba69e-1180-4213-96e6-8a5b58ac2085 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:40.702345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ba69e-1180-4213-96e6-8a5b58ac2085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:40.723991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-614ba69e-1180-4213-96e6-8a5b58ac2085 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:40.725661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-614ba69e-1180-4213-96e6-8a5b58ac2085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:40.766236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:40.773219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a089bf-1d57-4613-b042-f144e64ac222 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:40.826827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:40.838426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be458b-ad2b-4674-a7bb-7e4c0d2d8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:40.841217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be458b-ad2b-4674-a7bb-7e4c0d2d8703 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:40.841760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be458b-ad2b-4674-a7bb-7e4c0d2d8703 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:40.843595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be458b-ad2b-4674-a7bb-7e4c0d2d8703 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:40.845291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be458b-ad2b-4674-a7bb-7e4c0d2d8703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:40.846963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be458b-ad2b-4674-a7bb-7e4c0d2d8703 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:40.849043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 113/212] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:40.858360 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be458b-ad2b-4674-a7bb-7e4c0d2d8703 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:40.871308 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 100/213] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:40.914952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ba69e-1180-4213-96e6-8a5b58ac2085 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:41.023299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be458b-ad2b-4674-a7bb-7e4c0d2d8703 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:41.078416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62006796-0edb-4dae-b155-5d8008591039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:41.079119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62006796-0edb-4dae-b155-5d8008591039 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:41.082132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62006796-0edb-4dae-b155-5d8008591039 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:41.082132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62006796-0edb-4dae-b155-5d8008591039 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:41.082132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62006796-0edb-4dae-b155-5d8008591039 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:41.082132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62006796-0edb-4dae-b155-5d8008591039 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:41.104322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ba69e-1180-4213-96e6-8a5b58ac2085 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:41.154513 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de11a93-3114-4eda-8f26-51576c9bb154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:41.157129 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de11a93-3114-4eda-8f26-51576c9bb154 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:41.157628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de11a93-3114-4eda-8f26-51576c9bb154 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:41.158088 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de11a93-3114-4eda-8f26-51576c9bb154 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:41.171568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de11a93-3114-4eda-8f26-51576c9bb154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-1de11a93-3114-4eda-8f26-51576c9bb154 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:41.182250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:41.184027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:41.185278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 101/214] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:41.194777 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de11a93-3114-4eda-8f26-51576c9bb154 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:41.209838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 114/215] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:35:40 2022] POST /identity/v3/users => generated 297 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:35:41.292197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:41.412250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de11a93-3114-4eda-8f26-51576c9bb154 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:41.477636 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98543c69-8e6e-4b8d-9dd6-78757c74ecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:41.478741 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98543c69-8e6e-4b8d-9dd6-78757c74ecbd None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:41.479232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98543c69-8e6e-4b8d-9dd6-78757c74ecbd None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:41.479771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98543c69-8e6e-4b8d-9dd6-78757c74ecbd None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:41.481026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98543c69-8e6e-4b8d-9dd6-78757c74ecbd None admin] RBAC: Adding query filter params (name=member) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:41.481588 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98543c69-8e6e-4b8d-9dd6-78757c74ecbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:41.484503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98543c69-8e6e-4b8d-9dd6-78757c74ecbd None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:41.502987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 102/216] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:41.513006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62006796-0edb-4dae-b155-5d8008591039 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:41.560907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:41.684897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62006796-0edb-4dae-b155-5d8008591039 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:41.739054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c56496-d9ff-475c-9105-c8b917c82e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:41.741246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c56496-d9ff-475c-9105-c8b917c82e07 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:41.741539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c56496-d9ff-475c-9105-c8b917c82e07 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:41.741820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c56496-d9ff-475c-9105-c8b917c82e07 None admin] PATH_INFO: `/v3/users/46ffb52b0a7040de9069d7b8c2cb11b6` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:41.770520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c56496-d9ff-475c-9105-c8b917c82e07 None admin] RBAC: Authorizing `identity:get_user(user_id=46ffb52b0a7040de9069d7b8c2cb11b6)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:41.772053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c56496-d9ff-475c-9105-c8b917c82e07 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:41.774722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 115/217] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:41 2022] GET /identity/v3/users/46ffb52b0a7040de9069d7b8c2cb11b6 => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:41.777125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0b5eb-7b01-4341-a4b0-58d6f11e292f None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:41.777857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0b5eb-7b01-4341-a4b0-58d6f11e292f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:41.777857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0b5eb-7b01-4341-a4b0-58d6f11e292f None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:41.780063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 103/218] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:41.786127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802086ca-dec4-44c2-9ec9-fa18f65f49ea None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:41.786535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0b5eb-7b01-4341-a4b0-58d6f11e292f None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:41.786913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802086ca-dec4-44c2-9ec9-fa18f65f49ea None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:41.786913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802086ca-dec4-44c2-9ec9-fa18f65f49ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:41.812073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-802086ca-dec4-44c2-9ec9-fa18f65f49ea None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:41.813384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-802086ca-dec4-44c2-9ec9-fa18f65f49ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:41.945760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 116/219] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:41.947731 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e14a8-daa8-430c-9e8c-824db0a6cc2a None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:41.948081 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e14a8-daa8-430c-9e8c-824db0a6cc2a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:41.948331 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e14a8-daa8-430c-9e8c-824db0a6cc2a None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:41.951215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 117/220] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:41.957930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed51aa7-2d75-4271-82e9-59d97bbd8f7c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:41.958282 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed51aa7-2d75-4271-82e9-59d97bbd8f7c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:41.958530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed51aa7-2d75-4271-82e9-59d97bbd8f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:41.962699 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0b5eb-7b01-4341-a4b0-58d6f11e292f None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:41.973073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:41.984143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-5ed51aa7-2d75-4271-82e9-59d97bbd8f7c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:41.988321 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5ed51aa7-2d75-4271-82e9-59d97bbd8f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:41.998329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:42.055104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeea331-e31f-48dd-ab3f-644f73fe89a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:42.057295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeea331-e31f-48dd-ab3f-644f73fe89a5 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:42.057791 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeea331-e31f-48dd-ab3f-644f73fe89a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:42.060055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeea331-e31f-48dd-ab3f-644f73fe89a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:42.073470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 118/221] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:42.074050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed51aa7-2d75-4271-82e9-59d97bbd8f7c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:42.210551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeea331-e31f-48dd-ab3f-644f73fe89a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:42.215067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeea331-e31f-48dd-ab3f-644f73fe89a5 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:42.236680 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed51aa7-2d75-4271-82e9-59d97bbd8f7c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:42.286973 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c002ab-3715-4f1d-9eae-980b8bbd17a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:42.288206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c002ab-3715-4f1d-9eae-980b8bbd17a0 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:42.288620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c002ab-3715-4f1d-9eae-980b8bbd17a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:42.288999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c002ab-3715-4f1d-9eae-980b8bbd17a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:42.304056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c002ab-3715-4f1d-9eae-980b8bbd17a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-55c002ab-3715-4f1d-9eae-980b8bbd17a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:42.315494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:42.316672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:42.317481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:42.317481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:42.317481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:42.317481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:42.317481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:42.317481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:42.317481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:42.317481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:42.317481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:42.317481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:42.317481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:35:42.317481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:42.323206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 119/222] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:35:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:42.324261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c002ab-3715-4f1d-9eae-980b8bbd17a0 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:42.328055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:42.400706 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 104/223] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:42.402519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeea331-e31f-48dd-ab3f-644f73fe89a5 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:42.415197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:42.458813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c002ab-3715-4f1d-9eae-980b8bbd17a0 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:42.498038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e609297-0845-477d-8935-e3c3f1279605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:42.499057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e609297-0845-477d-8935-e3c3f1279605 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:42.499440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e609297-0845-477d-8935-e3c3f1279605 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:42.499822 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e609297-0845-477d-8935-e3c3f1279605 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:42.512728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e609297-0845-477d-8935-e3c3f1279605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-4e609297-0845-477d-8935-e3c3f1279605 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:42.521061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:42.522045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:42.522848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:42.522848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:42.522848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:42.522848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:42.522848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:42.522848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:42.522848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:42.522848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:42.522848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:42.522848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:42.522848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:42.522848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:42.523482 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 120/224] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:42.524502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e609297-0845-477d-8935-e3c3f1279605 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:42.531046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeea331-e31f-48dd-ab3f-644f73fe89a5 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:42.570845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4a8e3-d036-43bc-a9da-443a08e3fa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:42.572464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4a8e3-d036-43bc-a9da-443a08e3fa62 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:42.573148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4a8e3-d036-43bc-a9da-443a08e3fa62 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:42.573821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4a8e3-d036-43bc-a9da-443a08e3fa62 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:42.574886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4a8e3-d036-43bc-a9da-443a08e3fa62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:42.575405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4a8e3-d036-43bc-a9da-443a08e3fa62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:42.577048 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4a8e3-d036-43bc-a9da-443a08e3fa62 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:42.586492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 105/225] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:35:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:42.593107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4a8e3-d036-43bc-a9da-443a08e3fa62 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:42.603783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:42.651564 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e609297-0845-477d-8935-e3c3f1279605 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:42.671320 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:42.694783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14fcb7-b65d-4fd0-9114-ee55d52d7b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:42.695678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14fcb7-b65d-4fd0-9114-ee55d52d7b30 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:42.695962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14fcb7-b65d-4fd0-9114-ee55d52d7b30 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:42.696235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14fcb7-b65d-4fd0-9114-ee55d52d7b30 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:42.698238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14fcb7-b65d-4fd0-9114-ee55d52d7b30 None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:42.699763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14fcb7-b65d-4fd0-9114-ee55d52d7b30 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:42.702010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 121/226] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:42 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:42.703064 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14fcb7-b65d-4fd0-9114-ee55d52d7b30 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:42.713320 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4a8e3-d036-43bc-a9da-443a08e3fa62 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:42.754329 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff2fb0-0bee-4c6a-b787-9b31a53f0100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:42.755411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff2fb0-0bee-4c6a-b787-9b31a53f0100 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:42.755914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff2fb0-0bee-4c6a-b787-9b31a53f0100 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:42.756396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff2fb0-0bee-4c6a-b787-9b31a53f0100 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:42.757420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff2fb0-0bee-4c6a-b787-9b31a53f0100 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:42.757958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff2fb0-0bee-4c6a-b787-9b31a53f0100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:42.759694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff2fb0-0bee-4c6a-b787-9b31a53f0100 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:42.769947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 106/227] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:42.771161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff2fb0-0bee-4c6a-b787-9b31a53f0100 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:42.825991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14fcb7-b65d-4fd0-9114-ee55d52d7b30 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:42.863297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:42.870752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56411856-5a83-4570-8a70-8597fade2cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:42.871892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56411856-5a83-4570-8a70-8597fade2cf3 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:42.872341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56411856-5a83-4570-8a70-8597fade2cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:42.872779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56411856-5a83-4570-8a70-8597fade2cf3 None admin] PATH_INFO: `/v3/users/b82717174598401098c6f63d7e75bca7` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:42.874225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56411856-5a83-4570-8a70-8597fade2cf3 None admin] RBAC: Authorizing `identity:get_user(user_id=b82717174598401098c6f63d7e75bca7)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:42.875909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56411856-5a83-4570-8a70-8597fade2cf3 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:42.878028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 122/228] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:42 2022] GET /identity/v3/users/b82717174598401098c6f63d7e75bca7 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:42.879134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56411856-5a83-4570-8a70-8597fade2cf3 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:42.897782 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff2fb0-0bee-4c6a-b787-9b31a53f0100 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:42.931349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:42.938397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674568f0-8291-4aa2-a6bb-61e69ed5cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:42.939450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674568f0-8291-4aa2-a6bb-61e69ed5cd79 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:42.939924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674568f0-8291-4aa2-a6bb-61e69ed5cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:42.940356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674568f0-8291-4aa2-a6bb-61e69ed5cd79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:42.941451 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674568f0-8291-4aa2-a6bb-61e69ed5cd79 None admin] RBAC: Adding query filter params (role.id=0f0e06be5d684398a453fa6312e57d41, scope.project.id=b19baba10ae34863868739f9da315ab6, user.id=46ffb52b0a7040de9069d7b8c2cb11b6) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:42.948165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674568f0-8291-4aa2-a6bb-61e69ed5cd79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:42.948165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674568f0-8291-4aa2-a6bb-61e69ed5cd79 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:42.950309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 107/229] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:42 2022] GET /identity/v3/role_assignments?user.id=46ffb52b0a7040de9069d7b8c2cb11b6&scope.project.id=b19baba10ae34863868739f9da315ab6&role.id=0f0e06be5d684398a453fa6312e57d41 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:42.951413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674568f0-8291-4aa2-a6bb-61e69ed5cd79 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:43.015785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56411856-5a83-4570-8a70-8597fade2cf3 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:43.074751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674568f0-8291-4aa2-a6bb-61e69ed5cd79 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:43.090988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d8ea0-2d1c-420b-bf0f-aaf6993cc395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:43.092561 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d8ea0-2d1c-420b-bf0f-aaf6993cc395 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:43.101342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d8ea0-2d1c-420b-bf0f-aaf6993cc395 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:43.102094 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d8ea0-2d1c-420b-bf0f-aaf6993cc395 None admin] PATH_INFO: `/v3/users/b82717174598401098c6f63d7e75bca7` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:43.105515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d8ea0-2d1c-420b-bf0f-aaf6993cc395 None admin] RBAC: Authorizing `identity:get_user(user_id=b82717174598401098c6f63d7e75bca7)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:43.108070 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d8ea0-2d1c-420b-bf0f-aaf6993cc395 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:43.111505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 123/230] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:42 2022] GET /identity/v3/users/b82717174598401098c6f63d7e75bca7 => generated 283 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:43.119789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f12ae7-994b-4b50-b302-bd5e9e179b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:43.121194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f12ae7-994b-4b50-b302-bd5e9e179b13 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:43.121449 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d8ea0-2d1c-420b-bf0f-aaf6993cc395 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:43.121895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f12ae7-994b-4b50-b302-bd5e9e179b13 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:43.122364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f12ae7-994b-4b50-b302-bd5e9e179b13 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:43.123904 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f12ae7-994b-4b50-b302-bd5e9e179b13 None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:43.125857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f12ae7-994b-4b50-b302-bd5e9e179b13 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:43.128100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 108/231] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:42 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:43.141604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f12ae7-994b-4b50-b302-bd5e9e179b13 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:43.236958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:43.300900 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:43.336835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f12ae7-994b-4b50-b302-bd5e9e179b13 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:43.402672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d8ea0-2d1c-420b-bf0f-aaf6993cc395 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:43.434795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96b09a-0036-41a5-ba29-36f3d8f482e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:43.436374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96b09a-0036-41a5-ba29-36f3d8f482e3 None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:43.436992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96b09a-0036-41a5-ba29-36f3d8f482e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:43.437497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96b09a-0036-41a5-ba29-36f3d8f482e3 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6/users/b82717174598401098c6f63d7e75bca7/roles/7c97532e07d14d4096b310fb69816951` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:43.448811 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96b09a-0036-41a5-ba29-36f3d8f482e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b19baba10ae34863868739f9da315ab6, user_id=b82717174598401098c6f63d7e75bca7, role_id=7c97532e07d14d4096b310fb69816951)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:43.451669 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96b09a-0036-41a5-ba29-36f3d8f482e3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:43.510687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99357619-59ec-4545-9b15-465a34ef8c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:43.512333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99357619-59ec-4545-9b15-465a34ef8c3c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:43.512870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99357619-59ec-4545-9b15-465a34ef8c3c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:43.513370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99357619-59ec-4545-9b15-465a34ef8c3c None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:43.516031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99357619-59ec-4545-9b15-465a34ef8c3c None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:43.518956 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99357619-59ec-4545-9b15-465a34ef8c3c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:43.523267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 124/232] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:43 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:43.533806 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99357619-59ec-4545-9b15-465a34ef8c3c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:43.552635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 109/233] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:35:43 2022] PUT /identity/v3/projects/b19baba10ae34863868739f9da315ab6/users/b82717174598401098c6f63d7e75bca7/roles/7c97532e07d14d4096b310fb69816951 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:35:43.764465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99357619-59ec-4545-9b15-465a34ef8c3c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:43.839912 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb844e4e-e777-43fc-8bf5-911902e66c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:43.841598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb844e4e-e777-43fc-8bf5-911902e66c02 None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:43.842090 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb844e4e-e777-43fc-8bf5-911902e66c02 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:43.842597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb844e4e-e777-43fc-8bf5-911902e66c02 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6/users/b82717174598401098c6f63d7e75bca7/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:43.846546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb844e4e-e777-43fc-8bf5-911902e66c02 None admin] RBAC: Authorizing `identity:create_grant(project_id=b19baba10ae34863868739f9da315ab6, user_id=b82717174598401098c6f63d7e75bca7, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:43.849364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb844e4e-e777-43fc-8bf5-911902e66c02 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:43.854197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:43.996110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 125/234] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:35:43 2022] PUT /identity/v3/projects/b19baba10ae34863868739f9da315ab6/users/b82717174598401098c6f63d7e75bca7/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:35:44.146807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50b0c0-b3c8-4a57-ba4a-6643b0e230d7 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:44.147310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50b0c0-b3c8-4a57-ba4a-6643b0e230d7 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:44.147680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50b0c0-b3c8-4a57-ba4a-6643b0e230d7 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:44.151276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 110/235] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:44.158762 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cb591-ba24-43a9-891c-745414917393 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:44.159260 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cb591-ba24-43a9-891c-745414917393 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:44.159756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cb591-ba24-43a9-891c-745414917393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:44.194086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-612cb591-ba24-43a9-891c-745414917393 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:44.196159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-612cb591-ba24-43a9-891c-745414917393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:44.328899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 126/236] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:44.352765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50b0c0-b3c8-4a57-ba4a-6643b0e230d7 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:44.601632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50b0c0-b3c8-4a57-ba4a-6643b0e230d7 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:44.637468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:44.659380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70caaf-e166-452d-b2df-c6b63c95e633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:44.660217 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70caaf-e166-452d-b2df-c6b63c95e633 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:44.660523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70caaf-e166-452d-b2df-c6b63c95e633 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:44.660808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70caaf-e166-452d-b2df-c6b63c95e633 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:44.676387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70caaf-e166-452d-b2df-c6b63c95e633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-9d70caaf-e166-452d-b2df-c6b63c95e633 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:44.685029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:44.686069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:44.686866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:44.686866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:44.686866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:44.686866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:44.686866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:44.686866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:44.686866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:44.686866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:44.686866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:44.686866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:44.686866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:44.686866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:44.689098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 111/237] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:44.695171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cb591-ba24-43a9-891c-745414917393 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:44.851746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cb591-ba24-43a9-891c-745414917393 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:44.888697 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:44.905566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5fda7b-b00c-4dff-b31a-06a27b17a143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:44.906283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fda7b-b00c-4dff-b31a-06a27b17a143 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:44.906568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fda7b-b00c-4dff-b31a-06a27b17a143 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:44.906847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fda7b-b00c-4dff-b31a-06a27b17a143 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:44.907631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fda7b-b00c-4dff-b31a-06a27b17a143 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:44.907946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fda7b-b00c-4dff-b31a-06a27b17a143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:44.909419 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5fda7b-b00c-4dff-b31a-06a27b17a143 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:44.920434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 127/238] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:44.926425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70caaf-e166-452d-b2df-c6b63c95e633 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:45.120041 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c45ed-5900-4130-83bf-82ca8b5c9892 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:45.120934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c45ed-5900-4130-83bf-82ca8b5c9892 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:45.121465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c45ed-5900-4130-83bf-82ca8b5c9892 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:45.123171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 128/239] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:45.129133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512ee7-da4f-4a67-9dcf-4902df22d694 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:45.129767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512ee7-da4f-4a67-9dcf-4902df22d694 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:45.130254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512ee7-da4f-4a67-9dcf-4902df22d694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:45.154135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70caaf-e166-452d-b2df-c6b63c95e633 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:45.157844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-94512ee7-da4f-4a67-9dcf-4902df22d694 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:45.160407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-94512ee7-da4f-4a67-9dcf-4902df22d694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:45.200400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003da91-c53c-4bb9-ac4d-edcf7ad8322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:45.202503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003da91-c53c-4bb9-ac4d-edcf7ad8322a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:45.203023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003da91-c53c-4bb9-ac4d-edcf7ad8322a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:45.203519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003da91-c53c-4bb9-ac4d-edcf7ad8322a None admin] PATH_INFO: `/v3/users/8d947e4de98347ebadc9652105ff1321` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:45.241554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003da91-c53c-4bb9-ac4d-edcf7ad8322a None admin] RBAC: Authorizing `identity:get_user(user_id=8d947e4de98347ebadc9652105ff1321)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:45.243057 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003da91-c53c-4bb9-ac4d-edcf7ad8322a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:45.249034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 112/240] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:44 2022] GET /identity/v3/users/8d947e4de98347ebadc9652105ff1321 => generated 297 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:45.254567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003da91-c53c-4bb9-ac4d-edcf7ad8322a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:45.312663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 129/241] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:45.332169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:45.348876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94512ee7-da4f-4a67-9dcf-4902df22d694 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:45.480056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94512ee7-da4f-4a67-9dcf-4902df22d694 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:45.498762 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003da91-c53c-4bb9-ac4d-edcf7ad8322a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:45.504453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:45.520276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadb204-7e80-4c45-ac56-e6ac0db00243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:45.521509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb204-7e80-4c45-ac56-e6ac0db00243 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:45.530957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb204-7e80-4c45-ac56-e6ac0db00243 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:45.530957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb204-7e80-4c45-ac56-e6ac0db00243 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:45.530957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadb204-7e80-4c45-ac56-e6ac0db00243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:45.530957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadb204-7e80-4c45-ac56-e6ac0db00243 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:45.530957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 130/242] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:45.534199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadb204-7e80-4c45-ac56-e6ac0db00243 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:45.589821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25596b-7be6-4274-b9f9-91c54a54110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:45.590502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25596b-7be6-4274-b9f9-91c54a54110a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:45.590787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25596b-7be6-4274-b9f9-91c54a54110a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:45.591065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25596b-7be6-4274-b9f9-91c54a54110a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:45.674539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadb204-7e80-4c45-ac56-e6ac0db00243 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:45.716071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b7795-79fd-4f83-8be6-1b3d92786e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:45.717212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b7795-79fd-4f83-8be6-1b3d92786e16 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:45.717694 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b7795-79fd-4f83-8be6-1b3d92786e16 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:45.718163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b7795-79fd-4f83-8be6-1b3d92786e16 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:45.719111 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b7795-79fd-4f83-8be6-1b3d92786e16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:45.720802 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b7795-79fd-4f83-8be6-1b3d92786e16 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:45.740744 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25596b-7be6-4274-b9f9-91c54a54110a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:45.742866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25596b-7be6-4274-b9f9-91c54a54110a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:45.794897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:45.808655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 131/243] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:35:45 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:45.817993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ca9e9-21a6-412d-a1de-d9c13acaba1a None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:45.820640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ca9e9-21a6-412d-a1de-d9c13acaba1a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:45.820640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ca9e9-21a6-412d-a1de-d9c13acaba1a None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:45.820640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 132/244] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:45.835286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf1416-637e-450d-9b29-6bcf54740db6 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:45.835946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf1416-637e-450d-9b29-6bcf54740db6 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:45.836438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf1416-637e-450d-9b29-6bcf54740db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:45.878771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-eacf1416-637e-450d-9b29-6bcf54740db6 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:45.880785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-eacf1416-637e-450d-9b29-6bcf54740db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:45.883503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 113/245] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 17:35:45.893797 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25596b-7be6-4274-b9f9-91c54a54110a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:45.982507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:46.039796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25596b-7be6-4274-b9f9-91c54a54110a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:46.040036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 133/246] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:46.073806 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf1416-637e-450d-9b29-6bcf54740db6 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:46.098388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81a7cd-5b87-4406-ae03-f4004d607127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:46.099532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a7cd-5b87-4406-ae03-f4004d607127 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:46.099978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a7cd-5b87-4406-ae03-f4004d607127 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:46.100392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a7cd-5b87-4406-ae03-f4004d607127 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:46.104035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81a7cd-5b87-4406-ae03-f4004d607127 None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:46.105979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81a7cd-5b87-4406-ae03-f4004d607127 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:46.108226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 114/247] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:45 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:46.115222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81a7cd-5b87-4406-ae03-f4004d607127 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:46.128027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:46.209226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf1416-637e-450d-9b29-6bcf54740db6 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:46.254559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81a7cd-5b87-4406-ae03-f4004d607127 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:46.258276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8af40-c7fb-4cf5-aab5-6395c8cc7883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:46.260610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8af40-c7fb-4cf5-aab5-6395c8cc7883 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:46.260610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8af40-c7fb-4cf5-aab5-6395c8cc7883 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:46.260610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8af40-c7fb-4cf5-aab5-6395c8cc7883 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:46.277541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8af40-c7fb-4cf5-aab5-6395c8cc7883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-14b8af40-c7fb-4cf5-aab5-6395c8cc7883 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:46.289105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:46.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:46.291008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:46.291008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:46.291008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:46.291008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:46.291008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:46.291008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:46.291008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:46.291008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:46.291008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:46.291008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:46.291008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:46.291008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:46.299115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 134/248] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:35:46.299115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d6adc-5865-49c4-be8b-6026aa3dd54b None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:46.299115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d6adc-5865-49c4-be8b-6026aa3dd54b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:46.299115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d6adc-5865-49c4-be8b-6026aa3dd54b None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:46.300584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 135/249] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:46.301383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d6adc-5865-49c4-be8b-6026aa3dd54b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:46.309503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d7103-ca56-48f5-bf43-22599e9b7b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:46.310700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d7103-ca56-48f5-bf43-22599e9b7b97 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:46.311223 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d7103-ca56-48f5-bf43-22599e9b7b97 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:46.311500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d7103-ca56-48f5-bf43-22599e9b7b97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:46.312379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d7103-ca56-48f5-bf43-22599e9b7b97 None admin] RBAC: Adding query filter params (role.id=6ea42ab173de4304986be223ef0dcb2c, scope.project.id=b19baba10ae34863868739f9da315ab6, user.id=8d947e4de98347ebadc9652105ff1321) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:46.312755 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d7103-ca56-48f5-bf43-22599e9b7b97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:46.319770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d7103-ca56-48f5-bf43-22599e9b7b97 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:46.324443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 115/250] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:46 2022] GET /identity/v3/role_assignments?user.id=8d947e4de98347ebadc9652105ff1321&scope.project.id=b19baba10ae34863868739f9da315ab6&role.id=6ea42ab173de4304986be223ef0dcb2c => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:46.329582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dc074-436a-47d2-bd89-e6d4b33a61f9 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:46.330286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dc074-436a-47d2-bd89-e6d4b33a61f9 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:46.330572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dc074-436a-47d2-bd89-e6d4b33a61f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:46.353884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-9e8dc074-436a-47d2-bd89-e6d4b33a61f9 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:46.355784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:46.356107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9e8dc074-436a-47d2-bd89-e6d4b33a61f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:46.445027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 116/251] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:46.481199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dc074-436a-47d2-bd89-e6d4b33a61f9 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:46.483868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:46.497591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d6adc-5865-49c4-be8b-6026aa3dd54b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:46.570882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fd761-270d-493a-acdf-9640a1a21cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:46.571495 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fd761-270d-493a-acdf-9640a1a21cf1 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:46.571996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fd761-270d-493a-acdf-9640a1a21cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:46.572386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fd761-270d-493a-acdf-9640a1a21cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:46.573218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fd761-270d-493a-acdf-9640a1a21cf1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:46.573529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fd761-270d-493a-acdf-9640a1a21cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:46.574963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fd761-270d-493a-acdf-9640a1a21cf1 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:46.595249 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 136/252] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:46.601537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fd761-270d-493a-acdf-9640a1a21cf1 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:46.687935 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dc074-436a-47d2-bd89-e6d4b33a61f9 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:46.747840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa7d2f-86a2-4495-b963-241bdfbfe168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:46.748697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa7d2f-86a2-4495-b963-241bdfbfe168 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:46.748977 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa7d2f-86a2-4495-b963-241bdfbfe168 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:46.749251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa7d2f-86a2-4495-b963-241bdfbfe168 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:46.773194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa7d2f-86a2-4495-b963-241bdfbfe168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-b8fa7d2f-86a2-4495-b963-241bdfbfe168 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:46.782736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:46.783666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:46.784452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 117/253] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:35:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:46.793724 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa7d2f-86a2-4495-b963-241bdfbfe168 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:46.834756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:46.845795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fd761-270d-493a-acdf-9640a1a21cf1 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:46.918057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e6ca9-6c16-49f3-97df-0f2e27f512df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:46.919769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e6ca9-6c16-49f3-97df-0f2e27f512df None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:46.920230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e6ca9-6c16-49f3-97df-0f2e27f512df None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:46.920754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e6ca9-6c16-49f3-97df-0f2e27f512df None admin] PATH_INFO: `/v3/users/46ffb52b0a7040de9069d7b8c2cb11b6` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:46.922528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e6ca9-6c16-49f3-97df-0f2e27f512df None admin] RBAC: Authorizing `identity:get_user(user_id=46ffb52b0a7040de9069d7b8c2cb11b6)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:46.924254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e6ca9-6c16-49f3-97df-0f2e27f512df None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:46.927882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 137/254] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:46 2022] GET /identity/v3/users/46ffb52b0a7040de9069d7b8c2cb11b6 => generated 297 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:46.929522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84568bb-d964-48bc-b881-161f3913f2e5 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:46.930037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84568bb-d964-48bc-b881-161f3913f2e5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:46.930514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84568bb-d964-48bc-b881-161f3913f2e5 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:46.932148 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 138/255] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:46.935408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:46.937892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84568bb-d964-48bc-b881-161f3913f2e5 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:47.016766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa7d2f-86a2-4495-b963-241bdfbfe168 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:47.075800 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84568bb-d964-48bc-b881-161f3913f2e5 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:47.115191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a290d-0459-4826-8b4a-17c3b1c67cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:47.116006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a290d-0459-4826-8b4a-17c3b1c67cea None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:47.116289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a290d-0459-4826-8b4a-17c3b1c67cea None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:47.116605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a290d-0459-4826-8b4a-17c3b1c67cea None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:47.117998 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a290d-0459-4826-8b4a-17c3b1c67cea None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:47.120080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a290d-0459-4826-8b4a-17c3b1c67cea None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:47.122329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 139/256] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:46 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:47.123647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4fc69-c1c7-4aa2-a1a3-14d6e4488b86 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:47.123932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4fc69-c1c7-4aa2-a1a3-14d6e4488b86 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:47.124211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4fc69-c1c7-4aa2-a1a3-14d6e4488b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:47.143561 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-5bd4fc69-c1c7-4aa2-a1a3-14d6e4488b86 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:47.144905 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5bd4fc69-c1c7-4aa2-a1a3-14d6e4488b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:47.156138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b343687-f5ea-4c1d-bc91-4543a2b382ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:47.156853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b343687-f5ea-4c1d-bc91-4543a2b382ec None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:47.157140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b343687-f5ea-4c1d-bc91-4543a2b382ec None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:47.157414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b343687-f5ea-4c1d-bc91-4543a2b382ec None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:47.158186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b343687-f5ea-4c1d-bc91-4543a2b382ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:47.158495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b343687-f5ea-4c1d-bc91-4543a2b382ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:47.159913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b343687-f5ea-4c1d-bc91-4543a2b382ec None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:47.180845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:47.183616 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 118/257] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:35:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:47.184307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b343687-f5ea-4c1d-bc91-4543a2b382ec None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:47.253294 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 140/258] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:47.254212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4fc69-c1c7-4aa2-a1a3-14d6e4488b86 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:47.388124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b343687-f5ea-4c1d-bc91-4543a2b382ec None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:47.440885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:47.455252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134b29e-6971-4e94-ae9e-ca009950062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:47.456158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134b29e-6971-4e94-ae9e-ca009950062a None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:47.456448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134b29e-6971-4e94-ae9e-ca009950062a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:47.456755 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134b29e-6971-4e94-ae9e-ca009950062a None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6/users/46ffb52b0a7040de9069d7b8c2cb11b6/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:47.459695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134b29e-6971-4e94-ae9e-ca009950062a None admin] RBAC: Authorizing `identity:create_grant(project_id=b19baba10ae34863868739f9da315ab6, user_id=46ffb52b0a7040de9069d7b8c2cb11b6, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:47.461214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134b29e-6971-4e94-ae9e-ca009950062a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:47.479308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4fc69-c1c7-4aa2-a1a3-14d6e4488b86 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:47.519350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b6fc0-6de6-42d2-9a82-97ddc69198e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:47.520291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b6fc0-6de6-42d2-9a82-97ddc69198e3 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:47.520648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b6fc0-6de6-42d2-9a82-97ddc69198e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:47.520926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b6fc0-6de6-42d2-9a82-97ddc69198e3 None admin] PATH_INFO: `/v3/users/b82717174598401098c6f63d7e75bca7` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:47.522264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b6fc0-6de6-42d2-9a82-97ddc69198e3 None admin] RBAC: Authorizing `identity:get_user(user_id=b82717174598401098c6f63d7e75bca7)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:47.523988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b6fc0-6de6-42d2-9a82-97ddc69198e3 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:47.526348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 141/259] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:47 2022] GET /identity/v3/users/b82717174598401098c6f63d7e75bca7 => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:47.527173 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b6fc0-6de6-42d2-9a82-97ddc69198e3 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:47.559779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:47.585452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 119/260] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:35:47 2022] PUT /identity/v3/projects/b19baba10ae34863868739f9da315ab6/users/46ffb52b0a7040de9069d7b8c2cb11b6/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:35:47.586493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134b29e-6971-4e94-ae9e-ca009950062a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:47.708743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b6fc0-6de6-42d2-9a82-97ddc69198e3 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:47.747690 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbb565-9d17-480d-8bb8-169a908ad03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:47.748733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb565-9d17-480d-8bb8-169a908ad03d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:47.749120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb565-9d17-480d-8bb8-169a908ad03d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:47.749500 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbb565-9d17-480d-8bb8-169a908ad03d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:47.763123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbb565-9d17-480d-8bb8-169a908ad03d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-addbb565-9d17-480d-8bb8-169a908ad03d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:47.771393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:47.772670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:47.773661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:47.773661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:47.773661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:47.773661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:47.773661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:47.773661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:47.773661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:47.773661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:47.773661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:47.773661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:47.773661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:35:47.773661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:47.775464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 142/261] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:47.785672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbb565-9d17-480d-8bb8-169a908ad03d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:47.837074 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134b29e-6971-4e94-ae9e-ca009950062a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:47.914303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabcb5a-5a9b-438d-8da7-5e07f38ff03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:47.915876 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabcb5a-5a9b-438d-8da7-5e07f38ff03a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:47.916360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabcb5a-5a9b-438d-8da7-5e07f38ff03a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:47.916969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabcb5a-5a9b-438d-8da7-5e07f38ff03a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:47.958921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:47.984431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbb565-9d17-480d-8bb8-169a908ad03d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:48.030115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:48.056604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabcb5a-5a9b-438d-8da7-5e07f38ff03a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:48.058195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabcb5a-5a9b-438d-8da7-5e07f38ff03a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:48.064175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e02b7-62a9-49b8-8cc3-c68bfd25bd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:48.064906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e02b7-62a9-49b8-8cc3-c68bfd25bd7f None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:48.065190 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e02b7-62a9-49b8-8cc3-c68bfd25bd7f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:48.065464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e02b7-62a9-49b8-8cc3-c68bfd25bd7f None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:48.066234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e02b7-62a9-49b8-8cc3-c68bfd25bd7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:48.066537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e02b7-62a9-49b8-8cc3-c68bfd25bd7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:48.067938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e02b7-62a9-49b8-8cc3-c68bfd25bd7f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:48.091164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 143/262] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:48.098874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e02b7-62a9-49b8-8cc3-c68bfd25bd7f None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:48.252621 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 120/263] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:48.253048 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabcb5a-5a9b-438d-8da7-5e07f38ff03a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:48.311798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e02b7-62a9-49b8-8cc3-c68bfd25bd7f None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:48.353700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:48.366716 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabcb5a-5a9b-438d-8da7-5e07f38ff03a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:48.381789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39f293-23de-482f-9d34-a84ce4426c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:48.382990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39f293-23de-482f-9d34-a84ce4426c34 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:48.383409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39f293-23de-482f-9d34-a84ce4426c34 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:48.383839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39f293-23de-482f-9d34-a84ce4426c34 None admin] PATH_INFO: `/v3/users/b82717174598401098c6f63d7e75bca7` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:48.389642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39f293-23de-482f-9d34-a84ce4426c34 None admin] RBAC: Authorizing `identity:get_user(user_id=b82717174598401098c6f63d7e75bca7)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:48.391561 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39f293-23de-482f-9d34-a84ce4426c34 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:48.393583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 144/264] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:48 2022] GET /identity/v3/users/b82717174598401098c6f63d7e75bca7 => generated 283 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:48.410252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da82a4-4e75-4b1f-b6b1-8dc125b5ca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:48.411276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da82a4-4e75-4b1f-b6b1-8dc125b5ca3c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:48.411657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da82a4-4e75-4b1f-b6b1-8dc125b5ca3c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:48.412029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da82a4-4e75-4b1f-b6b1-8dc125b5ca3c None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:48.412325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39f293-23de-482f-9d34-a84ce4426c34 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:48.413517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da82a4-4e75-4b1f-b6b1-8dc125b5ca3c None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:48.415189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da82a4-4e75-4b1f-b6b1-8dc125b5ca3c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:48.417775 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 121/265] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:48 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:48.424517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da82a4-4e75-4b1f-b6b1-8dc125b5ca3c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:48.448507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:48.535058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da82a4-4e75-4b1f-b6b1-8dc125b5ca3c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:48.574413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f4bc6-6efe-477c-9c16-c26ef7583dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:48.575084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f4bc6-6efe-477c-9c16-c26ef7583dcc None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:48.575366 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f4bc6-6efe-477c-9c16-c26ef7583dcc None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:48.575638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f4bc6-6efe-477c-9c16-c26ef7583dcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:48.576511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f4bc6-6efe-477c-9c16-c26ef7583dcc None admin] RBAC: Adding query filter params (role.id=7c97532e07d14d4096b310fb69816951, scope.project.id=b19baba10ae34863868739f9da315ab6, user.id=b82717174598401098c6f63d7e75bca7) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:48.576823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f4bc6-6efe-477c-9c16-c26ef7583dcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:48.578284 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f4bc6-6efe-477c-9c16-c26ef7583dcc None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:48.585295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 122/266] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:48 2022] GET /identity/v3/role_assignments?user.id=b82717174598401098c6f63d7e75bca7&scope.project.id=b19baba10ae34863868739f9da315ab6&role.id=7c97532e07d14d4096b310fb69816951 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:48.694198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39f293-23de-482f-9d34-a84ce4426c34 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:48.753246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543cbfc-f0b4-42ee-994d-774736982c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:48.753927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543cbfc-f0b4-42ee-994d-774736982c38 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:48.754205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543cbfc-f0b4-42ee-994d-774736982c38 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:48.754480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543cbfc-f0b4-42ee-994d-774736982c38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:48.840450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543cbfc-f0b4-42ee-994d-774736982c38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:48.841911 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543cbfc-f0b4-42ee-994d-774736982c38 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:48.861632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:48.956264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5b2e5-e939-41f9-87c2-342569242666 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:48.956688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5b2e5-e939-41f9-87c2-342569242666 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:48.956897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5b2e5-e939-41f9-87c2-342569242666 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:48.958602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 123/267] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:35:48.965458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3cb27-efa6-4e7e-b774-6c729e89dedd None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:48.965750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3cb27-efa6-4e7e-b774-6c729e89dedd None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:48.966020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3cb27-efa6-4e7e-b774-6c729e89dedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:48.968790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 145/268] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:48.976734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543cbfc-f0b4-42ee-994d-774736982c38 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:48.997890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-2ff3cb27-efa6-4e7e-b774-6c729e89dedd None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:48.999293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2ff3cb27-efa6-4e7e-b774-6c729e89dedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:49.015926 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:49.085416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 124/269] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:49.152171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543cbfc-f0b4-42ee-994d-774736982c38 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:49.166008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3cb27-efa6-4e7e-b774-6c729e89dedd None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:49.188734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:49.229753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e0f85-012c-4b29-80ad-63497a8a9c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:49.230677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e0f85-012c-4b29-80ad-63497a8a9c2f None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:49.230960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e0f85-012c-4b29-80ad-63497a8a9c2f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:49.231235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e0f85-012c-4b29-80ad-63497a8a9c2f None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:49.232521 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e0f85-012c-4b29-80ad-63497a8a9c2f None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:49.234009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e0f85-012c-4b29-80ad-63497a8a9c2f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:49.244985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 146/270] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:48 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:49.253778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e0f85-012c-4b29-80ad-63497a8a9c2f None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:49.305713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3cb27-efa6-4e7e-b774-6c729e89dedd None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:49.348995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f04f04-eef4-48bb-9de7-7c7970b42416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:49.349992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f04f04-eef4-48bb-9de7-7c7970b42416 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:49.350284 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f04f04-eef4-48bb-9de7-7c7970b42416 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:49.350563 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f04f04-eef4-48bb-9de7-7c7970b42416 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:49.365508 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f04f04-eef4-48bb-9de7-7c7970b42416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-d5f04f04-eef4-48bb-9de7-7c7970b42416 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:49.375416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:49.376603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:49.377573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:49.377573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:49.377573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:49.377573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:49.377573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:49.377573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:49.377573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:49.377573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:49.377573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:49.377573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:49.377573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:49.377573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:49.380609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 125/271] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:35:49.389688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f04f04-eef4-48bb-9de7-7c7970b42416 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:49.409196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:49.500711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e0f85-012c-4b29-80ad-63497a8a9c2f None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:49.539204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc61813-0e9d-4a2d-9672-9266395b572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:49.540363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61813-0e9d-4a2d-9672-9266395b572a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:49.541531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61813-0e9d-4a2d-9672-9266395b572a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:49.542218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61813-0e9d-4a2d-9672-9266395b572a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:49.543302 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc61813-0e9d-4a2d-9672-9266395b572a None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=b19baba10ae34863868739f9da315ab6, user.id=b82717174598401098c6f63d7e75bca7) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:49.543860 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc61813-0e9d-4a2d-9672-9266395b572a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:49.545783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc61813-0e9d-4a2d-9672-9266395b572a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:49.552957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 147/272] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:49 2022] GET /identity/v3/role_assignments?user.id=b82717174598401098c6f63d7e75bca7&scope.project.id=b19baba10ae34863868739f9da315ab6&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:49.554734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f0358-fbd3-4eae-a230-273fa9e45fc3 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:49.555234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f0358-fbd3-4eae-a230-273fa9e45fc3 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:49.555878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f0358-fbd3-4eae-a230-273fa9e45fc3 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:49.557847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 148/273] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:49.563346 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f04f04-eef4-48bb-9de7-7c7970b42416 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:49.564537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5c3e3-df92-481c-a5a0-49602791e8af None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:49.564975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5c3e3-df92-481c-a5a0-49602791e8af None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:49.565444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5c3e3-df92-481c-a5a0-49602791e8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:49.585935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-0eb5c3e3-df92-481c-a5a0-49602791e8af None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:49.588200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0eb5c3e3-df92-481c-a5a0-49602791e8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:49.616030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c59d6-fc47-4c67-b7ea-01615950b74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:49.617138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c59d6-fc47-4c67-b7ea-01615950b74e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:49.617529 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c59d6-fc47-4c67-b7ea-01615950b74e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:49.618370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c59d6-fc47-4c67-b7ea-01615950b74e None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:49.620141 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c59d6-fc47-4c67-b7ea-01615950b74e None admin] RBAC: Adding query filter params (name=member) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:49.620633 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c59d6-fc47-4c67-b7ea-01615950b74e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:49.622416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c59d6-fc47-4c67-b7ea-01615950b74e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:49.635840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 126/274] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:49.637512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe05a53-d425-4e72-bccf-dd9bddd48db4 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:49.637913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe05a53-d425-4e72-bccf-dd9bddd48db4 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:49.638294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe05a53-d425-4e72-bccf-dd9bddd48db4 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:49.641018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 127/275] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:49.646407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe05a53-d425-4e72-bccf-dd9bddd48db4 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:49.649752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:49.692638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 149/276] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:49.692638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a351d-b434-4a8e-955b-5b1152442c03 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:49.692638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a351d-b434-4a8e-955b-5b1152442c03 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:49.692638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a351d-b434-4a8e-955b-5b1152442c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:49.710697 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-c93a351d-b434-4a8e-955b-5b1152442c03 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:49.712018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c93a351d-b434-4a8e-955b-5b1152442c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:49.803384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:49.820918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 150/277] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:49.828658 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a351d-b434-4a8e-955b-5b1152442c03 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:49.846785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe05a53-d425-4e72-bccf-dd9bddd48db4 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:49.896272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb864d6-23e6-40dd-bf2b-88836bedc0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:49.897217 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb864d6-23e6-40dd-bf2b-88836bedc0f5 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:49.897512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb864d6-23e6-40dd-bf2b-88836bedc0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:49.897798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb864d6-23e6-40dd-bf2b-88836bedc0f5 None admin] PATH_INFO: `/v3/users/1be35faa29f64c5fb395d267421f3e59` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:49.920067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb864d6-23e6-40dd-bf2b-88836bedc0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=1be35faa29f64c5fb395d267421f3e59)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:49.921955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb864d6-23e6-40dd-bf2b-88836bedc0f5 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:49.924387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 128/278] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:49 2022] GET /identity/v3/users/1be35faa29f64c5fb395d267421f3e59 => generated 293 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:49.928606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb864d6-23e6-40dd-bf2b-88836bedc0f5 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:49.995375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a351d-b434-4a8e-955b-5b1152442c03 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:50.017443 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:50.050616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8748e2-6466-4ea1-a478-92d96987fcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:50.052031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8748e2-6466-4ea1-a478-92d96987fcfc None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:50.052426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8748e2-6466-4ea1-a478-92d96987fcfc None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:50.052928 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8748e2-6466-4ea1-a478-92d96987fcfc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:50.073845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8748e2-6466-4ea1-a478-92d96987fcfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-ba8748e2-6466-4ea1-a478-92d96987fcfc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:50.089642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:50.091385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 151/279] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:50.094020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8748e2-6466-4ea1-a478-92d96987fcfc None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:50.104225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb864d6-23e6-40dd-bf2b-88836bedc0f5 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:50.140092 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:50.151760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ee2f2-a148-4309-8fda-b31c782aa35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:50.155681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ee2f2-a148-4309-8fda-b31c782aa35f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:50.155681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ee2f2-a148-4309-8fda-b31c782aa35f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:50.155681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ee2f2-a148-4309-8fda-b31c782aa35f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:50.155681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ee2f2-a148-4309-8fda-b31c782aa35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:50.157197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ee2f2-a148-4309-8fda-b31c782aa35f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:50.159045 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 129/280] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:50.159989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ee2f2-a148-4309-8fda-b31c782aa35f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:50.247548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8748e2-6466-4ea1-a478-92d96987fcfc None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:50.309589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b98c50-80d3-4c2a-a818-47e87aef2a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:50.310410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b98c50-80d3-4c2a-a818-47e87aef2a96 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:50.310691 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b98c50-80d3-4c2a-a818-47e87aef2a96 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:50.311020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b98c50-80d3-4c2a-a818-47e87aef2a96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:50.311881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b98c50-80d3-4c2a-a818-47e87aef2a96 None admin] RBAC: Adding query filter params (role.id=0f0e06be5d684398a453fa6312e57d41, user.id=1be35faa29f64c5fb395d267421f3e59, scope.system=all) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:50.312194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b98c50-80d3-4c2a-a818-47e87aef2a96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:50.315761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b98c50-80d3-4c2a-a818-47e87aef2a96 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:50.323111 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 152/281] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Jul 20 17:35:50 2022] GET /identity/v3/role_assignments?user.id=1be35faa29f64c5fb395d267421f3e59&scope.system=all&role.id=0f0e06be5d684398a453fa6312e57d41 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:50.323980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b98c50-80d3-4c2a-a818-47e87aef2a96 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:50.347743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ee2f2-a148-4309-8fda-b31c782aa35f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:50.373513 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:50.410551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ea0ed-73f0-462f-b72c-4ed0892dd4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:50.412122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ea0ed-73f0-462f-b72c-4ed0892dd4c9 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:50.412522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ea0ed-73f0-462f-b72c-4ed0892dd4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:50.412911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ea0ed-73f0-462f-b72c-4ed0892dd4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:50.413724 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ea0ed-73f0-462f-b72c-4ed0892dd4c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:50.414037 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ea0ed-73f0-462f-b72c-4ed0892dd4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:50.417178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ea0ed-73f0-462f-b72c-4ed0892dd4c9 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:50.431726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 130/282] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:50.438081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ea0ed-73f0-462f-b72c-4ed0892dd4c9 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:50.505299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b98c50-80d3-4c2a-a818-47e87aef2a96 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:50.534921 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:50.553359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997c583-42ab-481e-a8a3-6794baa06291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:50.554415 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997c583-42ab-481e-a8a3-6794baa06291 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:50.555113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997c583-42ab-481e-a8a3-6794baa06291 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:50.555592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997c583-42ab-481e-a8a3-6794baa06291 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:50.556839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997c583-42ab-481e-a8a3-6794baa06291 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:50.558763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997c583-42ab-481e-a8a3-6794baa06291 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:50.594110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ea0ed-73f0-462f-b72c-4ed0892dd4c9 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:50.635936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928ebb8-5cb6-4f22-a632-6d49d3fce167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:50.636844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928ebb8-5cb6-4f22-a632-6d49d3fce167 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:50.637125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928ebb8-5cb6-4f22-a632-6d49d3fce167 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:50.637396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928ebb8-5cb6-4f22-a632-6d49d3fce167 None admin] PATH_INFO: `/v3/users/8d947e4de98347ebadc9652105ff1321` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:50.638659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928ebb8-5cb6-4f22-a632-6d49d3fce167 None admin] RBAC: Authorizing `identity:get_user(user_id=8d947e4de98347ebadc9652105ff1321)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:50.640145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928ebb8-5cb6-4f22-a632-6d49d3fce167 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:50.642173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 131/283] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:50 2022] GET /identity/v3/users/8d947e4de98347ebadc9652105ff1321 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:50.645973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84483c58-a93f-453f-a126-0bbbfb18b122 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:50.646241 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84483c58-a93f-453f-a126-0bbbfb18b122 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:50.646527 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84483c58-a93f-453f-a126-0bbbfb18b122 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:50.648025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 132/284] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:50.650526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84483c58-a93f-453f-a126-0bbbfb18b122 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:50.661573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 153/285] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:35:50 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:50.662885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a37ea-4144-4b20-87e0-1536bfe1edf0 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:50.663244 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a37ea-4144-4b20-87e0-1536bfe1edf0 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:50.663599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a37ea-4144-4b20-87e0-1536bfe1edf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:50.688129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-118a37ea-4144-4b20-87e0-1536bfe1edf0 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:50.690020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-118a37ea-4144-4b20-87e0-1536bfe1edf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:50.804600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 154/286] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:50.804793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84483c58-a93f-453f-a126-0bbbfb18b122 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:50.824464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a37ea-4144-4b20-87e0-1536bfe1edf0 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:50.836963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:50.848375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:50.849976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92deab9b-8910-4716-accb-572124f580e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:50.852295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92deab9b-8910-4716-accb-572124f580e3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:50.852295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92deab9b-8910-4716-accb-572124f580e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:50.852295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92deab9b-8910-4716-accb-572124f580e3 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:50.853535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92deab9b-8910-4716-accb-572124f580e3 None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:50.855957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92deab9b-8910-4716-accb-572124f580e3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:50.858535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 133/287] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:50 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:50.864209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92deab9b-8910-4716-accb-572124f580e3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:50.991359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a37ea-4144-4b20-87e0-1536bfe1edf0 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:51.038090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92deab9b-8910-4716-accb-572124f580e3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:51.049148 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75dbab-aa04-477d-abeb-3cfbddfb49dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:51.049986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75dbab-aa04-477d-abeb-3cfbddfb49dc None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:51.050300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75dbab-aa04-477d-abeb-3cfbddfb49dc None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:51.051131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75dbab-aa04-477d-abeb-3cfbddfb49dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:51.065365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75dbab-aa04-477d-abeb-3cfbddfb49dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-0a75dbab-aa04-477d-abeb-3cfbddfb49dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:51.073501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:51.074479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:51.075281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 155/288] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:51.080829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75dbab-aa04-477d-abeb-3cfbddfb49dc None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:51.097781 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05435aca-7396-4f36-861f-0e22704527d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:51.098782 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05435aca-7396-4f36-861f-0e22704527d8 None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:51.099184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05435aca-7396-4f36-861f-0e22704527d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:51.099535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05435aca-7396-4f36-861f-0e22704527d8 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6/users/8d947e4de98347ebadc9652105ff1321/roles/6ea42ab173de4304986be223ef0dcb2c` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:51.101730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05435aca-7396-4f36-861f-0e22704527d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b19baba10ae34863868739f9da315ab6, user_id=8d947e4de98347ebadc9652105ff1321, role_id=6ea42ab173de4304986be223ef0dcb2c)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:51.103850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05435aca-7396-4f36-861f-0e22704527d8 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:51.211453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 134/289] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:35:50 2022] PUT /identity/v3/projects/b19baba10ae34863868739f9da315ab6/users/8d947e4de98347ebadc9652105ff1321/roles/6ea42ab173de4304986be223ef0dcb2c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:35:51.224767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:51.272395 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75dbab-aa04-477d-abeb-3cfbddfb49dc None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:51.339162 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c038b-e81b-45dc-84b5-43eb6f2592ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:51.339790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c038b-e81b-45dc-84b5-43eb6f2592ae None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:51.340079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c038b-e81b-45dc-84b5-43eb6f2592ae None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:51.340360 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c038b-e81b-45dc-84b5-43eb6f2592ae None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:51.341192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c038b-e81b-45dc-84b5-43eb6f2592ae None admin] RBAC: Adding query filter params (name=member) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:51.341506 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c038b-e81b-45dc-84b5-43eb6f2592ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:51.343012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c038b-e81b-45dc-84b5-43eb6f2592ae None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:51.357985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 156/290] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:51.364153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05435aca-7396-4f36-861f-0e22704527d8 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:51.477872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:51.536434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05435aca-7396-4f36-861f-0e22704527d8 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:51.583148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49c0f1-b705-4d6e-8269-4053ebcd002b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:51.584038 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49c0f1-b705-4d6e-8269-4053ebcd002b None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:51.584323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49c0f1-b705-4d6e-8269-4053ebcd002b None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:51.587617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49c0f1-b705-4d6e-8269-4053ebcd002b None admin] PATH_INFO: `/v3/users/46ffb52b0a7040de9069d7b8c2cb11b6` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:51.587617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49c0f1-b705-4d6e-8269-4053ebcd002b None admin] RBAC: Authorizing `identity:get_user(user_id=46ffb52b0a7040de9069d7b8c2cb11b6)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:51.587617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49c0f1-b705-4d6e-8269-4053ebcd002b None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:51.590005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 135/291] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:51 2022] GET /identity/v3/users/46ffb52b0a7040de9069d7b8c2cb11b6 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:51.600049 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c038b-e81b-45dc-84b5-43eb6f2592ae None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:51.832796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c038b-e81b-45dc-84b5-43eb6f2592ae None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:51.869285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9cc2a-eebf-4366-83f7-8ff399decebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:51.870039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9cc2a-eebf-4366-83f7-8ff399decebb None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:51.870321 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9cc2a-eebf-4366-83f7-8ff399decebb None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:51.870593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9cc2a-eebf-4366-83f7-8ff399decebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:51.897378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:51.947384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9cc2a-eebf-4366-83f7-8ff399decebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:51.949028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9cc2a-eebf-4366-83f7-8ff399decebb None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:52.055620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 157/292] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:52.061609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49c0f1-b705-4d6e-8269-4053ebcd002b None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:52.213184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49c0f1-b705-4d6e-8269-4053ebcd002b None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:52.236927 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:52.252795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73735f1-b061-4d98-8d97-014266f97cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:52.253664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73735f1-b061-4d98-8d97-014266f97cce None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:52.253950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73735f1-b061-4d98-8d97-014266f97cce None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:52.254230 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73735f1-b061-4d98-8d97-014266f97cce None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:52.255466 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73735f1-b061-4d98-8d97-014266f97cce None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:52.256955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73735f1-b061-4d98-8d97-014266f97cce None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:52.259098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 136/293] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:52 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:52.269714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9cc2a-eebf-4366-83f7-8ff399decebb None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:52.330823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:52.412268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9cc2a-eebf-4366-83f7-8ff399decebb None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:52.453823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99c539-2176-40f9-aab0-3eef142a8a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:52.454492 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99c539-2176-40f9-aab0-3eef142a8a09 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:52.454776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99c539-2176-40f9-aab0-3eef142a8a09 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:52.455050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99c539-2176-40f9-aab0-3eef142a8a09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:52.455890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99c539-2176-40f9-aab0-3eef142a8a09 None admin] RBAC: Adding query filter params (role.id=0f0e06be5d684398a453fa6312e57d41, scope.project.id=b19baba10ae34863868739f9da315ab6, user.id=46ffb52b0a7040de9069d7b8c2cb11b6) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:52.456198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99c539-2176-40f9-aab0-3eef142a8a09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:52.457667 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99c539-2176-40f9-aab0-3eef142a8a09 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:52.472735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 158/294] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:52 2022] GET /identity/v3/role_assignments?user.id=46ffb52b0a7040de9069d7b8c2cb11b6&scope.project.id=b19baba10ae34863868739f9da315ab6&role.id=0f0e06be5d684398a453fa6312e57d41 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:52.945622 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188047a-192c-4a48-8881-659e28095355 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:52.945994 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188047a-192c-4a48-8881-659e28095355 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:52.946191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188047a-192c-4a48-8881-659e28095355 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:52.948936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 137/295] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:52.954962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc290f-aaf2-4207-80a6-72e42e1e7e4e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:52.955245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc290f-aaf2-4207-80a6-72e42e1e7e4e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:52.955535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc290f-aaf2-4207-80a6-72e42e1e7e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:52.973528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-17fc290f-aaf2-4207-80a6-72e42e1e7e4e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:52.974752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-17fc290f-aaf2-4207-80a6-72e42e1e7e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:53.065183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 159/296] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:53.088556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188047a-192c-4a48-8881-659e28095355 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:53.214652 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188047a-192c-4a48-8881-659e28095355 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:53.257101 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a3588-02b2-4019-8806-aa5d9f532a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:53.257920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a3588-02b2-4019-8806-aa5d9f532a1c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:53.258251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a3588-02b2-4019-8806-aa5d9f532a1c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:53.258535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a3588-02b2-4019-8806-aa5d9f532a1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:53.271796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a3588-02b2-4019-8806-aa5d9f532a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-f25a3588-02b2-4019-8806-aa5d9f532a1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:53.280020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:53.284125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:53.285007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 138/297] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:53.288022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc290f-aaf2-4207-80a6-72e42e1e7e4e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:53.345324 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:53.458071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc290f-aaf2-4207-80a6-72e42e1e7e4e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:53.496442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc82e9-50c8-4f88-b6ed-10979a46f1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:53.497061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc82e9-50c8-4f88-b6ed-10979a46f1b6 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:53.497339 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc82e9-50c8-4f88-b6ed-10979a46f1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:53.497607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc82e9-50c8-4f88-b6ed-10979a46f1b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:53.498363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc82e9-50c8-4f88-b6ed-10979a46f1b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:53.498667 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc82e9-50c8-4f88-b6ed-10979a46f1b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:53.500055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc82e9-50c8-4f88-b6ed-10979a46f1b6 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:53.510978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 160/298] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:53.519312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a3588-02b2-4019-8806-aa5d9f532a1c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:53.576353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a9aee-15c1-4208-ba00-ce413546df59 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:53.576897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a9aee-15c1-4208-ba00-ce413546df59 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:53.577348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a9aee-15c1-4208-ba00-ce413546df59 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:53.580103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 161/299] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:35:53.589146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ebe1f-d0ca-4bda-be48-cbceeaf15aeb None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:53.589609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ebe1f-d0ca-4bda-be48-cbceeaf15aeb None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:53.590086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ebe1f-d0ca-4bda-be48-cbceeaf15aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:53.615308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a55ebe1f-d0ca-4bda-be48-cbceeaf15aeb None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:53.616562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a55ebe1f-d0ca-4bda-be48-cbceeaf15aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:53.620640 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:53.696948 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 162/300] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:53.722436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ebe1f-d0ca-4bda-be48-cbceeaf15aeb None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:53.727081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a3588-02b2-4019-8806-aa5d9f532a1c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:53.776112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:53.794937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965cd64-abbb-45ba-90ae-da73a3cecd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:53.796376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965cd64-abbb-45ba-90ae-da73a3cecd0a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:53.796925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965cd64-abbb-45ba-90ae-da73a3cecd0a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:53.797780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965cd64-abbb-45ba-90ae-da73a3cecd0a None admin] PATH_INFO: `/v3/users/1be35faa29f64c5fb395d267421f3e59` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:53.799777 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965cd64-abbb-45ba-90ae-da73a3cecd0a None admin] RBAC: Authorizing `identity:get_user(user_id=1be35faa29f64c5fb395d267421f3e59)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:53.802739 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965cd64-abbb-45ba-90ae-da73a3cecd0a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:53.805909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 139/301] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:53 2022] GET /identity/v3/users/1be35faa29f64c5fb395d267421f3e59 => generated 293 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:53.812046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf444f-1af2-47fd-a338-312e032974b8 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:53.813051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf444f-1af2-47fd-a338-312e032974b8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:53.813644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf444f-1af2-47fd-a338-312e032974b8 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:53.816561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 140/302] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:53.823375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf444f-1af2-47fd-a338-312e032974b8 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:53.877413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ebe1f-d0ca-4bda-be48-cbceeaf15aeb None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:53.922955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff722-7396-4b4e-9c05-8aefe959e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:53.923927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff722-7396-4b4e-9c05-8aefe959e61e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:53.924462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff722-7396-4b4e-9c05-8aefe959e61e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:53.924952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff722-7396-4b4e-9c05-8aefe959e61e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:53.926406 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaff722-7396-4b4e-9c05-8aefe959e61e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:53.928088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaff722-7396-4b4e-9c05-8aefe959e61e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:53.930401 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 163/303] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:53.937489 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0401e-6b8d-4f8e-91d7-88aaf5175399 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:53.937933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0401e-6b8d-4f8e-91d7-88aaf5175399 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:53.938389 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0401e-6b8d-4f8e-91d7-88aaf5175399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:53.958306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-d7b0401e-6b8d-4f8e-91d7-88aaf5175399 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:53.959936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d7b0401e-6b8d-4f8e-91d7-88aaf5175399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:54.038247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf444f-1af2-47fd-a338-312e032974b8 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:54.067903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 164/304] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:54.069154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0401e-6b8d-4f8e-91d7-88aaf5175399 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:54.073280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:54.104698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc7342-a24f-469b-b9f0-5fe528eabf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:54.108786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7342-a24f-469b-b9f0-5fe528eabf2a None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:54.110625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7342-a24f-469b-b9f0-5fe528eabf2a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:54.111747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7342-a24f-469b-b9f0-5fe528eabf2a None admin] PATH_INFO: `/v3/system/users/1be35faa29f64c5fb395d267421f3e59/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:54.114535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc7342-a24f-469b-b9f0-5fe528eabf2a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1be35faa29f64c5fb395d267421f3e59, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:54.116964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc7342-a24f-469b-b9f0-5fe528eabf2a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:54.119988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:54.224626 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0401e-6b8d-4f8e-91d7-88aaf5175399 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:54.237324 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 141/305] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Jul 20 17:35:53 2022] PUT /identity/v3/system/users/1be35faa29f64c5fb395d267421f3e59/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:35:54.238392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc7342-a24f-469b-b9f0-5fe528eabf2a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:54.289708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baa3be-b26a-4263-9903-b2b3bc7e0490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:54.291269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baa3be-b26a-4263-9903-b2b3bc7e0490 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:54.291557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baa3be-b26a-4263-9903-b2b3bc7e0490 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:54.292720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baa3be-b26a-4263-9903-b2b3bc7e0490 None admin] PATH_INFO: `/v3/groups` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:54.292720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baa3be-b26a-4263-9903-b2b3bc7e0490 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:54.294078 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baa3be-b26a-4263-9903-b2b3bc7e0490 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:54.416719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc7342-a24f-469b-b9f0-5fe528eabf2a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:54.452607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 165/306] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Jul 20 17:35:54 2022] POST /identity/v3/groups => generated 229 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:54.454239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6265a1e-6900-4f13-848f-88db2c3b169c None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:54.454541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6265a1e-6900-4f13-848f-88db2c3b169c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:54.454887 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6265a1e-6900-4f13-848f-88db2c3b169c None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:54.456536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 166/307] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:54.467412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a05df-1b6a-45f2-982a-a93817fbc123 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:54.467864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a05df-1b6a-45f2-982a-a93817fbc123 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:54.468332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a05df-1b6a-45f2-982a-a93817fbc123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:54.477765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb1e2b-350d-4cd4-acd0-cd81b6bf8dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:54.480569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb1e2b-350d-4cd4-acd0-cd81b6bf8dc2 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:54.481057 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb1e2b-350d-4cd4-acd0-cd81b6bf8dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:54.481551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb1e2b-350d-4cd4-acd0-cd81b6bf8dc2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:54.491545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ad1a05df-1b6a-45f2-982a-a93817fbc123 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:54.493230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ad1a05df-1b6a-45f2-982a-a93817fbc123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:54.506493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb1e2b-350d-4cd4-acd0-cd81b6bf8dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-92cb1e2b-350d-4cd4-acd0-cd81b6bf8dc2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:54.517235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:54.519036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:54.525424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 142/308] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:54.532433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb1e2b-350d-4cd4-acd0-cd81b6bf8dc2 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:54.612346 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:54.658599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 167/309] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:35:54.700145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb1e2b-350d-4cd4-acd0-cd81b6bf8dc2 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:54.701712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a05df-1b6a-45f2-982a-a93817fbc123 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:54.734642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:54.749067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9db30-b37f-4080-8f4e-fbc12c83ab9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:54.749757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9db30-b37f-4080-8f4e-fbc12c83ab9c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:54.750044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9db30-b37f-4080-8f4e-fbc12c83ab9c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:54.750330 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9db30-b37f-4080-8f4e-fbc12c83ab9c None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:54.754499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9db30-b37f-4080-8f4e-fbc12c83ab9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:54.754499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9db30-b37f-4080-8f4e-fbc12c83ab9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:54.754499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9db30-b37f-4080-8f4e-fbc12c83ab9c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:54.763518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 143/310] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:54.769517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9db30-b37f-4080-8f4e-fbc12c83ab9c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:54.895252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a05df-1b6a-45f2-982a-a93817fbc123 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:54.905221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9db30-b37f-4080-8f4e-fbc12c83ab9c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:54.921019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:54.950978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c2b85-20ee-4166-a07b-400fa123d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:54.951251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c2b85-20ee-4166-a07b-400fa123d6c4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:54.951538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c2b85-20ee-4166-a07b-400fa123d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:54.952632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c2b85-20ee-4166-a07b-400fa123d6c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:54.975595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c2b85-20ee-4166-a07b-400fa123d6c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:54.985036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f1ad1-a4b1-4be2-af1a-74d2d6b5ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:54.987159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f1ad1-a4b1-4be2-af1a-74d2d6b5ebb2 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:54.988028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f1ad1-a4b1-4be2-af1a-74d2d6b5ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:54.988935 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f1ad1-a4b1-4be2-af1a-74d2d6b5ebb2 None admin] PATH_INFO: `/v3/users/d74b8d5ded124679810ab53def15513d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-953c2b85-20ee-4166-a07b-400fa123d6c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:54.993236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:54.995034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:54.996660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:54.996660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:54.996660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:54.996660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:54.996660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:54.996660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:54.996660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:54.996660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:54.996660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:54.996660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:54.996660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:54.996660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:54.999778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 168/311] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:35:55.006282 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c2b85-20ee-4166-a07b-400fa123d6c4 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:55.028401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f1ad1-a4b1-4be2-af1a-74d2d6b5ebb2 None admin] RBAC: Authorizing `identity:get_user(user_id=d74b8d5ded124679810ab53def15513d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:55.032708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f1ad1-a4b1-4be2-af1a-74d2d6b5ebb2 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:55.037594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 144/312] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:54 2022] GET /identity/v3/users/d74b8d5ded124679810ab53def15513d => generated 293 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:55.047734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f1ad1-a4b1-4be2-af1a-74d2d6b5ebb2 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:55.167954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:55.221204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c2b85-20ee-4166-a07b-400fa123d6c4 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:55.267231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f1ad1-a4b1-4be2-af1a-74d2d6b5ebb2 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:55.296836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdaec6-2841-45ec-9473-cbabccb5bb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:55.298460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdaec6-2841-45ec-9473-cbabccb5bb91 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:55.299166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdaec6-2841-45ec-9473-cbabccb5bb91 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:55.300083 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdaec6-2841-45ec-9473-cbabccb5bb91 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:55.301858 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdaec6-2841-45ec-9473-cbabccb5bb91 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:55.302705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdaec6-2841-45ec-9473-cbabccb5bb91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:55.306004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdaec6-2841-45ec-9473-cbabccb5bb91 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:55.327326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 169/313] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:55.335663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdaec6-2841-45ec-9473-cbabccb5bb91 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:55.341493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785684f7-522d-43de-a338-2a654d3d5efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:55.342956 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785684f7-522d-43de-a338-2a654d3d5efa None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:55.343687 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785684f7-522d-43de-a338-2a654d3d5efa None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:55.344415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785684f7-522d-43de-a338-2a654d3d5efa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:55.346325 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785684f7-522d-43de-a338-2a654d3d5efa None admin] RBAC: Adding query filter params (role.id=6ea42ab173de4304986be223ef0dcb2c, user.id=d74b8d5ded124679810ab53def15513d, scope.system=all) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:55.347119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785684f7-522d-43de-a338-2a654d3d5efa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:55.349997 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785684f7-522d-43de-a338-2a654d3d5efa None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:55.359966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 145/314] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Jul 20 17:35:55 2022] GET /identity/v3/role_assignments?user.id=d74b8d5ded124679810ab53def15513d&scope.system=all&role.id=6ea42ab173de4304986be223ef0dcb2c => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:55.534826 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdaec6-2841-45ec-9473-cbabccb5bb91 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:55.606155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590e834-dd4b-4eab-978e-8d553fb3cbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:55.607765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590e834-dd4b-4eab-978e-8d553fb3cbe4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:55.608251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590e834-dd4b-4eab-978e-8d553fb3cbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:55.608765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590e834-dd4b-4eab-978e-8d553fb3cbe4 None admin] PATH_INFO: `/v3/users/8d947e4de98347ebadc9652105ff1321` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:55.611259 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590e834-dd4b-4eab-978e-8d553fb3cbe4 None admin] RBAC: Authorizing `identity:get_user(user_id=8d947e4de98347ebadc9652105ff1321)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:55.614185 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590e834-dd4b-4eab-978e-8d553fb3cbe4 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:55.617805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 170/315] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:55 2022] GET /identity/v3/users/8d947e4de98347ebadc9652105ff1321 => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:55.627267 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785684f7-522d-43de-a338-2a654d3d5efa None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:55.680620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:55.839650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785684f7-522d-43de-a338-2a654d3d5efa None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:55.906359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c88bf-0198-47b5-8889-505861f71065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:55.907463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c88bf-0198-47b5-8889-505861f71065 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:55.907966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c88bf-0198-47b5-8889-505861f71065 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:55.908465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c88bf-0198-47b5-8889-505861f71065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:56.052147 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c88bf-0198-47b5-8889-505861f71065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:56.054940 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c88bf-0198-47b5-8889-505861f71065 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:56.107625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:56.244633 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 146/316] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:35:56.249596 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590e834-dd4b-4eab-978e-8d553fb3cbe4 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:56.257015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:56.451225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590e834-dd4b-4eab-978e-8d553fb3cbe4 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:56.514206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93c874-2666-4683-b0e9-a4511e0a7747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:56.515736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93c874-2666-4683-b0e9-a4511e0a7747 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:56.516219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93c874-2666-4683-b0e9-a4511e0a7747 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:56.516734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93c874-2666-4683-b0e9-a4511e0a7747 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:56.518961 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93c874-2666-4683-b0e9-a4511e0a7747 None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:56.521746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93c874-2666-4683-b0e9-a4511e0a7747 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:56.524965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 171/317] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:35:56 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:56.538332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c88bf-0198-47b5-8889-505861f71065 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:56.612717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e635a5c-ebe5-4073-9c39-761e7cffa9ad None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:56.613342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e635a5c-ebe5-4073-9c39-761e7cffa9ad None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:56.615162 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e635a5c-ebe5-4073-9c39-761e7cffa9ad None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:56.622948 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 172/318] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:56 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:35:56.629218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727c8fc-64fa-45c2-8310-ab66efa37aeb None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:56.629888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727c8fc-64fa-45c2-8310-ab66efa37aeb None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:56.630529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727c8fc-64fa-45c2-8310-ab66efa37aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:56.659568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-9727c8fc-64fa-45c2-8310-ab66efa37aeb None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:56.661777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9727c8fc-64fa-45c2-8310-ab66efa37aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:56.693882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c88bf-0198-47b5-8889-505861f71065 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:56.720437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:56.738392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86811fcd-fb89-42b4-85dc-e9ba721d2803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:56.744913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86811fcd-fb89-42b4-85dc-e9ba721d2803 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:56.744913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86811fcd-fb89-42b4-85dc-e9ba721d2803 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:56.744913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86811fcd-fb89-42b4-85dc-e9ba721d2803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:56.744913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86811fcd-fb89-42b4-85dc-e9ba721d2803 None admin] RBAC: Adding query filter params (role.id=6ea42ab173de4304986be223ef0dcb2c, scope.project.id=b19baba10ae34863868739f9da315ab6, user.id=8d947e4de98347ebadc9652105ff1321) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:56.745376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86811fcd-fb89-42b4-85dc-e9ba721d2803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:56.748904 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86811fcd-fb89-42b4-85dc-e9ba721d2803 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:56.768657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 147/319] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:35:56 2022] GET /identity/v3/role_assignments?user.id=8d947e4de98347ebadc9652105ff1321&scope.project.id=b19baba10ae34863868739f9da315ab6&role.id=6ea42ab173de4304986be223ef0dcb2c => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:56.778521 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 173/320] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:56.803827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86811fcd-fb89-42b4-85dc-e9ba721d2803 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:56.929288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86811fcd-fb89-42b4-85dc-e9ba721d2803 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:56.971206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c78b7-cf02-43da-8ef1-0e5b58328e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:56.972281 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c78b7-cf02-43da-8ef1-0e5b58328e7c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:56.972742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c78b7-cf02-43da-8ef1-0e5b58328e7c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:56.973181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c78b7-cf02-43da-8ef1-0e5b58328e7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:56.986759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c78b7-cf02-43da-8ef1-0e5b58328e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-819c78b7-cf02-43da-8ef1-0e5b58328e7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:56.995194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:56.996256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:56.997305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:56.997305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:56.997305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:56.997305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:56.997305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:56.997305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:56.997305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:56.997305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:56.997305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:56.997305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:56.997305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:35:56.997305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:35:56.999712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 148/321] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:35:57.006384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727c8fc-64fa-45c2-8310-ab66efa37aeb None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:57.009827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:57.184627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727c8fc-64fa-45c2-8310-ab66efa37aeb None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:57.246231 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2638a-9235-45d8-848a-b50300b2f884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:57.247360 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2638a-9235-45d8-848a-b50300b2f884 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:57.247795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2638a-9235-45d8-848a-b50300b2f884 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:57.248226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2638a-9235-45d8-848a-b50300b2f884 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:57.249513 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2638a-9235-45d8-848a-b50300b2f884 None admin] RBAC: Adding query filter params (name=member) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:57.250002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2638a-9235-45d8-848a-b50300b2f884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:57.252360 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2638a-9235-45d8-848a-b50300b2f884 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:57.272451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 174/322] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:57.274109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c78b7-cf02-43da-8ef1-0e5b58328e7c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:57.363636 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:57.466715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c78b7-cf02-43da-8ef1-0e5b58328e7c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:57.536511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b222d7-4a50-4e2f-8de0-4a695ff87435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:57.538648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b222d7-4a50-4e2f-8de0-4a695ff87435 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:57.540400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b222d7-4a50-4e2f-8de0-4a695ff87435 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:57.541141 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b222d7-4a50-4e2f-8de0-4a695ff87435 None admin] PATH_INFO: `/v3/users/1be35faa29f64c5fb395d267421f3e59` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:57.543864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b222d7-4a50-4e2f-8de0-4a695ff87435 None admin] RBAC: Authorizing `identity:get_user(user_id=1be35faa29f64c5fb395d267421f3e59)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:57.547100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b222d7-4a50-4e2f-8de0-4a695ff87435 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:57.556520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 149/323] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:57 2022] GET /identity/v3/users/1be35faa29f64c5fb395d267421f3e59 => generated 293 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:57.561556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2638a-9235-45d8-848a-b50300b2f884 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:57.666846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a1bcb-b006-4d38-9ff7-bab3e9e247c8 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:57.667222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a1bcb-b006-4d38-9ff7-bab3e9e247c8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:57.667497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a1bcb-b006-4d38-9ff7-bab3e9e247c8 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:57.669032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 150/324] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:35:57.674287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cdf44-4db2-4586-b72a-f2b2b4d5da16 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:57.674619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cdf44-4db2-4586-b72a-f2b2b4d5da16 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:57.675328 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cdf44-4db2-4586-b72a-f2b2b4d5da16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:57.690015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:57.693219 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-222cdf44-4db2-4586-b72a-f2b2b4d5da16 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:57.694421 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-222cdf44-4db2-4586-b72a-f2b2b4d5da16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:57.763371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2638a-9235-45d8-848a-b50300b2f884 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:57.810871 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 151/325] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:57.822209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5398ad-4cbe-41b9-9905-4da67c2057b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:57.823609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5398ad-4cbe-41b9-9905-4da67c2057b8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:57.824104 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5398ad-4cbe-41b9-9905-4da67c2057b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:57.824625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5398ad-4cbe-41b9-9905-4da67c2057b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:57.826261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5398ad-4cbe-41b9-9905-4da67c2057b8 None admin] RBAC: Adding query filter params (role.id=0f0e06be5d684398a453fa6312e57d41, user.id=1be35faa29f64c5fb395d267421f3e59, scope.system=all) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:57.826820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5398ad-4cbe-41b9-9905-4da67c2057b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:57.829591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5398ad-4cbe-41b9-9905-4da67c2057b8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:57.847345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cdf44-4db2-4586-b72a-f2b2b4d5da16 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:57.850717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 175/326] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Jul 20 17:35:57 2022] GET /identity/v3/role_assignments?user.id=1be35faa29f64c5fb395d267421f3e59&scope.system=all&role.id=0f0e06be5d684398a453fa6312e57d41 => generated 510 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:57.952439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:58.066123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cdf44-4db2-4586-b72a-f2b2b4d5da16 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:58.129727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f01b4-918f-493b-b0d8-e239e313b400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:58.131084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f01b4-918f-493b-b0d8-e239e313b400 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:58.131574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f01b4-918f-493b-b0d8-e239e313b400 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:58.132079 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f01b4-918f-493b-b0d8-e239e313b400 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:58.134219 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f01b4-918f-493b-b0d8-e239e313b400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:58.137469 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f01b4-918f-493b-b0d8-e239e313b400 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:58.140779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 152/327] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:35:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:35:58.149836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5398ad-4cbe-41b9-9905-4da67c2057b8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:58.319899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5398ad-4cbe-41b9-9905-4da67c2057b8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:58.347433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:58.349299 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af3c8-bb3d-413b-bf0e-e4263889a54f None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:58.349797 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af3c8-bb3d-413b-bf0e-e4263889a54f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:58.350288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af3c8-bb3d-413b-bf0e-e4263889a54f None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:58.353083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 153/328] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:35:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:35:58.359984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8264a-bc97-4369-82e3-48af6d8e80a2 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:58.360467 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8264a-bc97-4369-82e3-48af6d8e80a2 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:58.360981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8264a-bc97-4369-82e3-48af6d8e80a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:58.361873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490aa5d-4440-4a66-a5d8-efd226927251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:58.362084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490aa5d-4440-4a66-a5d8-efd226927251 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:58.362422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490aa5d-4440-4a66-a5d8-efd226927251 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:58.362755 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490aa5d-4440-4a66-a5d8-efd226927251 None admin] PATH_INFO: `/v3/groups` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:58.363524 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490aa5d-4440-4a66-a5d8-efd226927251 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:58.365230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490aa5d-4440-4a66-a5d8-efd226927251 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:58.389781 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-0ae8264a-bc97-4369-82e3-48af6d8e80a2 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:35:58.391832 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0ae8264a-bc97-4369-82e3-48af6d8e80a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:35:58.460810 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 176/329] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Jul 20 17:35:58 2022] POST /identity/v3/groups => generated 226 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:35:58.524990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 154/330] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:35:58.550610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490aa5d-4440-4a66-a5d8-efd226927251 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:58.721025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490aa5d-4440-4a66-a5d8-efd226927251 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:58.766761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13e1a5-dfc5-40f0-b24b-cff311a1cced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:58.768190 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13e1a5-dfc5-40f0-b24b-cff311a1cced None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:58.768735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13e1a5-dfc5-40f0-b24b-cff311a1cced None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:58.769215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13e1a5-dfc5-40f0-b24b-cff311a1cced None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:58.788108 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13e1a5-dfc5-40f0-b24b-cff311a1cced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-7c13e1a5-dfc5-40f0-b24b-cff311a1cced None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:35:58.802010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:35:58.802959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:35:58.803747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:35:58.803747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:35:58.803747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:35:58.803747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:35:58.803747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:35:58.803747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:35:58.803747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:35:58.803747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:35:58.803747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:35:58.803747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:35:58.803747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:35:58.803747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:35:58.804944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 177/331] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:35:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:35:58.814578 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8264a-bc97-4369-82e3-48af6d8e80a2 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:58.905586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:58.971943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8264a-bc97-4369-82e3-48af6d8e80a2 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:59.014629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528592e9-3a06-4d23-976c-6e0a16d05283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:59.015316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528592e9-3a06-4d23-976c-6e0a16d05283 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:59.015601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528592e9-3a06-4d23-976c-6e0a16d05283 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:59.015879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528592e9-3a06-4d23-976c-6e0a16d05283 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:59.016679 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528592e9-3a06-4d23-976c-6e0a16d05283 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:35:59.016991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528592e9-3a06-4d23-976c-6e0a16d05283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:59.018450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528592e9-3a06-4d23-976c-6e0a16d05283 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:59.029751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 155/332] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:35:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:59.035256 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13e1a5-dfc5-40f0-b24b-cff311a1cced None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:59.101032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:59.174414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13e1a5-dfc5-40f0-b24b-cff311a1cced None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:59.217642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b286f4-599f-4870-b41f-fbd8d4652daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:59.218546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b286f4-599f-4870-b41f-fbd8d4652daa None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:59.218826 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b286f4-599f-4870-b41f-fbd8d4652daa None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:59.219098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b286f4-599f-4870-b41f-fbd8d4652daa None admin] PATH_INFO: `/v3/users/d74b8d5ded124679810ab53def15513d` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:59.220336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b286f4-599f-4870-b41f-fbd8d4652daa None admin] RBAC: Authorizing `identity:get_user(user_id=d74b8d5ded124679810ab53def15513d)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:59.221835 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b286f4-599f-4870-b41f-fbd8d4652daa None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:59.226165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 178/333] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:35:59 2022] GET /identity/v3/users/d74b8d5ded124679810ab53def15513d => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:35:59.230981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528592e9-3a06-4d23-976c-6e0a16d05283 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:35:59.379494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528592e9-3a06-4d23-976c-6e0a16d05283 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:35:59.389343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:35:59.437305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1073f-683f-4d72-b154-72d3e8def175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:35:59.438181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1073f-683f-4d72-b154-72d3e8def175 None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:35:59.438461 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1073f-683f-4d72-b154-72d3e8def175 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:35:59.438736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1073f-683f-4d72-b154-72d3e8def175 None admin] PATH_INFO: `/v3/system/users/d74b8d5ded124679810ab53def15513d/roles/6ea42ab173de4304986be223ef0dcb2c` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:35:59.440985 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1073f-683f-4d72-b154-72d3e8def175 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d74b8d5ded124679810ab53def15513d, role_id=6ea42ab173de4304986be223ef0dcb2c)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:35:59.442396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1073f-683f-4d72-b154-72d3e8def175 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:35:59.517842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 156/334] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Jul 20 17:35:59 2022] PUT /identity/v3/system/users/d74b8d5ded124679810ab53def15513d/roles/6ea42ab173de4304986be223ef0dcb2c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:36:01.023216 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9154449-fbfe-4d8b-946d-b746c3c92523 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:01.024642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9154449-fbfe-4d8b-946d-b746c3c92523 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:01.025464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9154449-fbfe-4d8b-946d-b746c3c92523 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:01.029158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 179/335] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:01.035509 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167ddd6-96d4-4251-9ebe-5c4b8a1aaa54 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:01.036514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167ddd6-96d4-4251-9ebe-5c4b8a1aaa54 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:01.037008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167ddd6-96d4-4251-9ebe-5c4b8a1aaa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:01.061995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-3167ddd6-96d4-4251-9ebe-5c4b8a1aaa54 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:01.063671 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3167ddd6-96d4-4251-9ebe-5c4b8a1aaa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:01.152447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 157/336] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:01.199052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9154449-fbfe-4d8b-946d-b746c3c92523 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:01.380654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdd064-8f8f-4865-ae55-5fc375a364b0 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:01.381321 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdd064-8f8f-4865-ae55-5fc375a364b0 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:01.381834 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdd064-8f8f-4865-ae55-5fc375a364b0 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:01.383793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 158/337] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:01.389734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff95e7-01e4-4008-9de3-a37309877477 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:01.390446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff95e7-01e4-4008-9de3-a37309877477 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:01.390923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff95e7-01e4-4008-9de3-a37309877477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:01.404656 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9154449-fbfe-4d8b-946d-b746c3c92523 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:01.428570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-40ff95e7-01e4-4008-9de3-a37309877477 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:01.430125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-40ff95e7-01e4-4008-9de3-a37309877477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:01.432844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:01.473380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980a2ac-7a05-4cf2-9f54-801825bd6dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:01.474222 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980a2ac-7a05-4cf2-9f54-801825bd6dcf None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:01.474498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980a2ac-7a05-4cf2-9f54-801825bd6dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:01.474775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980a2ac-7a05-4cf2-9f54-801825bd6dcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:01.505728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980a2ac-7a05-4cf2-9f54-801825bd6dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-4980a2ac-7a05-4cf2-9f54-801825bd6dcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:01.515833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:01.516816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:01.517628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:01.517628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:01.517628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:01.517628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:01.517628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:01.517628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:01.517628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:01.517628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:01.517628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:01.517628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:01.517628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:01.517628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:01.522640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 180/338] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:36:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:01.529146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980a2ac-7a05-4cf2-9f54-801825bd6dcf None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:01.627556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 159/339] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:01.708061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff95e7-01e4-4008-9de3-a37309877477 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:01.739056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980a2ac-7a05-4cf2-9f54-801825bd6dcf None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:01.778558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:01.814817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce184ca-9d30-4ca1-a65a-4b39c81ba99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:01.815885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce184ca-9d30-4ca1-a65a-4b39c81ba99a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:01.816372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce184ca-9d30-4ca1-a65a-4b39c81ba99a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:01.816902 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce184ca-9d30-4ca1-a65a-4b39c81ba99a None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:01.817930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce184ca-9d30-4ca1-a65a-4b39c81ba99a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:01.818477 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce184ca-9d30-4ca1-a65a-4b39c81ba99a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:01.823791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce184ca-9d30-4ca1-a65a-4b39c81ba99a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:01.842044 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 181/340] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:01.848415 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce184ca-9d30-4ca1-a65a-4b39c81ba99a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:01.925620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:01.950937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff95e7-01e4-4008-9de3-a37309877477 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:02.047380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381d156-f54b-425a-a49f-043de3a60bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:02.050229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381d156-f54b-425a-a49f-043de3a60bf5 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:02.050987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381d156-f54b-425a-a49f-043de3a60bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:02.051991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381d156-f54b-425a-a49f-043de3a60bf5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:02.081538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381d156-f54b-425a-a49f-043de3a60bf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-8381d156-f54b-425a-a49f-043de3a60bf5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:02.100117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:02.102169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:02.104441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:02.104441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:02.104441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:02.104441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:02.104441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:02.104441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:02.104441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:02.104441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:02.104441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:02.104441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:02.104441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:36:02.104441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:02.113232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 160/341] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:02.116368 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf7dae-f007-48af-9b9a-f2445825cba2 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:02.117181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf7dae-f007-48af-9b9a-f2445825cba2 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:02.117872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf7dae-f007-48af-9b9a-f2445825cba2 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:02.128517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 161/342] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:02.130889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf7dae-f007-48af-9b9a-f2445825cba2 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:02.138706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce184ca-9d30-4ca1-a65a-4b39c81ba99a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:02.253985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4219d5-1d89-464f-9997-ded483c4928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:02.254789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4219d5-1d89-464f-9997-ded483c4928f None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:02.255150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4219d5-1d89-464f-9997-ded483c4928f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:02.255505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4219d5-1d89-464f-9997-ded483c4928f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:02.401605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:02.421311 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf7dae-f007-48af-9b9a-f2445825cba2 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:02.485481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4219d5-1d89-464f-9997-ded483c4928f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:02.488280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4219d5-1d89-464f-9997-ded483c4928f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:02.545424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245b9cd-6bbe-48d2-895c-867363d42a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:02.546445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245b9cd-6bbe-48d2-895c-867363d42a6f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:02.547168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245b9cd-6bbe-48d2-895c-867363d42a6f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:02.547592 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245b9cd-6bbe-48d2-895c-867363d42a6f None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:02.548577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245b9cd-6bbe-48d2-895c-867363d42a6f None admin] RBAC: Adding query filter params (name=member) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:02.549109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245b9cd-6bbe-48d2-895c-867363d42a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:02.550937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245b9cd-6bbe-48d2-895c-867363d42a6f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:02.566964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 162/343] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:36:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:02.569953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea523b11-1c49-422f-8ecd-d31d761c3194 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:02.570811 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea523b11-1c49-422f-8ecd-d31d761c3194 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:02.571681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea523b11-1c49-422f-8ecd-d31d761c3194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:02.572735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:02.605111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-ea523b11-1c49-422f-8ecd-d31d761c3194 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:02.607840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ea523b11-1c49-422f-8ecd-d31d761c3194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:02.738450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 182/344] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 890 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:02.739249 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4219d5-1d89-464f-9997-ded483c4928f None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:02.775825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 163/345] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:02.777253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea523b11-1c49-422f-8ecd-d31d761c3194 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:02.954898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4219d5-1d89-464f-9997-ded483c4928f None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:02.962471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:03.011380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:03.011828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea523b11-1c49-422f-8ecd-d31d761c3194 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:03.022785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4a128-1526-4b08-bce0-67a9068e4f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:03.025344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4a128-1526-4b08-bce0-67a9068e4f61 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:03.026632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4a128-1526-4b08-bce0-67a9068e4f61 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:03.027275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4a128-1526-4b08-bce0-67a9068e4f61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:03.099738 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689b858-2d2d-4461-81e9-8ae7c9650531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:03.102326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689b858-2d2d-4461-81e9-8ae7c9650531 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:03.103144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689b858-2d2d-4461-81e9-8ae7c9650531 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:03.104833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689b858-2d2d-4461-81e9-8ae7c9650531 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:03.109002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689b858-2d2d-4461-81e9-8ae7c9650531 None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:03.112128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689b858-2d2d-4461-81e9-8ae7c9650531 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:03.115729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 164/346] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:02 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:03.119524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689b858-2d2d-4461-81e9-8ae7c9650531 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:03.157164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4a128-1526-4b08-bce0-67a9068e4f61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:03.159391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4a128-1526-4b08-bce0-67a9068e4f61 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:03.298721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689b858-2d2d-4461-81e9-8ae7c9650531 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:03.332562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 183/347] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:03.334351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42d64f-efab-4bf8-aed2-1a9fe25a42f6 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:03.334859 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42d64f-efab-4bf8-aed2-1a9fe25a42f6 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:03.335444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42d64f-efab-4bf8-aed2-1a9fe25a42f6 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:03.337319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 184/348] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:03.338557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42d64f-efab-4bf8-aed2-1a9fe25a42f6 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:03.349730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711b4ae-4438-4527-9415-212d47e9014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:03.350557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711b4ae-4438-4527-9415-212d47e9014c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:03.350865 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711b4ae-4438-4527-9415-212d47e9014c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:03.351105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711b4ae-4438-4527-9415-212d47e9014c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:03.375034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711b4ae-4438-4527-9415-212d47e9014c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:03.386497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-1711b4ae-4438-4527-9415-212d47e9014c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:03.394993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:03.396858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:03.398453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:03.398453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:03.398453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:03.398453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:03.398453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:03.398453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:03.398453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:03.398453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:03.398453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:03.398453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:03.398453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:36:03.398453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:03.402644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 165/349] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:03.405209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41dd6b-8ec8-4c79-8708-b493419b2579 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:03.405209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41dd6b-8ec8-4c79-8708-b493419b2579 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:03.405209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41dd6b-8ec8-4c79-8708-b493419b2579 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:03.406007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 166/350] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:03.417070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41dd6b-8ec8-4c79-8708-b493419b2579 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:03.428836 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:03.517930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42d64f-efab-4bf8-aed2-1a9fe25a42f6 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:03.579050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33229631-d2d9-4c29-bfd4-06c694c18df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:03.580299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33229631-d2d9-4c29-bfd4-06c694c18df0 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:03.580823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33229631-d2d9-4c29-bfd4-06c694c18df0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:03.581277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33229631-d2d9-4c29-bfd4-06c694c18df0 None admin] PATH_INFO: `/v3/groups/99edc607b47842d1b1a70ae32cd92c70` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:03.588735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33229631-d2d9-4c29-bfd4-06c694c18df0 None admin] RBAC: Authorizing `identity:get_group(group_id=99edc607b47842d1b1a70ae32cd92c70)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:03.590784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33229631-d2d9-4c29-bfd4-06c694c18df0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:03.593171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 185/351] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:03 2022] GET /identity/v3/groups/99edc607b47842d1b1a70ae32cd92c70 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:03.594792 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34915d56-82a4-4d5b-b955-f36a1735781f None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:03.595280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34915d56-82a4-4d5b-b955-f36a1735781f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:03.595768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34915d56-82a4-4d5b-b955-f36a1735781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:03.615806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41dd6b-8ec8-4c79-8708-b493419b2579 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:03.621334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-34915d56-82a4-4d5b-b955-f36a1735781f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:03.622388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-34915d56-82a4-4d5b-b955-f36a1735781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:03.662220 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af52da-1f10-413b-b55b-219f89e0e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:03.663476 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af52da-1f10-413b-b55b-219f89e0e51f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:03.663917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af52da-1f10-413b-b55b-219f89e0e51f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:03.664211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af52da-1f10-413b-b55b-219f89e0e51f None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:03.668256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af52da-1f10-413b-b55b-219f89e0e51f None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:03.670884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af52da-1f10-413b-b55b-219f89e0e51f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:03.673953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 167/352] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:03 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:03.675035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af52da-1f10-413b-b55b-219f89e0e51f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:03.716782 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 186/353] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:03.718605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8a65-ce84-475b-b049-b68d8552043b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:03.719102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8a65-ce84-475b-b049-b68d8552043b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:03.719563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8a65-ce84-475b-b049-b68d8552043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:03.739450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e9fe8a65-ce84-475b-b049-b68d8552043b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:03.740705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e9fe8a65-ce84-475b-b049-b68d8552043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:03.770943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:03.798663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:03.823705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af52da-1f10-413b-b55b-219f89e0e51f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:03.840771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 187/354] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:03.841580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe8a65-ce84-475b-b049-b68d8552043b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:03.887473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92c51e-29e2-4def-a3e9-4f5c457fb6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:03.888342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92c51e-29e2-4def-a3e9-4f5c457fb6a2 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:03.888801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92c51e-29e2-4def-a3e9-4f5c457fb6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:03.889270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92c51e-29e2-4def-a3e9-4f5c457fb6a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:03.890556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92c51e-29e2-4def-a3e9-4f5c457fb6a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:03.891041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92c51e-29e2-4def-a3e9-4f5c457fb6a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:03.893136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92c51e-29e2-4def-a3e9-4f5c457fb6a2 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:03.909877 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 168/355] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:36:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:03.911739 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf105c03-3473-46cf-a61b-a5c6197d869d None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:03.912086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf105c03-3473-46cf-a61b-a5c6197d869d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:03.912429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf105c03-3473-46cf-a61b-a5c6197d869d None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:03.914066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 169/356] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:03.914672 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf105c03-3473-46cf-a61b-a5c6197d869d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:03.991652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe8a65-ce84-475b-b049-b68d8552043b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:04.050113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f046815-50a6-43bb-9d11-d67df72a63b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:04.051026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f046815-50a6-43bb-9d11-d67df72a63b8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:04.051531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f046815-50a6-43bb-9d11-d67df72a63b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:04.052023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f046815-50a6-43bb-9d11-d67df72a63b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:04.054027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f046815-50a6-43bb-9d11-d67df72a63b8 None admin] RBAC: Adding query filter params (group.id=99edc607b47842d1b1a70ae32cd92c70, role.id=7c97532e07d14d4096b310fb69816951, scope.project.id=0d047530c703494197e4bf5f63aec8df) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:04.054268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f046815-50a6-43bb-9d11-d67df72a63b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:04.055910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f046815-50a6-43bb-9d11-d67df72a63b8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:04.062879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 188/357] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 20 17:36:03 2022] GET /identity/v3/role_assignments?group.id=99edc607b47842d1b1a70ae32cd92c70&scope.project.id=0d047530c703494197e4bf5f63aec8df&role.id=7c97532e07d14d4096b310fb69816951 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:04.063743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f046815-50a6-43bb-9d11-d67df72a63b8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:04.087925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf105c03-3473-46cf-a61b-a5c6197d869d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:04.118726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:04.143349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9044464-1b06-46f5-8cea-a889f242aa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:04.144721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9044464-1b06-46f5-8cea-a889f242aa65 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:04.145002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9044464-1b06-46f5-8cea-a889f242aa65 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:04.145275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9044464-1b06-46f5-8cea-a889f242aa65 None admin] PATH_INFO: `/v3/groups/99edc607b47842d1b1a70ae32cd92c70` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:04.146628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9044464-1b06-46f5-8cea-a889f242aa65 None admin] RBAC: Authorizing `identity:get_group(group_id=99edc607b47842d1b1a70ae32cd92c70)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:04.148846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9044464-1b06-46f5-8cea-a889f242aa65 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:04.153103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 170/358] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:03 2022] GET /identity/v3/groups/99edc607b47842d1b1a70ae32cd92c70 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:04.153103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9044464-1b06-46f5-8cea-a889f242aa65 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:04.169188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:04.269015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f046815-50a6-43bb-9d11-d67df72a63b8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:04.308864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9044464-1b06-46f5-8cea-a889f242aa65 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:04.334531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bbd03-e5fc-4402-a4c2-a312dd505eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:04.336008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bbd03-e5fc-4402-a4c2-a312dd505eb4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:04.339047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bbd03-e5fc-4402-a4c2-a312dd505eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:04.339047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bbd03-e5fc-4402-a4c2-a312dd505eb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:04.358326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bbd03-e5fc-4402-a4c2-a312dd505eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-f14bbd03-e5fc-4402-a4c2-a312dd505eb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:04.376097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:04.377853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:04.379460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:04.379460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:04.379460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:04.379460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:04.379460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:04.379460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:04.379460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:04.379460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:04.379460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:04.379460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:04.379460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:04.379460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:04.381545 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd9c73-dcd2-4edb-92ce-2902569ea2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:04.381545 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd9c73-dcd2-4edb-92ce-2902569ea2df None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:04.381545 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd9c73-dcd2-4edb-92ce-2902569ea2df None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:04.381545 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd9c73-dcd2-4edb-92ce-2902569ea2df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:04.382406 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 189/359] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:36:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:04.382406 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bbd03-e5fc-4402-a4c2-a312dd505eb4 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:04.415423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd9c73-dcd2-4edb-92ce-2902569ea2df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-eacd9c73-dcd2-4edb-92ce-2902569ea2df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:04.424395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:04.425542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:04.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 171/360] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:04.430207 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d851d-db54-4f42-a8e8-76922025fc6c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:04.430207 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d851d-db54-4f42-a8e8-76922025fc6c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:04.430207 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d851d-db54-4f42-a8e8-76922025fc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:04.449987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-322d851d-db54-4f42-a8e8-76922025fc6c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:04.451522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-322d851d-db54-4f42-a8e8-76922025fc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:04.520117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:04.543849 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bbd03-e5fc-4402-a4c2-a312dd505eb4 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:04.574092 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:04.585874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 172/361] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:04.587531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d851d-db54-4f42-a8e8-76922025fc6c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:04.589448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07278-1f6d-4941-bf87-fc94177bd75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:04.589448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07278-1f6d-4941-bf87-fc94177bd75e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:04.591510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07278-1f6d-4941-bf87-fc94177bd75e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:04.591510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07278-1f6d-4941-bf87-fc94177bd75e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:04.698632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07278-1f6d-4941-bf87-fc94177bd75e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:04.700879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07278-1f6d-4941-bf87-fc94177bd75e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:04.768691 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d851d-db54-4f42-a8e8-76922025fc6c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:04.821847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:04.832276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a84ddc-c445-4024-a34f-18daffe40875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:04.832276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a84ddc-c445-4024-a34f-18daffe40875 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:04.832621 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a84ddc-c445-4024-a34f-18daffe40875 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:04.832878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a84ddc-c445-4024-a34f-18daffe40875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:04.833727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a84ddc-c445-4024-a34f-18daffe40875 None admin] RBAC: Adding query filter params (group.id=99edc607b47842d1b1a70ae32cd92c70, role.id=0f0e06be5d684398a453fa6312e57d41, scope.project.id=0d047530c703494197e4bf5f63aec8df) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:04.834044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a84ddc-c445-4024-a34f-18daffe40875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:04.835555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a84ddc-c445-4024-a34f-18daffe40875 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:04.842208 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 173/362] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 20 17:36:04 2022] GET /identity/v3/role_assignments?group.id=99edc607b47842d1b1a70ae32cd92c70&scope.project.id=0d047530c703494197e4bf5f63aec8df&role.id=0f0e06be5d684398a453fa6312e57d41 => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:04.848432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a84ddc-c445-4024-a34f-18daffe40875 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:04.852209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 190/363] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:04.853265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07278-1f6d-4941-bf87-fc94177bd75e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:04.938570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:05.016503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07278-1f6d-4941-bf87-fc94177bd75e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:05.022172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a84ddc-c445-4024-a34f-18daffe40875 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:05.069366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6eb7-e15b-4d54-8e1f-bfeeffbf269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:05.069366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6eb7-e15b-4d54-8e1f-bfeeffbf269d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:05.069366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6eb7-e15b-4d54-8e1f-bfeeffbf269d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:05.069735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6eb7-e15b-4d54-8e1f-bfeeffbf269d None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:05.070407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b6eb7-e15b-4d54-8e1f-bfeeffbf269d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:05.071959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b6eb7-e15b-4d54-8e1f-bfeeffbf269d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:05.073591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b6eb7-e15b-4d54-8e1f-bfeeffbf269d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:05.085460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 191/364] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:36:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:05.086449 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6eb7-e15b-4d54-8e1f-bfeeffbf269d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:05.087808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3080bd-6c56-4e76-b456-2003f6ece791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:05.089680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3080bd-6c56-4e76-b456-2003f6ece791 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:05.090183 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3080bd-6c56-4e76-b456-2003f6ece791 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:05.090628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3080bd-6c56-4e76-b456-2003f6ece791 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:05.091595 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3080bd-6c56-4e76-b456-2003f6ece791 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:05.092084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3080bd-6c56-4e76-b456-2003f6ece791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:05.093773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3080bd-6c56-4e76-b456-2003f6ece791 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:05.103892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 174/365] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:05.109630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3080bd-6c56-4e76-b456-2003f6ece791 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:05.150587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:05.236365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6eb7-e15b-4d54-8e1f-bfeeffbf269d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:05.237003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3080bd-6c56-4e76-b456-2003f6ece791 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:05.285574 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5914326-16b3-440b-bcad-5572060dc476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:05.286334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5914326-16b3-440b-bcad-5572060dc476 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:05.286620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5914326-16b3-440b-bcad-5572060dc476 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:05.286896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5914326-16b3-440b-bcad-5572060dc476 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:05.292976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:05.298261 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718dd72-eb7e-4c63-bbc9-5fd10e3235b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:05.299853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718dd72-eb7e-4c63-bbc9-5fd10e3235b9 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:05.300290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718dd72-eb7e-4c63-bbc9-5fd10e3235b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:05.300761 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718dd72-eb7e-4c63-bbc9-5fd10e3235b9 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:05.302441 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5914326-16b3-440b-bcad-5572060dc476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:05.306664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718dd72-eb7e-4c63-bbc9-5fd10e3235b9 None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:05.306664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718dd72-eb7e-4c63-bbc9-5fd10e3235b9 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:05.308817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 175/366] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:05 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:05.310285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718dd72-eb7e-4c63-bbc9-5fd10e3235b9 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-c5914326-16b3-440b-bcad-5572060dc476 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:05.311271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:05.312157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:05.313004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 192/367] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:36:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:05.313655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5914326-16b3-440b-bcad-5572060dc476 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:05.473487 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5914326-16b3-440b-bcad-5572060dc476 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:05.477926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:05.505962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718dd72-eb7e-4c63-bbc9-5fd10e3235b9 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:05.522518 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc9cbb-d559-428b-987d-bf6a30d35682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:05.523628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc9cbb-d559-428b-987d-bf6a30d35682 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:05.524382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc9cbb-d559-428b-987d-bf6a30d35682 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:05.525008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc9cbb-d559-428b-987d-bf6a30d35682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:05.593807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352553d5-26e1-4bb1-8e70-0b105480a494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:05.595734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352553d5-26e1-4bb1-8e70-0b105480a494 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:05.596921 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352553d5-26e1-4bb1-8e70-0b105480a494 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:05.597205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352553d5-26e1-4bb1-8e70-0b105480a494 None admin] PATH_INFO: `/v3/users/d74b8d5ded124679810ab53def15513d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:05.600532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352553d5-26e1-4bb1-8e70-0b105480a494 None admin] RBAC: Authorizing `identity:get_user(user_id=d74b8d5ded124679810ab53def15513d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:05.603637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352553d5-26e1-4bb1-8e70-0b105480a494 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:05.606491 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 176/368] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:36:05 2022] GET /identity/v3/users/d74b8d5ded124679810ab53def15513d => generated 293 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:05.607329 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352553d5-26e1-4bb1-8e70-0b105480a494 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:05.665343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc9cbb-d559-428b-987d-bf6a30d35682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:05.669223 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc9cbb-d559-428b-987d-bf6a30d35682 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:05.685096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:05.743304 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352553d5-26e1-4bb1-8e70-0b105480a494 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:05.793241 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30db863-cbcc-48f5-a61e-07bd6197488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:05.794157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30db863-cbcc-48f5-a61e-07bd6197488e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:05.794440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30db863-cbcc-48f5-a61e-07bd6197488e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:05.795099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30db863-cbcc-48f5-a61e-07bd6197488e None admin] PATH_INFO: `/v3/groups/99edc607b47842d1b1a70ae32cd92c70` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:05.796796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30db863-cbcc-48f5-a61e-07bd6197488e None admin] RBAC: Authorizing `identity:get_group(group_id=99edc607b47842d1b1a70ae32cd92c70)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:05.798593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30db863-cbcc-48f5-a61e-07bd6197488e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:05.801270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 177/369] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:05 2022] GET /identity/v3/groups/99edc607b47842d1b1a70ae32cd92c70 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:05.802177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30db863-cbcc-48f5-a61e-07bd6197488e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:05.839071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 193/370] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:05.840518 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc9cbb-d559-428b-987d-bf6a30d35682 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:05.848058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:06.008305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30db863-cbcc-48f5-a61e-07bd6197488e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:06.037205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc9cbb-d559-428b-987d-bf6a30d35682 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:06.062561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:06.076814 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20915775-e6d0-4b17-afb8-dcc96d1304df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:06.077968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20915775-e6d0-4b17-afb8-dcc96d1304df None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:06.078509 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20915775-e6d0-4b17-afb8-dcc96d1304df None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:06.078957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20915775-e6d0-4b17-afb8-dcc96d1304df None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:06.080736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20915775-e6d0-4b17-afb8-dcc96d1304df None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:06.081247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20915775-e6d0-4b17-afb8-dcc96d1304df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:06.083798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20915775-e6d0-4b17-afb8-dcc96d1304df None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:06.099669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4075-75bc-4e4f-820e-933e43559dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:06.100642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4075-75bc-4e4f-820e-933e43559dbf None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:06.101094 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4075-75bc-4e4f-820e-933e43559dbf None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:06.101549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc4075-75bc-4e4f-820e-933e43559dbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:06.102408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 178/371] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:06.103894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20915775-e6d0-4b17-afb8-dcc96d1304df None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:06.104511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc4075-75bc-4e4f-820e-933e43559dbf None admin] RBAC: Adding query filter params (role.id=6ea42ab173de4304986be223ef0dcb2c, user.id=d74b8d5ded124679810ab53def15513d, scope.system=all) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:06.105280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc4075-75bc-4e4f-820e-933e43559dbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:06.107983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc4075-75bc-4e4f-820e-933e43559dbf None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:06.131470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 194/372] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Jul 20 17:36:05 2022] GET /identity/v3/role_assignments?user.id=d74b8d5ded124679810ab53def15513d&scope.system=all&role.id=6ea42ab173de4304986be223ef0dcb2c => generated 510 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:06.133062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4075-75bc-4e4f-820e-933e43559dbf None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:06.267423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:06.302681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20915775-e6d0-4b17-afb8-dcc96d1304df None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:06.348257 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc4075-75bc-4e4f-820e-933e43559dbf None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:06.372337 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49142f9-568c-4d04-b2e1-109398674256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:06.373389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49142f9-568c-4d04-b2e1-109398674256 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:06.373838 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49142f9-568c-4d04-b2e1-109398674256 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:06.374300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49142f9-568c-4d04-b2e1-109398674256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:06.375980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49142f9-568c-4d04-b2e1-109398674256 None admin] RBAC: Adding query filter params (group.id=99edc607b47842d1b1a70ae32cd92c70, role.id=0f0e06be5d684398a453fa6312e57d41, scope.project.id=b19baba10ae34863868739f9da315ab6) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:06.376514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49142f9-568c-4d04-b2e1-109398674256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:06.379398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49142f9-568c-4d04-b2e1-109398674256 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:06.408521 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 179/373] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 20 17:36:06 2022] GET /identity/v3/role_assignments?group.id=99edc607b47842d1b1a70ae32cd92c70&scope.project.id=b19baba10ae34863868739f9da315ab6&role.id=0f0e06be5d684398a453fa6312e57d41 => generated 260 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:06.408521 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49142f9-568c-4d04-b2e1-109398674256 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:06.450225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe9985-ae85-445b-944d-7f4974fd4c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:06.451655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe9985-ae85-445b-944d-7f4974fd4c8a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:06.452096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe9985-ae85-445b-944d-7f4974fd4c8a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:06.452572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe9985-ae85-445b-944d-7f4974fd4c8a None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:06.461523 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe9985-ae85-445b-944d-7f4974fd4c8a None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:06.463076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe9985-ae85-445b-944d-7f4974fd4c8a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:06.465095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 195/374] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:06 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:06.476602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe9985-ae85-445b-944d-7f4974fd4c8a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:06.512947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:06.599266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49142f9-568c-4d04-b2e1-109398674256 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:06.677496 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d419f11-2ce0-43b8-9bbf-43121e1f4031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:06.679391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d419f11-2ce0-43b8-9bbf-43121e1f4031 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:06.680038 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d419f11-2ce0-43b8-9bbf-43121e1f4031 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:06.680830 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d419f11-2ce0-43b8-9bbf-43121e1f4031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:06.817194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d419f11-2ce0-43b8-9bbf-43121e1f4031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:06.820353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d419f11-2ce0-43b8-9bbf-43121e1f4031 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:06.838991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe9985-ae85-445b-944d-7f4974fd4c8a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:06.923740 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:06.941080 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:06.960785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c82c80-ac01-4871-9d6b-fcd355fc464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:06.961963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c82c80-ac01-4871-9d6b-fcd355fc464b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:06.962466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c82c80-ac01-4871-9d6b-fcd355fc464b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:06.962889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c82c80-ac01-4871-9d6b-fcd355fc464b None admin] PATH_INFO: `/v3/groups/99edc607b47842d1b1a70ae32cd92c70` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:06.968622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c82c80-ac01-4871-9d6b-fcd355fc464b None admin] RBAC: Authorizing `identity:get_group(group_id=99edc607b47842d1b1a70ae32cd92c70)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:06.970727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c82c80-ac01-4871-9d6b-fcd355fc464b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:06.977020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 196/375] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:06 2022] GET /identity/v3/groups/99edc607b47842d1b1a70ae32cd92c70 => generated 226 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:06.993329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c82c80-ac01-4871-9d6b-fcd355fc464b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:07.043206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 180/376] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:07.052456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d419f11-2ce0-43b8-9bbf-43121e1f4031 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:07.270820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d419f11-2ce0-43b8-9bbf-43121e1f4031 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:07.303172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c82c80-ac01-4871-9d6b-fcd355fc464b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:07.347409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec12e3-e174-49e7-b35a-fad68e604e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:07.348366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec12e3-e174-49e7-b35a-fad68e604e4c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:07.349312 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec12e3-e174-49e7-b35a-fad68e604e4c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:07.349770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec12e3-e174-49e7-b35a-fad68e604e4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:07.350932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec12e3-e174-49e7-b35a-fad68e604e4c None admin] RBAC: Adding query filter params (group.id=99edc607b47842d1b1a70ae32cd92c70, role.id=7c97532e07d14d4096b310fb69816951, scope.project.id=b19baba10ae34863868739f9da315ab6) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:07.351469 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec12e3-e174-49e7-b35a-fad68e604e4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:07.353194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec12e3-e174-49e7-b35a-fad68e604e4c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:07.360563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 197/377] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 20 17:36:06 2022] GET /identity/v3/role_assignments?group.id=99edc607b47842d1b1a70ae32cd92c70&scope.project.id=b19baba10ae34863868739f9da315ab6&role.id=7c97532e07d14d4096b310fb69816951 => generated 260 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:07.389769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591cb33-cbff-4b9e-a97d-e738f029400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:07.391185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591cb33-cbff-4b9e-a97d-e738f029400a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:07.391619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591cb33-cbff-4b9e-a97d-e738f029400a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:07.392047 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591cb33-cbff-4b9e-a97d-e738f029400a None admin] PATH_INFO: `/v3/projects/8f637912c585421ea114b8fb6faea1e7` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:07.394303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591cb33-cbff-4b9e-a97d-e738f029400a None admin] RBAC: Authorizing `identity:get_project(project_id=8f637912c585421ea114b8fb6faea1e7)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:07.396855 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591cb33-cbff-4b9e-a97d-e738f029400a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:07.400170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 181/378] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:07 2022] GET /identity/v3/projects/8f637912c585421ea114b8fb6faea1e7 => generated 344 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:07.409941 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec12e3-e174-49e7-b35a-fad68e604e4c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:07.521123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:07.564499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec12e3-e174-49e7-b35a-fad68e604e4c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:07.624826 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e67569-0264-4124-ab14-7993b1e49028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:07.625754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e67569-0264-4124-ab14-7993b1e49028 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:07.626046 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e67569-0264-4124-ab14-7993b1e49028 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:07.626329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e67569-0264-4124-ab14-7993b1e49028 None admin] PATH_INFO: `/v3/groups/17c8a15aac894f8abf16d95decad9862` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:07.637031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e67569-0264-4124-ab14-7993b1e49028 None admin] RBAC: Authorizing `identity:get_group(group_id=17c8a15aac894f8abf16d95decad9862)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:07.638540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e67569-0264-4124-ab14-7993b1e49028 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:07.640757 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 198/379] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:07 2022] GET /identity/v3/groups/17c8a15aac894f8abf16d95decad9862 => generated 229 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:07.648206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591cb33-cbff-4b9e-a97d-e738f029400a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:07.721388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7358d8-1c72-442e-b9f0-e87e4d1bb3d8 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:07.721910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7358d8-1c72-442e-b9f0-e87e4d1bb3d8 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:07.722335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7358d8-1c72-442e-b9f0-e87e4d1bb3d8 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:07.723896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 199/380] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:07.730408 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d241a-b2bb-4f04-a83d-0b47492b7185 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:07.730921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d241a-b2bb-4f04-a83d-0b47492b7185 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:07.731344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d241a-b2bb-4f04-a83d-0b47492b7185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:07.733976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:07.789258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-705d241a-b2bb-4f04-a83d-0b47492b7185 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:07.791802 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-705d241a-b2bb-4f04-a83d-0b47492b7185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:07.961792 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 200/381] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:36:07.984287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591cb33-cbff-4b9e-a97d-e738f029400a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:07.998767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d241a-b2bb-4f04-a83d-0b47492b7185 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:08.090156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e52199-7c79-4952-9382-4a029ae8a5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:08.091582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e52199-7c79-4952-9382-4a029ae8a5fb None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:08.092274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e52199-7c79-4952-9382-4a029ae8a5fb None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:08.092981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e52199-7c79-4952-9382-4a029ae8a5fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:08.094759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e52199-7c79-4952-9382-4a029ae8a5fb None admin] RBAC: Adding query filter params (group.id=17c8a15aac894f8abf16d95decad9862, role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=8f637912c585421ea114b8fb6faea1e7) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:08.095505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e52199-7c79-4952-9382-4a029ae8a5fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:08.098114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e52199-7c79-4952-9382-4a029ae8a5fb None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:08.109575 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 182/382] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 20 17:36:07 2022] GET /identity/v3/role_assignments?group.id=17c8a15aac894f8abf16d95decad9862&scope.project.id=8f637912c585421ea114b8fb6faea1e7&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 260 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:08.112244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33940f7-ee86-4ea9-9016-24e9d83b0b44 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:08.112641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:08.112750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33940f7-ee86-4ea9-9016-24e9d83b0b44 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:08.113206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33940f7-ee86-4ea9-9016-24e9d83b0b44 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:08.116025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 183/383] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:08.122850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72944d-d8ae-41f8-969c-5f4c47802470 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:08.123418 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72944d-d8ae-41f8-969c-5f4c47802470 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:08.123857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72944d-d8ae-41f8-969c-5f4c47802470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:08.153597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-6d72944d-d8ae-41f8-969c-5f4c47802470 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:08.155181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6d72944d-d8ae-41f8-969c-5f4c47802470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:08.246966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d241a-b2bb-4f04-a83d-0b47492b7185 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:08.305103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393da8b-0e9a-4894-ab90-d1f3f6b7e8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:08.306178 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393da8b-0e9a-4894-ab90-d1f3f6b7e8ba None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:08.306636 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393da8b-0e9a-4894-ab90-d1f3f6b7e8ba None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:08.307053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393da8b-0e9a-4894-ab90-d1f3f6b7e8ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:08.314741 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 184/384] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:36:08.335152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393da8b-0e9a-4894-ab90-d1f3f6b7e8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:08.341325 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72944d-d8ae-41f8-969c-5f4c47802470 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-a393da8b-0e9a-4894-ab90-d1f3f6b7e8ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:08.343752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:08.345280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:08.346106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 201/385] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:36:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:08.355252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393da8b-0e9a-4894-ab90-d1f3f6b7e8ba None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:08.368733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:08.546111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72944d-d8ae-41f8-969c-5f4c47802470 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:08.562554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393da8b-0e9a-4894-ab90-d1f3f6b7e8ba None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:08.596979 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:08.626474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea1c02-b9f9-4cc7-9e7e-d51e21d5b1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:08.627305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1c02-b9f9-4cc7-9e7e-d51e21d5b1fd None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:08.627589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1c02-b9f9-4cc7-9e7e-d51e21d5b1fd None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:08.627888 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea1c02-b9f9-4cc7-9e7e-d51e21d5b1fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:08.634711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a0fce-e870-4dfd-8436-11a4c8a4ab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:08.635451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a0fce-e870-4dfd-8436-11a4c8a4ab49 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:08.635740 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a0fce-e870-4dfd-8436-11a4c8a4ab49 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:08.636015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a0fce-e870-4dfd-8436-11a4c8a4ab49 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:08.636891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a0fce-e870-4dfd-8436-11a4c8a4ab49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:08.637385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a0fce-e870-4dfd-8436-11a4c8a4ab49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:08.638976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a0fce-e870-4dfd-8436-11a4c8a4ab49 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:08.651728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea1c02-b9f9-4cc7-9e7e-d51e21d5b1fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:08.661759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 202/386] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:36:08.663527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a0fce-e870-4dfd-8436-11a4c8a4ab49 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-c0ea1c02-b9f9-4cc7-9e7e-d51e21d5b1fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:08.669204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:08.670164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:08.670948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:08.670948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:08.670948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:08.670948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:08.670948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:08.670948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:08.670948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:08.670948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:08.670948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:08.670948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:08.670948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:36:08.670948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:08.673342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 185/387] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:08.681136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea1c02-b9f9-4cc7-9e7e-d51e21d5b1fd None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:08.839000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:08.865816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea1c02-b9f9-4cc7-9e7e-d51e21d5b1fd None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:08.906559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf2ca6-5eb3-4989-91e4-deb943d23091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:08.909385 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf2ca6-5eb3-4989-91e4-deb943d23091 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:08.910591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf2ca6-5eb3-4989-91e4-deb943d23091 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:08.911640 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf2ca6-5eb3-4989-91e4-deb943d23091 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:08.912790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf2ca6-5eb3-4989-91e4-deb943d23091 None admin] RBAC: Adding query filter params (name=member) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:08.914790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a0fce-e870-4dfd-8436-11a4c8a4ab49 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:08.916053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf2ca6-5eb3-4989-91e4-deb943d23091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:08.919668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf2ca6-5eb3-4989-91e4-deb943d23091 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:08.936157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 186/388] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:36:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:08.941405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf2ca6-5eb3-4989-91e4-deb943d23091 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:08.999953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b454f-9c01-40c7-8026-6a7abe72a143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:09.001104 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b454f-9c01-40c7-8026-6a7abe72a143 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:09.002641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b454f-9c01-40c7-8026-6a7abe72a143 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:09.003177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b454f-9c01-40c7-8026-6a7abe72a143 None admin] PATH_INFO: `/v3/groups/99edc607b47842d1b1a70ae32cd92c70` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:09.007334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b454f-9c01-40c7-8026-6a7abe72a143 None admin] RBAC: Authorizing `identity:get_group(group_id=99edc607b47842d1b1a70ae32cd92c70)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:09.009033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b454f-9c01-40c7-8026-6a7abe72a143 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:09.016254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 203/389] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:08 2022] GET /identity/v3/groups/99edc607b47842d1b1a70ae32cd92c70 => generated 226 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:36:09.022182 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b454f-9c01-40c7-8026-6a7abe72a143 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:09.114289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf2ca6-5eb3-4989-91e4-deb943d23091 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:09.142748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:09.154740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea342f9c-e81a-4fe5-83ff-0cf630c465ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:09.155849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea342f9c-e81a-4fe5-83ff-0cf630c465ae None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:09.156267 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea342f9c-e81a-4fe5-83ff-0cf630c465ae None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:09.156976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea342f9c-e81a-4fe5-83ff-0cf630c465ae None admin] PATH_INFO: `/v3/groups/99edc607b47842d1b1a70ae32cd92c70` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:09.158353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea342f9c-e81a-4fe5-83ff-0cf630c465ae None admin] RBAC: Authorizing `identity:get_group(group_id=99edc607b47842d1b1a70ae32cd92c70)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:09.159951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea342f9c-e81a-4fe5-83ff-0cf630c465ae None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:09.162112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 187/390] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:08 2022] GET /identity/v3/groups/99edc607b47842d1b1a70ae32cd92c70 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:09.168131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea342f9c-e81a-4fe5-83ff-0cf630c465ae None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:09.179992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:09.297547 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b454f-9c01-40c7-8026-6a7abe72a143 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:09.341393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eac8f5-5f9f-48cc-9961-c6bc47881a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:09.342558 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eac8f5-5f9f-48cc-9961-c6bc47881a2b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:09.342998 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eac8f5-5f9f-48cc-9961-c6bc47881a2b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:09.343426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eac8f5-5f9f-48cc-9961-c6bc47881a2b None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:09.345043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eac8f5-5f9f-48cc-9961-c6bc47881a2b None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:09.346781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eac8f5-5f9f-48cc-9961-c6bc47881a2b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:09.349180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 204/391] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:09 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:36:09.362383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eac8f5-5f9f-48cc-9961-c6bc47881a2b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:09.368659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea342f9c-e81a-4fe5-83ff-0cf630c465ae None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:09.473192 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e604e60-c83c-4d05-91db-96c67c103021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:09.475278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e604e60-c83c-4d05-91db-96c67c103021 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:09.476070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e604e60-c83c-4d05-91db-96c67c103021 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:09.476857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e604e60-c83c-4d05-91db-96c67c103021 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:09.481519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e604e60-c83c-4d05-91db-96c67c103021 None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:09.486819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e604e60-c83c-4d05-91db-96c67c103021 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:09.492800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 188/392] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:09 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:09.497849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406d882-4baa-4e34-8262-fa7b844cd410 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:09.499015 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406d882-4baa-4e34-8262-fa7b844cd410 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:09.500812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406d882-4baa-4e34-8262-fa7b844cd410 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:09.505747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 189/393] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:09.507749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406d882-4baa-4e34-8262-fa7b844cd410 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:09.564262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eac8f5-5f9f-48cc-9961-c6bc47881a2b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:09.584544 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:09.614820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12754e-b809-494f-b6c3-16ae09746ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:09.616192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12754e-b809-494f-b6c3-16ae09746ce8 None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:09.616703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12754e-b809-494f-b6c3-16ae09746ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:09.617205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12754e-b809-494f-b6c3-16ae09746ce8 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df/groups/99edc607b47842d1b1a70ae32cd92c70/roles/7c97532e07d14d4096b310fb69816951` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:09.619176 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:09.622357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12754e-b809-494f-b6c3-16ae09746ce8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d047530c703494197e4bf5f63aec8df, group_id=99edc607b47842d1b1a70ae32cd92c70, role_id=7c97532e07d14d4096b310fb69816951)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:09.625881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12754e-b809-494f-b6c3-16ae09746ce8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:09.649941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406d882-4baa-4e34-8262-fa7b844cd410 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:09.688843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b774c24-5280-40a4-abc7-4fc94bf843f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:09.689661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b774c24-5280-40a4-abc7-4fc94bf843f2 None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:09.689947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b774c24-5280-40a4-abc7-4fc94bf843f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:09.690225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b774c24-5280-40a4-abc7-4fc94bf843f2 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df/groups/99edc607b47842d1b1a70ae32cd92c70/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:09.692326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b774c24-5280-40a4-abc7-4fc94bf843f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d047530c703494197e4bf5f63aec8df, group_id=99edc607b47842d1b1a70ae32cd92c70, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:09.694000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b774c24-5280-40a4-abc7-4fc94bf843f2 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:09.724569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 205/394] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jul 20 17:36:09 2022] PUT /identity/v3/projects/0d047530c703494197e4bf5f63aec8df/groups/99edc607b47842d1b1a70ae32cd92c70/roles/7c97532e07d14d4096b310fb69816951 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:36:09.726545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386baeae-7ab8-4ff2-aa61-e671b3e3cdac None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:09.727086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386baeae-7ab8-4ff2-aa61-e671b3e3cdac None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:09.727619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386baeae-7ab8-4ff2-aa61-e671b3e3cdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:09.749110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-386baeae-7ab8-4ff2-aa61-e671b3e3cdac None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:09.750881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-386baeae-7ab8-4ff2-aa61-e671b3e3cdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:09.796449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 190/395] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jul 20 17:36:09 2022] PUT /identity/v3/projects/0d047530c703494197e4bf5f63aec8df/groups/99edc607b47842d1b1a70ae32cd92c70/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:36:09.840707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 206/396] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:09.891878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b774c24-5280-40a4-abc7-4fc94bf843f2 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:10.033481 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b774c24-5280-40a4-abc7-4fc94bf843f2 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:10.078909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d1423-b030-42f1-a120-a83dad76fdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:10.079730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d1423-b030-42f1-a120-a83dad76fdfd None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:10.080003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d1423-b030-42f1-a120-a83dad76fdfd None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:10.080285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d1423-b030-42f1-a120-a83dad76fdfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:10.084005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:10.096213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d1423-b030-42f1-a120-a83dad76fdfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-e60d1423-b030-42f1-a120-a83dad76fdfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:10.104806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:10.105759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:10.106645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:10.106645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:10.106645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:10.106645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:10.106645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:10.106645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:10.106645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:10.106645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:10.106645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:10.106645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:10.106645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:36:10.106645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:10.107240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 191/397] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:10.112660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386baeae-7ab8-4ff2-aa61-e671b3e3cdac None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:10.259735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386baeae-7ab8-4ff2-aa61-e671b3e3cdac None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:10.262015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:10.306795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a3731-e514-4c5a-9882-8471c4118253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:10.308010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a3731-e514-4c5a-9882-8471c4118253 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:10.308527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a3731-e514-4c5a-9882-8471c4118253 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:10.308847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a3731-e514-4c5a-9882-8471c4118253 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:10.309678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a3731-e514-4c5a-9882-8471c4118253 None admin] RBAC: Adding query filter params (name=member) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:10.313015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a3731-e514-4c5a-9882-8471c4118253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:10.315242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a3731-e514-4c5a-9882-8471c4118253 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:10.326936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 207/398] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:36:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:10.332188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d1423-b030-42f1-a120-a83dad76fdfd None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:10.450377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d1423-b030-42f1-a120-a83dad76fdfd None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:10.453660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a6f31-dea4-49a2-889a-81c5e49f54fa None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:10.454153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a6f31-dea4-49a2-889a-81c5e49f54fa None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:10.454234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a6f31-dea4-49a2-889a-81c5e49f54fa None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:10.455932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 208/399] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:10.461569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b6360-2f59-414a-9ee9-f0a8349f865b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:10.461897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b6360-2f59-414a-9ee9-f0a8349f865b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:10.462136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b6360-2f59-414a-9ee9-f0a8349f865b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:10.483274 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e33b6360-2f59-414a-9ee9-f0a8349f865b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:10.484631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e33b6360-2f59-414a-9ee9-f0a8349f865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:10.493043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab5975-eb97-4793-9a8f-d983724c3321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:10.493989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab5975-eb97-4793-9a8f-d983724c3321 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:10.494278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab5975-eb97-4793-9a8f-d983724c3321 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:10.494605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab5975-eb97-4793-9a8f-d983724c3321 None admin] PATH_INFO: `/v3/groups/99edc607b47842d1b1a70ae32cd92c70` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:10.496203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab5975-eb97-4793-9a8f-d983724c3321 None admin] RBAC: Authorizing `identity:get_group(group_id=99edc607b47842d1b1a70ae32cd92c70)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:10.497742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab5975-eb97-4793-9a8f-d983724c3321 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:10.499986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 192/400] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:10 2022] GET /identity/v3/groups/99edc607b47842d1b1a70ae32cd92c70 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:10.505419 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab5975-eb97-4793-9a8f-d983724c3321 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:10.582034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:10.585080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 209/401] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:36:10.631078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab5975-eb97-4793-9a8f-d983724c3321 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:10.631651 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b6360-2f59-414a-9ee9-f0a8349f865b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:10.674418 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd6e08-a83f-425d-93b9-5ce37cccb664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:10.675543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd6e08-a83f-425d-93b9-5ce37cccb664 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:10.675999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd6e08-a83f-425d-93b9-5ce37cccb664 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:10.676431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd6e08-a83f-425d-93b9-5ce37cccb664 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:10.678726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd6e08-a83f-425d-93b9-5ce37cccb664 None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:10.680639 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd6e08-a83f-425d-93b9-5ce37cccb664 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:10.684589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 193/402] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:10 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:10.686859 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b0c82-8d66-45e4-a784-84a08deb8199 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:10.687334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b0c82-8d66-45e4-a784-84a08deb8199 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:10.687779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b0c82-8d66-45e4-a784-84a08deb8199 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:10.689937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 194/403] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:10.693756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b0c82-8d66-45e4-a784-84a08deb8199 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:10.829045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:10.840577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b6360-2f59-414a-9ee9-f0a8349f865b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:10.875554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b0c82-8d66-45e4-a784-84a08deb8199 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:10.878061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fec66-cf63-4d8d-ba61-c93de0c5fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:10.879193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fec66-cf63-4d8d-ba61-c93de0c5fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:10.879635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fec66-cf63-4d8d-ba61-c93de0c5fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:10.880064 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fec66-cf63-4d8d-ba61-c93de0c5fbc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:10.893055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fec66-cf63-4d8d-ba61-c93de0c5fbc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-954fec66-cf63-4d8d-ba61-c93de0c5fbc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:10.901490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:10.902974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:10.904015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:10.904015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:10.904015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:10.904015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:10.904015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:10.904015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:10.904015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:10.904015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:10.904015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:10.904015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:10.904015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:36:10.904015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:10.906492 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 210/404] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:36:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:36:10.908357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9564856-1066-4206-b877-51e957f45700 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:10.908884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9564856-1066-4206-b877-51e957f45700 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:10.909316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9564856-1066-4206-b877-51e957f45700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:10.928951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f9564856-1066-4206-b877-51e957f45700 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:10.930763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f9564856-1066-4206-b877-51e957f45700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:10.935929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:10.946706 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d9577-7a8e-432b-9669-79e9a3f9f2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:10.948614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d9577-7a8e-432b-9669-79e9a3f9f2cb None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:10.949649 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d9577-7a8e-432b-9669-79e9a3f9f2cb None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:10.949785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d9577-7a8e-432b-9669-79e9a3f9f2cb None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6/groups/99edc607b47842d1b1a70ae32cd92c70/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:10.953708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d9577-7a8e-432b-9669-79e9a3f9f2cb None admin] RBAC: Authorizing `identity:create_grant(project_id=b19baba10ae34863868739f9da315ab6, group_id=99edc607b47842d1b1a70ae32cd92c70, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:10.956621 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d9577-7a8e-432b-9669-79e9a3f9f2cb None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:11.018368 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 211/405] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:11.019675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9564856-1066-4206-b877-51e957f45700 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:11.054843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 195/406] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jul 20 17:36:10 2022] PUT /identity/v3/projects/b19baba10ae34863868739f9da315ab6/groups/99edc607b47842d1b1a70ae32cd92c70/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:36:11.062644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d9577-7a8e-432b-9669-79e9a3f9f2cb None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:11.161424 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:11.180649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9564856-1066-4206-b877-51e957f45700 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:11.234591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a831e-4ced-4606-b939-308047faeb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:11.235302 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a831e-4ced-4606-b939-308047faeb4b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:11.235583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a831e-4ced-4606-b939-308047faeb4b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:11.236016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a831e-4ced-4606-b939-308047faeb4b None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:11.236936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a831e-4ced-4606-b939-308047faeb4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:11.237287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a831e-4ced-4606-b939-308047faeb4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:11.238768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a831e-4ced-4606-b939-308047faeb4b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:11.265035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 212/407] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:11.266072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a831e-4ced-4606-b939-308047faeb4b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:11.336094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d9577-7a8e-432b-9669-79e9a3f9f2cb None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:11.379177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00e30d-df13-4ca6-abe7-43df5234664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:11.380102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e30d-df13-4ca6-abe7-43df5234664e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:11.380384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e30d-df13-4ca6-abe7-43df5234664e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:11.380687 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e30d-df13-4ca6-abe7-43df5234664e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:11.403850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00e30d-df13-4ca6-abe7-43df5234664e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:11.412207 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a831e-4ced-4606-b939-308047faeb4b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-ab00e30d-df13-4ca6-abe7-43df5234664e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:11.412923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:11.413820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:11.415046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 196/408] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:36:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:11.421172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00e30d-df13-4ca6-abe7-43df5234664e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:11.454556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf00aa-6516-4f17-9b74-0fa19bd2db4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:11.455589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf00aa-6516-4f17-9b74-0fa19bd2db4f None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:11.455879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf00aa-6516-4f17-9b74-0fa19bd2db4f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:11.456308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf00aa-6516-4f17-9b74-0fa19bd2db4f None admin] PATH_INFO: `/v3/groups/17c8a15aac894f8abf16d95decad9862` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:11.458002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf00aa-6516-4f17-9b74-0fa19bd2db4f None admin] RBAC: Authorizing `identity:get_group(group_id=17c8a15aac894f8abf16d95decad9862)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:11.460006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf00aa-6516-4f17-9b74-0fa19bd2db4f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:11.462053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 213/409] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:11 2022] GET /identity/v3/groups/17c8a15aac894f8abf16d95decad9862 => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:11.468827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf00aa-6516-4f17-9b74-0fa19bd2db4f None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:11.489829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:11.541344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:11.622790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf00aa-6516-4f17-9b74-0fa19bd2db4f None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:11.645347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00e30d-df13-4ca6-abe7-43df5234664e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:11.705668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307244cd-1c1b-48c3-bca9-8e12d03d018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:11.706470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307244cd-1c1b-48c3-bca9-8e12d03d018c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:11.706748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307244cd-1c1b-48c3-bca9-8e12d03d018c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:11.707017 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307244cd-1c1b-48c3-bca9-8e12d03d018c None admin] PATH_INFO: `/v3/projects/8f637912c585421ea114b8fb6faea1e7` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:11.711234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307244cd-1c1b-48c3-bca9-8e12d03d018c None admin] RBAC: Authorizing `identity:get_project(project_id=8f637912c585421ea114b8fb6faea1e7)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:11.712719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307244cd-1c1b-48c3-bca9-8e12d03d018c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:11.716664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 214/410] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:11 2022] GET /identity/v3/projects/8f637912c585421ea114b8fb6faea1e7 => generated 344 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:11.721340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307244cd-1c1b-48c3-bca9-8e12d03d018c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:11.727461 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93171fc5-3a2a-4163-b214-da3119802745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:11.728165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93171fc5-3a2a-4163-b214-da3119802745 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:11.728455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93171fc5-3a2a-4163-b214-da3119802745 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:11.728767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93171fc5-3a2a-4163-b214-da3119802745 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:11.730155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93171fc5-3a2a-4163-b214-da3119802745 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:11.730470 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93171fc5-3a2a-4163-b214-da3119802745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:11.731888 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93171fc5-3a2a-4163-b214-da3119802745 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:11.741439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 197/411] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:36:11.749979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93171fc5-3a2a-4163-b214-da3119802745 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:11.840897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:11.860832 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307244cd-1c1b-48c3-bca9-8e12d03d018c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:11.922728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0d37-7e3e-45b6-9c34-0eb36d9b7c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:11.924253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0d37-7e3e-45b6-9c34-0eb36d9b7c02 None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:11.933430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0d37-7e3e-45b6-9c34-0eb36d9b7c02 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:11.934020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0d37-7e3e-45b6-9c34-0eb36d9b7c02 None admin] PATH_INFO: `/v3/projects/8f637912c585421ea114b8fb6faea1e7/groups/17c8a15aac894f8abf16d95decad9862/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:11.937874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d0d37-7e3e-45b6-9c34-0eb36d9b7c02 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f637912c585421ea114b8fb6faea1e7, group_id=17c8a15aac894f8abf16d95decad9862, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:11.940786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d0d37-7e3e-45b6-9c34-0eb36d9b7c02 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:11.951189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93171fc5-3a2a-4163-b214-da3119802745 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:11.967668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:11.994040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd1326-7a46-4630-9117-8f598e483905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:11.995908 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd1326-7a46-4630-9117-8f598e483905 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:11.996634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd1326-7a46-4630-9117-8f598e483905 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:11.997211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd1326-7a46-4630-9117-8f598e483905 None admin] PATH_INFO: `/v3/groups/99edc607b47842d1b1a70ae32cd92c70` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:11.998765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd1326-7a46-4630-9117-8f598e483905 None admin] RBAC: Authorizing `identity:get_group(group_id=99edc607b47842d1b1a70ae32cd92c70)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:12.000580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd1326-7a46-4630-9117-8f598e483905 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:12.003119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 198/412] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:11 2022] GET /identity/v3/groups/99edc607b47842d1b1a70ae32cd92c70 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:12.008537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd1326-7a46-4630-9117-8f598e483905 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:12.035985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 215/413] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jul 20 17:36:11 2022] PUT /identity/v3/projects/8f637912c585421ea114b8fb6faea1e7/groups/17c8a15aac894f8abf16d95decad9862/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:36:12.167475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd1326-7a46-4630-9117-8f598e483905 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:12.220005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc54ea2-93e3-432c-a25d-f54b5a41974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:12.220826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc54ea2-93e3-432c-a25d-f54b5a41974f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:12.221161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc54ea2-93e3-432c-a25d-f54b5a41974f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:12.221442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc54ea2-93e3-432c-a25d-f54b5a41974f None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:12.225531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc54ea2-93e3-432c-a25d-f54b5a41974f None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:12.227498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc54ea2-93e3-432c-a25d-f54b5a41974f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:12.230122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 199/414] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:12 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:12.236680 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0d37-7e3e-45b6-9c34-0eb36d9b7c02 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:12.361691 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0d37-7e3e-45b6-9c34-0eb36d9b7c02 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:12.418768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8327b-1a6f-4a94-a71a-f5e3a79b8db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:12.420117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8327b-1a6f-4a94-a71a-f5e3a79b8db5 None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:12.420402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8327b-1a6f-4a94-a71a-f5e3a79b8db5 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:12.420717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8327b-1a6f-4a94-a71a-f5e3a79b8db5 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6/groups/99edc607b47842d1b1a70ae32cd92c70/roles/7c97532e07d14d4096b310fb69816951` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:12.422114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75445313-06c4-4839-bf2a-14d8b1486228 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:12.422643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75445313-06c4-4839-bf2a-14d8b1486228 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:12.423134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75445313-06c4-4839-bf2a-14d8b1486228 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:12.423246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8327b-1a6f-4a94-a71a-f5e3a79b8db5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b19baba10ae34863868739f9da315ab6, group_id=99edc607b47842d1b1a70ae32cd92c70, role_id=7c97532e07d14d4096b310fb69816951)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:12.425655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8327b-1a6f-4a94-a71a-f5e3a79b8db5 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:12.426270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 200/415] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:12.432360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c66830-a89c-4ee8-ac6b-54ddda4c6546 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:12.432815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c66830-a89c-4ee8-ac6b-54ddda4c6546 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:12.433093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c66830-a89c-4ee8-ac6b-54ddda4c6546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:12.454689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-05c66830-a89c-4ee8-ac6b-54ddda4c6546 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:12.455931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-05c66830-a89c-4ee8-ac6b-54ddda4c6546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:12.520685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 216/416] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Jul 20 17:36:12 2022] PUT /identity/v3/projects/b19baba10ae34863868739f9da315ab6/groups/99edc607b47842d1b1a70ae32cd92c70/roles/7c97532e07d14d4096b310fb69816951 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:36:12.525656 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:12.555019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 201/417] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:36:12.605195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8327b-1a6f-4a94-a71a-f5e3a79b8db5 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:12.610220 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:12.819323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8327b-1a6f-4a94-a71a-f5e3a79b8db5 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:12.861014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd06ff1-b56f-46e8-a691-d10cef811f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:12.861861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd06ff1-b56f-46e8-a691-d10cef811f46 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:12.862148 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd06ff1-b56f-46e8-a691-d10cef811f46 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:12.862430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd06ff1-b56f-46e8-a691-d10cef811f46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:12.875843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd06ff1-b56f-46e8-a691-d10cef811f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:12.881149 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b3d7-f8be-48ef-a3f2-30f4aaf20a22 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:12.881664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b3d7-f8be-48ef-a3f2-30f4aaf20a22 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:12.882148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b3d7-f8be-48ef-a3f2-30f4aaf20a22 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-2fd06ff1-b56f-46e8-a691-d10cef811f46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:12.884442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:12.885410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:12.887689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 217/418] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:36:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:12.888545 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 202/419] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:12.893455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd06ff1-b56f-46e8-a691-d10cef811f46 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:12.898157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf06be-014b-4c56-8cc0-d4247b6f9855 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:12.898842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf06be-014b-4c56-8cc0-d4247b6f9855 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:12.899474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf06be-014b-4c56-8cc0-d4247b6f9855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:12.938427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-facf06be-014b-4c56-8cc0-d4247b6f9855 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:12.942380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-facf06be-014b-4c56-8cc0-d4247b6f9855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:12.992454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:13.016874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd06ff1-b56f-46e8-a691-d10cef811f46 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:13.058971 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783123-045b-4122-873b-4c867e1bad85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:13.059666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783123-045b-4122-873b-4c867e1bad85 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:13.059957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783123-045b-4122-873b-4c867e1bad85 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:13.060246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783123-045b-4122-873b-4c867e1bad85 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:13.061355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d783123-045b-4122-873b-4c867e1bad85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:13.061725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d783123-045b-4122-873b-4c867e1bad85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:13.063667 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d783123-045b-4122-873b-4c867e1bad85 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:13.074006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 218/420] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:36:13.079795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783123-045b-4122-873b-4c867e1bad85 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:13.156040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 203/421] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:13.249353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf06be-014b-4c56-8cc0-d4247b6f9855 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:13.258614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783123-045b-4122-873b-4c867e1bad85 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:13.284941 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:13.295984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181724-f3b1-49e7-a065-d1938f42144f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:13.296680 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181724-f3b1-49e7-a065-d1938f42144f None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:13.296962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181724-f3b1-49e7-a065-d1938f42144f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:13.297237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181724-f3b1-49e7-a065-d1938f42144f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:13.375572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181724-f3b1-49e7-a065-d1938f42144f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:13.377136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181724-f3b1-49e7-a065-d1938f42144f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:13.492006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 219/422] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:13.498572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181724-f3b1-49e7-a065-d1938f42144f None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:13.517556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf06be-014b-4c56-8cc0-d4247b6f9855 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:13.532880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:13.539634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:13.598622 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81816271-fb6d-4043-9246-f749acb60f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:13.599429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81816271-fb6d-4043-9246-f749acb60f1e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:13.599710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81816271-fb6d-4043-9246-f749acb60f1e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:13.599983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81816271-fb6d-4043-9246-f749acb60f1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:13.620691 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81816271-fb6d-4043-9246-f749acb60f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-81816271-fb6d-4043-9246-f749acb60f1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:13.635510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:13.637930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:13.639604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 204/423] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:13.647212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81816271-fb6d-4043-9246-f749acb60f1e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:13.702843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181724-f3b1-49e7-a065-d1938f42144f None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:13.775716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a0ee1-c3d1-4f6f-868f-9a564dd4f621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:13.776718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a0ee1-c3d1-4f6f-868f-9a564dd4f621 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:13.777009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a0ee1-c3d1-4f6f-868f-9a564dd4f621 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:13.778283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a0ee1-c3d1-4f6f-868f-9a564dd4f621 None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:13.780035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a0ee1-c3d1-4f6f-868f-9a564dd4f621 None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:13.782681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a0ee1-c3d1-4f6f-868f-9a564dd4f621 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:13.785524 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 220/424] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:13 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:36:13.794054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a0ee1-c3d1-4f6f-868f-9a564dd4f621 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:13.883875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81816271-fb6d-4043-9246-f749acb60f1e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:14.003950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04795c3-d4e8-4a0a-b3c6-262da71a0116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:14.005553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04795c3-d4e8-4a0a-b3c6-262da71a0116 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:14.006293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04795c3-d4e8-4a0a-b3c6-262da71a0116 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:14.011351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04795c3-d4e8-4a0a-b3c6-262da71a0116 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:14.013377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04795c3-d4e8-4a0a-b3c6-262da71a0116 None admin] RBAC: Adding query filter params (name=member) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:14.018582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04795c3-d4e8-4a0a-b3c6-262da71a0116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:14.021234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04795c3-d4e8-4a0a-b3c6-262da71a0116 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:14.044862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 205/425] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:36:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:14.053608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04795c3-d4e8-4a0a-b3c6-262da71a0116 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:14.060943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:14.078543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a0ee1-c3d1-4f6f-868f-9a564dd4f621 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:14.148872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:14.157685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfd6b2-3893-4902-8f6b-569bac57174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:14.158592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd6b2-3893-4902-8f6b-569bac57174f None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:14.158881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd6b2-3893-4902-8f6b-569bac57174f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:14.159159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd6b2-3893-4902-8f6b-569bac57174f None admin] PATH_INFO: `/v3/groups/99edc607b47842d1b1a70ae32cd92c70` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:14.160466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfd6b2-3893-4902-8f6b-569bac57174f None admin] RBAC: Authorizing `identity:get_group(group_id=99edc607b47842d1b1a70ae32cd92c70)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:14.162206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfd6b2-3893-4902-8f6b-569bac57174f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:14.164460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 221/426] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:13 2022] GET /identity/v3/groups/99edc607b47842d1b1a70ae32cd92c70 => generated 226 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:14.171933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfd6b2-3893-4902-8f6b-569bac57174f None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:14.326810 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfd6b2-3893-4902-8f6b-569bac57174f None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:14.348728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04795c3-d4e8-4a0a-b3c6-262da71a0116 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:14.369445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ae5cc-0f5a-432c-885a-fd004452f4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:14.370224 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ae5cc-0f5a-432c-885a-fd004452f4dd None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:14.370514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ae5cc-0f5a-432c-885a-fd004452f4dd None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:14.370858 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ae5cc-0f5a-432c-885a-fd004452f4dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:14.371841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ae5cc-0f5a-432c-885a-fd004452f4dd None admin] RBAC: Adding query filter params (group.id=99edc607b47842d1b1a70ae32cd92c70, role.id=7c97532e07d14d4096b310fb69816951, scope.project.id=0d047530c703494197e4bf5f63aec8df) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:14.372160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ae5cc-0f5a-432c-885a-fd004452f4dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:14.373722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ae5cc-0f5a-432c-885a-fd004452f4dd None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:14.381141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 222/427] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 20 17:36:14 2022] GET /identity/v3/role_assignments?group.id=99edc607b47842d1b1a70ae32cd92c70&scope.project.id=0d047530c703494197e4bf5f63aec8df&role.id=7c97532e07d14d4096b310fb69816951 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:36:14.382644 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283a6d-1175-4ac1-9749-e5c4f4b2c021 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:14.382941 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283a6d-1175-4ac1-9749-e5c4f4b2c021 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:14.383219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283a6d-1175-4ac1-9749-e5c4f4b2c021 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:14.384672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 223/428] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:14.398428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a197-3304-4b1b-aaf8-82adb435240b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:14.399021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a197-3304-4b1b-aaf8-82adb435240b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:14.399441 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a197-3304-4b1b-aaf8-82adb435240b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:14.426887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9ce24-8a46-417d-9c87-b2c58aa4ec9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:14.427587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9ce24-8a46-417d-9c87-b2c58aa4ec9e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:14.427874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9ce24-8a46-417d-9c87-b2c58aa4ec9e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:14.428157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9ce24-8a46-417d-9c87-b2c58aa4ec9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:14.456588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-1793a197-3304-4b1b-aaf8-82adb435240b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:14.458069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-1793a197-3304-4b1b-aaf8-82adb435240b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:14.516829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9ce24-8a46-417d-9c87-b2c58aa4ec9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:14.518339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9ce24-8a46-417d-9c87-b2c58aa4ec9e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:14.526000 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:14.555361 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:14.665760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 224/429] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:14.681493 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7e924-b4c9-4aaa-844d-656f430a9ed9 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:14.681804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7e924-b4c9-4aaa-844d-656f430a9ed9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:14.682057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7e924-b4c9-4aaa-844d-656f430a9ed9 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:14.686113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 225/430] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:36:14.689935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368a8cf-2d4c-4eea-8bcb-d1f6eac041b7 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:14.690230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368a8cf-2d4c-4eea-8bcb-d1f6eac041b7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:14.690513 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368a8cf-2d4c-4eea-8bcb-d1f6eac041b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:14.697285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 206/431] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 17:36:14.704762 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9ce24-8a46-417d-9c87-b2c58aa4ec9e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:14.712399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-4368a8cf-2d4c-4eea-8bcb-d1f6eac041b7 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:14.713642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4368a8cf-2d4c-4eea-8bcb-d1f6eac041b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:14.799171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 226/432] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:36:14.800457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368a8cf-2d4c-4eea-8bcb-d1f6eac041b7 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:14.853465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9ce24-8a46-417d-9c87-b2c58aa4ec9e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:14.904344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:14.909139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:14.913936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88589e75-63ab-4b47-b325-ed28850be7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:14.915415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589e75-63ab-4b47-b325-ed28850be7ee None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:14.915968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589e75-63ab-4b47-b325-ed28850be7ee None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:14.916414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88589e75-63ab-4b47-b325-ed28850be7ee None admin] PATH_INFO: `/v3/projects/0d047530c703494197e4bf5f63aec8df` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:14.918844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88589e75-63ab-4b47-b325-ed28850be7ee None admin] RBAC: Authorizing `identity:get_project(project_id=0d047530c703494197e4bf5f63aec8df)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:14.921675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88589e75-63ab-4b47-b325-ed28850be7ee None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:14.924987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 207/433] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:14 2022] GET /identity/v3/projects/0d047530c703494197e4bf5f63aec8df => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:14.926413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88589e75-63ab-4b47-b325-ed28850be7ee None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:14.934016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368a8cf-2d4c-4eea-8bcb-d1f6eac041b7 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:14.989000 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae616cc3-de7a-4a54-99e1-f5af7d114434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:14.990118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae616cc3-de7a-4a54-99e1-f5af7d114434 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:14.990559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae616cc3-de7a-4a54-99e1-f5af7d114434 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:14.991099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae616cc3-de7a-4a54-99e1-f5af7d114434 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:15.004330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae616cc3-de7a-4a54-99e1-f5af7d114434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-ae616cc3-de7a-4a54-99e1-f5af7d114434 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:15.013240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:15.014225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:15.015076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:15.015076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:15.015076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:15.015076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:15.015076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:15.015076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:15.015076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:15.015076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:15.015076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:15.015076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:15.015076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 17:36:15.015076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:15.017147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 227/434] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:15.018167 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae616cc3-de7a-4a54-99e1-f5af7d114434 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:15.075919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88589e75-63ab-4b47-b325-ed28850be7ee None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:15.130976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b9ad2-888d-4c3c-84f7-837fe3a0a08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:15.132179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b9ad2-888d-4c3c-84f7-837fe3a0a08f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:15.132693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b9ad2-888d-4c3c-84f7-837fe3a0a08f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:15.133166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b9ad2-888d-4c3c-84f7-837fe3a0a08f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:15.151251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b9ad2-888d-4c3c-84f7-837fe3a0a08f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-029b9ad2-888d-4c3c-84f7-837fe3a0a08f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:15.164872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:15.166887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 208/435] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:15.175022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b9ad2-888d-4c3c-84f7-837fe3a0a08f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:15.193683 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae616cc3-de7a-4a54-99e1-f5af7d114434 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:15.249433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf366aa-fa45-4358-a998-d70d4d1934d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:15.250824 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf366aa-fa45-4358-a998-d70d4d1934d9 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:15.251304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf366aa-fa45-4358-a998-d70d4d1934d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:15.251767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf366aa-fa45-4358-a998-d70d4d1934d9 None admin] PATH_INFO: `/v3/groups/99edc607b47842d1b1a70ae32cd92c70` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:15.253745 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf366aa-fa45-4358-a998-d70d4d1934d9 None admin] RBAC: Authorizing `identity:get_group(group_id=99edc607b47842d1b1a70ae32cd92c70)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:15.256171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf366aa-fa45-4358-a998-d70d4d1934d9 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:15.259093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 228/436] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:15 2022] GET /identity/v3/groups/99edc607b47842d1b1a70ae32cd92c70 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:15.260425 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf366aa-fa45-4358-a998-d70d4d1934d9 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:15.275948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:15.288782 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:15.340936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b9ad2-888d-4c3c-84f7-837fe3a0a08f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:15.387534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab1048-ceb7-4088-90fc-c5f271b785dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:15.388556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1048-ceb7-4088-90fc-c5f271b785dc None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:15.389034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1048-ceb7-4088-90fc-c5f271b785dc None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:15.389501 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1048-ceb7-4088-90fc-c5f271b785dc None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:15.393751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab1048-ceb7-4088-90fc-c5f271b785dc None admin] RBAC: Adding query filter params (name=member) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:15.393751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab1048-ceb7-4088-90fc-c5f271b785dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:15.393751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab1048-ceb7-4088-90fc-c5f271b785dc None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:15.406580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf366aa-fa45-4358-a998-d70d4d1934d9 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:15.411225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 209/437] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:36:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:15.412226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab1048-ceb7-4088-90fc-c5f271b785dc None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:15.452213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9bc3e-9dd0-4d91-9751-e1ed30ed66c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:15.452823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9bc3e-9dd0-4d91-9751-e1ed30ed66c0 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:15.453109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9bc3e-9dd0-4d91-9751-e1ed30ed66c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:15.453390 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9bc3e-9dd0-4d91-9751-e1ed30ed66c0 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:15.454162 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9bc3e-9dd0-4d91-9751-e1ed30ed66c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:15.454476 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9bc3e-9dd0-4d91-9751-e1ed30ed66c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:15.455863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9bc3e-9dd0-4d91-9751-e1ed30ed66c0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:15.466259 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 229/438] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:15.467143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9bc3e-9dd0-4d91-9751-e1ed30ed66c0 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:15.539758 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab1048-ceb7-4088-90fc-c5f271b785dc None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:15.555478 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:15.564112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:15.585457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fe4b4-2c9b-4589-a0b9-15d004781ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:15.586500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fe4b4-2c9b-4589-a0b9-15d004781ccf None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:15.586965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fe4b4-2c9b-4589-a0b9-15d004781ccf None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:15.587385 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fe4b4-2c9b-4589-a0b9-15d004781ccf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:15.588792 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fe4b4-2c9b-4589-a0b9-15d004781ccf None admin] RBAC: Adding query filter params (group.id=99edc607b47842d1b1a70ae32cd92c70, role.id=0f0e06be5d684398a453fa6312e57d41, scope.project.id=0d047530c703494197e4bf5f63aec8df) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:15.589366 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fe4b4-2c9b-4589-a0b9-15d004781ccf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:15.591955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fe4b4-2c9b-4589-a0b9-15d004781ccf None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:15.597179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9bc3e-9dd0-4d91-9751-e1ed30ed66c0 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:15.615017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 210/439] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 20 17:36:15 2022] GET /identity/v3/role_assignments?group.id=99edc607b47842d1b1a70ae32cd92c70&scope.project.id=0d047530c703494197e4bf5f63aec8df&role.id=0f0e06be5d684398a453fa6312e57d41 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:15.615017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26806d-56ec-41b8-8d44-9c6601466990 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:15.615017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26806d-56ec-41b8-8d44-9c6601466990 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:15.615017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26806d-56ec-41b8-8d44-9c6601466990 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:15.615017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 211/440] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:15.615017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26806d-56ec-41b8-8d44-9c6601466990 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:15.663967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af9c0a-f63e-4bb7-a699-9247c7356cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:15.665030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af9c0a-f63e-4bb7-a699-9247c7356cb6 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:15.665459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af9c0a-f63e-4bb7-a699-9247c7356cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:15.665880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af9c0a-f63e-4bb7-a699-9247c7356cb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:15.770939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af9c0a-f63e-4bb7-a699-9247c7356cb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:15.772817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af9c0a-f63e-4bb7-a699-9247c7356cb6 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:15.814185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26806d-56ec-41b8-8d44-9c6601466990 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:15.880943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eebd47-cf5c-47f5-b030-9bb0ae3ab5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:15.881852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eebd47-cf5c-47f5-b030-9bb0ae3ab5ee None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:15.882261 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eebd47-cf5c-47f5-b030-9bb0ae3ab5ee None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:15.882661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eebd47-cf5c-47f5-b030-9bb0ae3ab5ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:15.903698 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:15.943773 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 230/441] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:15.945163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62156c23-5de9-4dd7-bd92-2d511c4f4a85 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:15.945536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62156c23-5de9-4dd7-bd92-2d511c4f4a85 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:15.945822 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62156c23-5de9-4dd7-bd92-2d511c4f4a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:15.959147 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:15.968946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-62156c23-5de9-4dd7-bd92-2d511c4f4a85 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:15.971306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-62156c23-5de9-4dd7-bd92-2d511c4f4a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:15.992332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eebd47-cf5c-47f5-b030-9bb0ae3ab5ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:15.993942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eebd47-cf5c-47f5-b030-9bb0ae3ab5ee None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:16.072420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 231/442] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:16.077824 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62156c23-5de9-4dd7-bd92-2d511c4f4a85 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:16.158850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 212/443] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:16.159826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eebd47-cf5c-47f5-b030-9bb0ae3ab5ee None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:16.227293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62156c23-5de9-4dd7-bd92-2d511c4f4a85 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:16.231004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:16.268595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133a96c-0b3e-489a-b2c7-89a5997a4ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:16.269488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a96c-0b3e-489a-b2c7-89a5997a4ad7 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:16.269775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a96c-0b3e-489a-b2c7-89a5997a4ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:16.270057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a96c-0b3e-489a-b2c7-89a5997a4ad7 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:16.271439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133a96c-0b3e-489a-b2c7-89a5997a4ad7 None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:16.273036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133a96c-0b3e-489a-b2c7-89a5997a4ad7 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:16.274809 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 232/444] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:16 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:16.275732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133a96c-0b3e-489a-b2c7-89a5997a4ad7 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:16.291798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:16.314864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eebd47-cf5c-47f5-b030-9bb0ae3ab5ee None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:16.363791 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e729c0-9318-4c4c-97ae-507440ec8c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:16.364553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e729c0-9318-4c4c-97ae-507440ec8c00 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:16.364847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e729c0-9318-4c4c-97ae-507440ec8c00 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:16.365126 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e729c0-9318-4c4c-97ae-507440ec8c00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:16.377055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e729c0-9318-4c4c-97ae-507440ec8c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-b0e729c0-9318-4c4c-97ae-507440ec8c00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:16.385360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:16.387768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 213/445] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:36:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:16.388897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e729c0-9318-4c4c-97ae-507440ec8c00 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:16.399184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133a96c-0b3e-489a-b2c7-89a5997a4ad7 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:16.438276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a506216-e4b7-4333-b3f1-ff064bd6e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:16.439150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a506216-e4b7-4333-b3f1-ff064bd6e977 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:16.439430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a506216-e4b7-4333-b3f1-ff064bd6e977 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:16.439702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a506216-e4b7-4333-b3f1-ff064bd6e977 None admin] PATH_INFO: `/v3/projects/8f637912c585421ea114b8fb6faea1e7` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:16.440958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a506216-e4b7-4333-b3f1-ff064bd6e977 None admin] RBAC: Authorizing `identity:get_project(project_id=8f637912c585421ea114b8fb6faea1e7)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:16.442419 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a506216-e4b7-4333-b3f1-ff064bd6e977 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:16.444158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 233/446] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:16 2022] GET /identity/v3/projects/8f637912c585421ea114b8fb6faea1e7 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:16.444971 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a506216-e4b7-4333-b3f1-ff064bd6e977 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:16.507098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:16.519319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e729c0-9318-4c4c-97ae-507440ec8c00 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:16.559054 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb1ffb-84e9-49df-a874-37f98eaaa4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:16.560023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb1ffb-84e9-49df-a874-37f98eaaa4ab None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:16.560314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb1ffb-84e9-49df-a874-37f98eaaa4ab None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:16.560625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb1ffb-84e9-49df-a874-37f98eaaa4ab None admin] PATH_INFO: `/v3/groups/99edc607b47842d1b1a70ae32cd92c70` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:16.561915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb1ffb-84e9-49df-a874-37f98eaaa4ab None admin] RBAC: Authorizing `identity:get_group(group_id=99edc607b47842d1b1a70ae32cd92c70)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:16.563389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb1ffb-84e9-49df-a874-37f98eaaa4ab None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:16.565124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 214/447] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:16 2022] GET /identity/v3/groups/99edc607b47842d1b1a70ae32cd92c70 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:16.565921 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb1ffb-84e9-49df-a874-37f98eaaa4ab None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:16.598097 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:16.602311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a506216-e4b7-4333-b3f1-ff064bd6e977 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:16.654362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbea2ac-8142-408b-8363-c57e3175bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:16.655341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbea2ac-8142-408b-8363-c57e3175bdda None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:16.655807 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbea2ac-8142-408b-8363-c57e3175bdda None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:16.656261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbea2ac-8142-408b-8363-c57e3175bdda None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:16.657855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbea2ac-8142-408b-8363-c57e3175bdda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:16.658280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbea2ac-8142-408b-8363-c57e3175bdda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:16.660732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbea2ac-8142-408b-8363-c57e3175bdda None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:16.672931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 234/448] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:16.673891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbea2ac-8142-408b-8363-c57e3175bdda None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:16.720613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb1ffb-84e9-49df-a874-37f98eaaa4ab None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:16.784232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0369-72d1-44d6-8e95-276978b0a18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:16.785751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0369-72d1-44d6-8e95-276978b0a18a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:16.786251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0369-72d1-44d6-8e95-276978b0a18a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:16.786736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0369-72d1-44d6-8e95-276978b0a18a None admin] PATH_INFO: `/v3/groups/17c8a15aac894f8abf16d95decad9862` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:16.788873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b0369-72d1-44d6-8e95-276978b0a18a None admin] RBAC: Authorizing `identity:get_group(group_id=17c8a15aac894f8abf16d95decad9862)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:16.789870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbea2ac-8142-408b-8363-c57e3175bdda None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:16.791568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:16.791734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b0369-72d1-44d6-8e95-276978b0a18a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:16.800396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 215/449] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:16 2022] GET /identity/v3/groups/17c8a15aac894f8abf16d95decad9862 => generated 229 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:16.800396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0369-72d1-44d6-8e95-276978b0a18a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:16.830693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc25ab-f744-43a7-99e8-5eaa6335a4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:16.831350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc25ab-f744-43a7-99e8-5eaa6335a4db None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:16.831658 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc25ab-f744-43a7-99e8-5eaa6335a4db None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:16.831928 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc25ab-f744-43a7-99e8-5eaa6335a4db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:16.832815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc25ab-f744-43a7-99e8-5eaa6335a4db None admin] RBAC: Adding query filter params (group.id=99edc607b47842d1b1a70ae32cd92c70, role.id=0f0e06be5d684398a453fa6312e57d41, scope.project.id=b19baba10ae34863868739f9da315ab6) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:16.833109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc25ab-f744-43a7-99e8-5eaa6335a4db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:16.834548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc25ab-f744-43a7-99e8-5eaa6335a4db None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:16.841498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 235/450] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 20 17:36:16 2022] GET /identity/v3/role_assignments?group.id=99edc607b47842d1b1a70ae32cd92c70&scope.project.id=b19baba10ae34863868739f9da315ab6&role.id=0f0e06be5d684398a453fa6312e57d41 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:16.842350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc25ab-f744-43a7-99e8-5eaa6335a4db None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:16.941531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:16.970685 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0369-72d1-44d6-8e95-276978b0a18a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:17.012801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc25ab-f744-43a7-99e8-5eaa6335a4db None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:17.033496 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2f8f-6e39-48c3-a0bf-b26d36098088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:17.034174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2f8f-6e39-48c3-a0bf-b26d36098088 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:17.034456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2f8f-6e39-48c3-a0bf-b26d36098088 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:17.034733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2f8f-6e39-48c3-a0bf-b26d36098088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:17.074735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf19774-bdf7-4eca-b68e-c10f191662c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:17.075623 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf19774-bdf7-4eca-b68e-c10f191662c7 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:17.076013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf19774-bdf7-4eca-b68e-c10f191662c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:17.076408 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf19774-bdf7-4eca-b68e-c10f191662c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:17.079047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf19774-bdf7-4eca-b68e-c10f191662c7 None admin] RBAC: Adding query filter params (group.id=17c8a15aac894f8abf16d95decad9862, role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=8f637912c585421ea114b8fb6faea1e7) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:17.079567 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf19774-bdf7-4eca-b68e-c10f191662c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:17.081905 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf19774-bdf7-4eca-b68e-c10f191662c7 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:17.092381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 236/451] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 20 17:36:16 2022] GET /identity/v3/role_assignments?group.id=17c8a15aac894f8abf16d95decad9862&scope.project.id=8f637912c585421ea114b8fb6faea1e7&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 611 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:17.135986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b2f8f-6e39-48c3-a0bf-b26d36098088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:17.140080 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b2f8f-6e39-48c3-a0bf-b26d36098088 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:17.267675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:17.304352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 216/452] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:17.311123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf19774-bdf7-4eca-b68e-c10f191662c7 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:17.349461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:17.425800 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf19774-bdf7-4eca-b68e-c10f191662c7 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:17.461539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686ec4d-bfb5-498e-8ee1-9a92b25e74c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:17.462407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686ec4d-bfb5-498e-8ee1-9a92b25e74c7 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:17.462688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686ec4d-bfb5-498e-8ee1-9a92b25e74c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:17.462960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686ec4d-bfb5-498e-8ee1-9a92b25e74c7 None admin] PATH_INFO: `/v3/projects/b19baba10ae34863868739f9da315ab6` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:17.464363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686ec4d-bfb5-498e-8ee1-9a92b25e74c7 None admin] RBAC: Authorizing `identity:get_project(project_id=b19baba10ae34863868739f9da315ab6)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:17.465833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686ec4d-bfb5-498e-8ee1-9a92b25e74c7 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:17.467557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 237/453] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:36:17 2022] GET /identity/v3/projects/b19baba10ae34863868739f9da315ab6 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:17.473320 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2f8f-6e39-48c3-a0bf-b26d36098088 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:17.576200 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2f8f-6e39-48c3-a0bf-b26d36098088 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:17.610867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d185d5f-e589-4732-9224-e03dcf07bc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:17.611717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d185d5f-e589-4732-9224-e03dcf07bc21 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:17.611993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d185d5f-e589-4732-9224-e03dcf07bc21 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:17.612259 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d185d5f-e589-4732-9224-e03dcf07bc21 None admin] PATH_INFO: `/v3/groups/99edc607b47842d1b1a70ae32cd92c70` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:17.613455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d185d5f-e589-4732-9224-e03dcf07bc21 None admin] RBAC: Authorizing `identity:get_group(group_id=99edc607b47842d1b1a70ae32cd92c70)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:17.614890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d185d5f-e589-4732-9224-e03dcf07bc21 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:17.616541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 217/454] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Jul 20 17:36:17 2022] GET /identity/v3/groups/99edc607b47842d1b1a70ae32cd92c70 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:17.623377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686ec4d-bfb5-498e-8ee1-9a92b25e74c7 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:17.723839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:17.728190 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686ec4d-bfb5-498e-8ee1-9a92b25e74c7 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:17.769451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640fee6-f546-43c5-9348-2a7f84d8fe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:17.770424 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640fee6-f546-43c5-9348-2a7f84d8fe9c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:17.770789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640fee6-f546-43c5-9348-2a7f84d8fe9c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:17.771476 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640fee6-f546-43c5-9348-2a7f84d8fe9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:17.772373 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640fee6-f546-43c5-9348-2a7f84d8fe9c None admin] RBAC: Adding query filter params (group.id=99edc607b47842d1b1a70ae32cd92c70, role.id=7c97532e07d14d4096b310fb69816951, scope.project.id=b19baba10ae34863868739f9da315ab6) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:17.772720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640fee6-f546-43c5-9348-2a7f84d8fe9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:17.774216 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640fee6-f546-43c5-9348-2a7f84d8fe9c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:17.782059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 238/455] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Jul 20 17:36:17 2022] GET /identity/v3/role_assignments?group.id=99edc607b47842d1b1a70ae32cd92c70&scope.project.id=b19baba10ae34863868739f9da315ab6&role.id=7c97532e07d14d4096b310fb69816951 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:20.961272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c57a4-4f8c-4f58-bd05-170d89b241a1 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:20.962056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c57a4-4f8c-4f58-bd05-170d89b241a1 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:20.962056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c57a4-4f8c-4f58-bd05-170d89b241a1 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:20.963884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 218/456] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:20.970341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c1e21-c4a5-4443-a72f-b5bd21da40e8 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:20.971110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c1e21-c4a5-4443-a72f-b5bd21da40e8 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:20.971110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c1e21-c4a5-4443-a72f-b5bd21da40e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:20.997661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-599c1e21-c4a5-4443-a72f-b5bd21da40e8 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:20.998881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-599c1e21-c4a5-4443-a72f-b5bd21da40e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:21.098662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 239/457] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:36:21.143844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c57a4-4f8c-4f58-bd05-170d89b241a1 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:21.224343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80c1b2-875f-4380-915f-eab482313b9b None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:21.224592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80c1b2-875f-4380-915f-eab482313b9b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:21.224898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80c1b2-875f-4380-915f-eab482313b9b None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:21.226681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 240/458] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:36:21.236638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51442dad-9a95-4a5c-8fa0-0090aac56b44 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:21.236959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51442dad-9a95-4a5c-8fa0-0090aac56b44 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:21.237233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51442dad-9a95-4a5c-8fa0-0090aac56b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:21.270060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:21.280543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-51442dad-9a95-4a5c-8fa0-0090aac56b44 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:21.283353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-51442dad-9a95-4a5c-8fa0-0090aac56b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:21.383418 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c57a4-4f8c-4f58-bd05-170d89b241a1 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:21.429386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 241/459] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:36:21.464121 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef839f4d-87b1-4c5d-b7da-6bfe2a6d6f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:21.465494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51442dad-9a95-4a5c-8fa0-0090aac56b44 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:21.465993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef839f4d-87b1-4c5d-b7da-6bfe2a6d6f8d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:21.466414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef839f4d-87b1-4c5d-b7da-6bfe2a6d6f8d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:21.466825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef839f4d-87b1-4c5d-b7da-6bfe2a6d6f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:21.502736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef839f4d-87b1-4c5d-b7da-6bfe2a6d6f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:21.504217 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef839f4d-87b1-4c5d-b7da-6bfe2a6d6f8d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:21.534892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-ef839f4d-87b1-4c5d-b7da-6bfe2a6d6f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:21.540075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:21.541593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:21.543243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:21.543243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:21.543243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:21.543243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:21.543243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 219/460] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:36:21.543243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe6e02-c77c-4732-8ab2-d6673a7e5b5b None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:21.543243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe6e02-c77c-4732-8ab2-d6673a7e5b5b None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:21.543972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe6e02-c77c-4732-8ab2-d6673a7e5b5b None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:21.550191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 220/461] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:21.551345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe6e02-c77c-4732-8ab2-d6673a7e5b5b None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:21.674686 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51442dad-9a95-4a5c-8fa0-0090aac56b44 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:21.679764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:21.685627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe6e02-c77c-4732-8ab2-d6673a7e5b5b None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:21.735052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f268a6a-96a3-41b8-b8af-81783abbb635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:21.735730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268a6a-96a3-41b8-b8af-81783abbb635 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:21.736038 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268a6a-96a3-41b8-b8af-81783abbb635 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:21.736276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268a6a-96a3-41b8-b8af-81783abbb635 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:21.737054 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f268a6a-96a3-41b8-b8af-81783abbb635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:21.737364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f268a6a-96a3-41b8-b8af-81783abbb635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:21.738769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f268a6a-96a3-41b8-b8af-81783abbb635 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:21.743723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168285fe-c2e8-45f8-8819-c299113b6cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:21.746317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168285fe-c2e8-45f8-8819-c299113b6cfb None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:21.747309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168285fe-c2e8-45f8-8819-c299113b6cfb None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:21.748093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168285fe-c2e8-45f8-8819-c299113b6cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:21.753477 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 221/462] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:21.754802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82bda0-c6ff-442f-8faa-3844d3e01768 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:21.755096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82bda0-c6ff-442f-8faa-3844d3e01768 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:21.755373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82bda0-c6ff-442f-8faa-3844d3e01768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:21.767759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168285fe-c2e8-45f8-8819-c299113b6cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:21.770541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168285fe-c2e8-45f8-8819-c299113b6cfb None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:21.773641 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-dd82bda0-c6ff-442f-8faa-3844d3e01768 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:21.774840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-dd82bda0-c6ff-442f-8faa-3844d3e01768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-168285fe-c2e8-45f8-8819-c299113b6cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:21.804763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:21.805702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:21.806617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:21.806617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:21.806617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:21.806617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:21.807390 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 242/463] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:36:21.809909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc400d12-6785-4ba7-b411-125fd40126b6 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:21.810410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc400d12-6785-4ba7-b411-125fd40126b6 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:21.810910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc400d12-6785-4ba7-b411-125fd40126b6 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:21.813536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 243/464] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:21.814937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc400d12-6785-4ba7-b411-125fd40126b6 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:21.872515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 222/465] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:21.872515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82bda0-c6ff-442f-8faa-3844d3e01768 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:21.945973 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:21.991504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:21.993824 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc400d12-6785-4ba7-b411-125fd40126b6 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:22.007594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82bda0-c6ff-442f-8faa-3844d3e01768 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:22.041673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f90d8-e02f-4951-b939-233558b2b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:22.042908 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f90d8-e02f-4951-b939-233558b2b874 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:22.043195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f90d8-e02f-4951-b939-233558b2b874 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:22.043465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f90d8-e02f-4951-b939-233558b2b874 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:22.044199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f90d8-e02f-4951-b939-233558b2b874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:22.044536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f90d8-e02f-4951-b939-233558b2b874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:22.045934 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f90d8-e02f-4951-b939-233558b2b874 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:22.047602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edb159-345e-47a2-bf4b-7ffa7b0c8ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:22.048643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb159-345e-47a2-bf4b-7ffa7b0c8ded None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:22.049223 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb159-345e-47a2-bf4b-7ffa7b0c8ded None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:22.049730 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb159-345e-47a2-bf4b-7ffa7b0c8ded None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:22.050972 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edb159-345e-47a2-bf4b-7ffa7b0c8ded None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:22.053756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edb159-345e-47a2-bf4b-7ffa7b0c8ded None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:22.059315 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 223/466] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:22.064948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865ad56-86bb-4f3a-8d2b-0b17d4481366 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:22.065522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865ad56-86bb-4f3a-8d2b-0b17d4481366 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:22.065815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865ad56-86bb-4f3a-8d2b-0b17d4481366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:22.085413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-0865ad56-86bb-4f3a-8d2b-0b17d4481366 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:22.086778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0865ad56-86bb-4f3a-8d2b-0b17d4481366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:22.162998 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 224/467] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:22.163859 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865ad56-86bb-4f3a-8d2b-0b17d4481366 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:22.194390 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 244/468] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:36:21 2022] POST /identity/v3/users => generated 246 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:36:22.196529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edb159-345e-47a2-bf4b-7ffa7b0c8ded None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:22.328112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:22.363745 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865ad56-86bb-4f3a-8d2b-0b17d4481366 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:22.400818 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edb159-345e-47a2-bf4b-7ffa7b0c8ded None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:22.443664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1050b6-0386-45ee-98a0-b94643f9aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:22.445466 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1050b6-0386-45ee-98a0-b94643f9aee9 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:22.446229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1050b6-0386-45ee-98a0-b94643f9aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:22.446920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1050b6-0386-45ee-98a0-b94643f9aee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:22.470312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1050b6-0386-45ee-98a0-b94643f9aee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:22.472686 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1050b6-0386-45ee-98a0-b94643f9aee9 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:22.480510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:22.493660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d290d2-7625-49e2-8e68-32d06698af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:22.494733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d290d2-7625-49e2-8e68-32d06698af79 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:22.495190 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d290d2-7625-49e2-8e68-32d06698af79 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:22.495690 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d290d2-7625-49e2-8e68-32d06698af79 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:22.496965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d290d2-7625-49e2-8e68-32d06698af79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:22.500826 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d290d2-7625-49e2-8e68-32d06698af79 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-2c1050b6-0386-45ee-98a0-b94643f9aee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:22.507442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:22.509381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:22.512567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:22.512567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:22.512567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:22.512567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:22.512567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 225/469] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:22.512567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1050b6-0386-45ee-98a0-b94643f9aee9 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:22.633439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 245/470] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:36:22 2022] POST /identity/v3/users => generated 248 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:36:22.634227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d290d2-7625-49e2-8e68-32d06698af79 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:22.688715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1050b6-0386-45ee-98a0-b94643f9aee9 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:22.727581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:22.734879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b6601-38fb-4fe5-a3a7-ded4d4554a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:22.735710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b6601-38fb-4fe5-a3a7-ded4d4554a7c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:22.735993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b6601-38fb-4fe5-a3a7-ded4d4554a7c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:22.736443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b6601-38fb-4fe5-a3a7-ded4d4554a7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:22.750228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b6601-38fb-4fe5-a3a7-ded4d4554a7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:22.751779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b6601-38fb-4fe5-a3a7-ded4d4554a7c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-887b6601-38fb-4fe5-a3a7-ded4d4554a7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:22.773133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:22.775250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:22.778190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:22.778190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:22.778190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:22.778190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:22.778190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 226/471] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:22.778190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d57f2-1ace-4ce3-aa20-3ec6990711ce None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:22.778190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d57f2-1ace-4ce3-aa20-3ec6990711ce None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:22.778190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d57f2-1ace-4ce3-aa20-3ec6990711ce None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:22.779507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 227/472] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:22.784650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d57f2-1ace-4ce3-aa20-3ec6990711ce None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:22.881050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d290d2-7625-49e2-8e68-32d06698af79 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:22.931427 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8d753-7d64-4c52-a73b-6dd7a9ec5e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:22.931736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8d753-7d64-4c52-a73b-6dd7a9ec5e79 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:22.931834 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d57f2-1ace-4ce3-aa20-3ec6990711ce None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:22.931989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8d753-7d64-4c52-a73b-6dd7a9ec5e79 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:22.932276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8d753-7d64-4c52-a73b-6dd7a9ec5e79 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:22.934046 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8d753-7d64-4c52-a73b-6dd7a9ec5e79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:22.934163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8d753-7d64-4c52-a73b-6dd7a9ec5e79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:22.935827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8d753-7d64-4c52-a73b-6dd7a9ec5e79 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:22.965494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 246/473] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:22.965494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c4a7-00ef-4199-bb2a-1440d57133e0 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:22.965494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c4a7-00ef-4199-bb2a-1440d57133e0 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:22.965494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c4a7-00ef-4199-bb2a-1440d57133e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:22.985590 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-5cf0c4a7-00ef-4199-bb2a-1440d57133e0 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:22.986565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edbae1-ec49-4e3f-ad67-3f5e9828acdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:22.987177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5cf0c4a7-00ef-4199-bb2a-1440d57133e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:22.987571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edbae1-ec49-4e3f-ad67-3f5e9828acdd None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:22.987988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edbae1-ec49-4e3f-ad67-3f5e9828acdd None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:22.988397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edbae1-ec49-4e3f-ad67-3f5e9828acdd None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:22.989288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edbae1-ec49-4e3f-ad67-3f5e9828acdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:22.989742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edbae1-ec49-4e3f-ad67-3f5e9828acdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:22.992413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edbae1-ec49-4e3f-ad67-3f5e9828acdd None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:23.008297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 228/474] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:36:23.009934 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edbae1-ec49-4e3f-ad67-3f5e9828acdd None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:23.087743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:23.143136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:23.143549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 247/475] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:23.152518 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c4a7-00ef-4199-bb2a-1440d57133e0 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:23.236890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edbae1-ec49-4e3f-ad67-3f5e9828acdd None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:23.281820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c796de8-b927-4b86-ba74-a3127ea05ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:23.282763 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c796de8-b927-4b86-ba74-a3127ea05ed9 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:23.285952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c796de8-b927-4b86-ba74-a3127ea05ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:23.286449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c796de8-b927-4b86-ba74-a3127ea05ed9 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:23.287368 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c796de8-b927-4b86-ba74-a3127ea05ed9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:23.289030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c796de8-b927-4b86-ba74-a3127ea05ed9 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:23.346906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c4a7-00ef-4199-bb2a-1440d57133e0 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:23.430569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab59c2-d06d-4926-ae35-6e1e999e3e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:23.432257 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab59c2-d06d-4926-ae35-6e1e999e3e60 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:23.433649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab59c2-d06d-4926-ae35-6e1e999e3e60 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:23.435789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab59c2-d06d-4926-ae35-6e1e999e3e60 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:23.436878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 229/476] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:36:23 2022] POST /identity/v3/users => generated 248 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:36:23.438640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab59c2-d06d-4926-ae35-6e1e999e3e60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:23.441957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c796de8-b927-4b86-ba74-a3127ea05ed9 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:23.442954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab59c2-d06d-4926-ae35-6e1e999e3e60 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:23.556273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 248/477] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:36:23 2022] POST /identity/v3/users => generated 249 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:36:23.693475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:23.698182 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c796de8-b927-4b86-ba74-a3127ea05ed9 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:23.759864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a39a8b-51b1-4f53-b88b-393d0451d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:23.761053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a39a8b-51b1-4f53-b88b-393d0451d838 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:23.762086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a39a8b-51b1-4f53-b88b-393d0451d838 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:23.762546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a39a8b-51b1-4f53-b88b-393d0451d838 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:23.764386 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a39a8b-51b1-4f53-b88b-393d0451d838 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:23.767948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a39a8b-51b1-4f53-b88b-393d0451d838 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:23.803852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.sql.core [None req-97a39a8b-51b1-4f53-b88b-393d0451d838 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 17:36:23.803852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 17:36:23.803852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [parameters: {'id': '4a9cb16928104adda2770fdc16ce377c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 17:36:23.803852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87026) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-97a39a8b-51b1-4f53-b88b-393d0451d838 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application conn.query(q) Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result.read() Jul 20 17:36:23.826660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return ref.to_dict() Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 17:36:23.827581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application next(self.gen) Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application yield resource Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application next(self.gen) Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise self.value Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application session.commit() Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 17:36:23.828541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.session.flush() Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application compat.raise_( Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 17:36:23.830714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 17:36:23.831996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application conn.query(q) Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result.read() Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 17:36:23.833068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [parameters: {'id': '4a9cb16928104adda2770fdc16ce377c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:23.835001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 17:36:23.837082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:23.842584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 230/478] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jul 20 17:36:23 2022] POST /identity/v3/roles => generated 144 bytes in 391 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:23.842750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab59c2-d06d-4926-ae35-6e1e999e3e60 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:23.881309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:23.976258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab59c2-d06d-4926-ae35-6e1e999e3e60 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:24.037873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a9045-c5b6-45bb-a3b0-7c4f9c679027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:24.038724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a9045-c5b6-45bb-a3b0-7c4f9c679027 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:24.039004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a9045-c5b6-45bb-a3b0-7c4f9c679027 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:24.039278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a9045-c5b6-45bb-a3b0-7c4f9c679027 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:24.063665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a9045-c5b6-45bb-a3b0-7c4f9c679027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-259a9045-c5b6-45bb-a3b0-7c4f9c679027 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:24.072155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:24.073160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:24.074009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:24.074009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:24.074009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:24.074009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:24.074009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:24.074009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:24.074009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:24.074009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:24.074009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:24.074009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:24.074009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 17:36:24.074009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:24.077984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 249/479] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:36:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:24.091533 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a39a8b-51b1-4f53-b88b-393d0451d838 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:24.351884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a39a8b-51b1-4f53-b88b-393d0451d838 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:24.476862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6353bf-de5e-42f8-aa97-2cc8c4213bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:24.478528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6353bf-de5e-42f8-aa97-2cc8c4213bb6 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:24.479321 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6353bf-de5e-42f8-aa97-2cc8c4213bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:24.480167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6353bf-de5e-42f8-aa97-2cc8c4213bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:24.481953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6353bf-de5e-42f8-aa97-2cc8c4213bb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:24.482765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6353bf-de5e-42f8-aa97-2cc8c4213bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:24.485767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6353bf-de5e-42f8-aa97-2cc8c4213bb6 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:24.506777 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 231/480] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:24.962310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8f0a-a036-4e0b-bcbe-82eaa1d02b51 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:24.963116 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8f0a-a036-4e0b-bcbe-82eaa1d02b51 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:24.963493 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8f0a-a036-4e0b-bcbe-82eaa1d02b51 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:24.967052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 250/481] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:24.973344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83942ea-737c-4958-8953-38a63e9ead7f None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:24.973847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83942ea-737c-4958-8953-38a63e9ead7f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:24.974342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83942ea-737c-4958-8953-38a63e9ead7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:25.012752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c83942ea-737c-4958-8953-38a63e9ead7f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:25.015414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c83942ea-737c-4958-8953-38a63e9ead7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:25.068620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:25.189290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 232/482] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:25.238686 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8f0a-a036-4e0b-bcbe-82eaa1d02b51 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:25.499910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:25.529805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8f0a-a036-4e0b-bcbe-82eaa1d02b51 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:25.607637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf162c24-4008-4b27-a30b-565d4bc0c11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:25.608467 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf162c24-4008-4b27-a30b-565d4bc0c11c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:25.608768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf162c24-4008-4b27-a30b-565d4bc0c11c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:25.609040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf162c24-4008-4b27-a30b-565d4bc0c11c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:25.627597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf162c24-4008-4b27-a30b-565d4bc0c11c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-cf162c24-4008-4b27-a30b-565d4bc0c11c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:25.635472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:25.637839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:25.639303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:25.639303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:25.639303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:25.639303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:25.639303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:25.639303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:25.639303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:25.639303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:25.639303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:25.639303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:25.639303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:25.639303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:25.641296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 251/483] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:25.647768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83942ea-737c-4958-8953-38a63e9ead7f None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:25.843064 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83942ea-737c-4958-8953-38a63e9ead7f None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:25.891273 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa2335-4543-41f2-b949-20c4eae17b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:25.891963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa2335-4543-41f2-b949-20c4eae17b7e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:25.892241 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa2335-4543-41f2-b949-20c4eae17b7e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:25.892514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa2335-4543-41f2-b949-20c4eae17b7e None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:25.893287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa2335-4543-41f2-b949-20c4eae17b7e None admin] RBAC: Adding query filter params (name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:25.893593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa2335-4543-41f2-b949-20c4eae17b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:25.895028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa2335-4543-41f2-b949-20c4eae17b7e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:25.910300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 233/484] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:25.916983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf162c24-4008-4b27-a30b-565d4bc0c11c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:26.030721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79381fe-c6ad-4305-ba21-5e88ed3e6892 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:26.031143 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79381fe-c6ad-4305-ba21-5e88ed3e6892 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:26.031294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79381fe-c6ad-4305-ba21-5e88ed3e6892 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:26.034411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 234/485] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:36:26.038947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d00b98-3153-4e6c-a22d-02c09469d2f7 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:26.039278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d00b98-3153-4e6c-a22d-02c09469d2f7 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:26.039512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d00b98-3153-4e6c-a22d-02c09469d2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:26.065627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-90d00b98-3153-4e6c-a22d-02c09469d2f7 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:26.068436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-90d00b98-3153-4e6c-a22d-02c09469d2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:26.103352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:26.161005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf162c24-4008-4b27-a30b-565d4bc0c11c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:26.215259 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 235/486] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:36:26.234695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b7bc9-55b4-4b36-9284-1fb92f6cdab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:26.236080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7bc9-55b4-4b36-9284-1fb92f6cdab9 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:26.236631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7bc9-55b4-4b36-9284-1fb92f6cdab9 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:26.237193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7bc9-55b4-4b36-9284-1fb92f6cdab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:26.267327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d00b98-3153-4e6c-a22d-02c09469d2f7 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:26.287149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b7bc9-55b4-4b36-9284-1fb92f6cdab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:26.290119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b7bc9-55b4-4b36-9284-1fb92f6cdab9 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-6c4b7bc9-55b4-4b36-9284-1fb92f6cdab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:26.333663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:26.335275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:26.337004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:26.337004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:26.337004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:26.337004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:26.337404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 252/487] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:36:26.348218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b7bc9-55b4-4b36-9284-1fb92f6cdab9 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:26.355126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:26.440273 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d00b98-3153-4e6c-a22d-02c09469d2f7 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:26.507695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a53dbd-68d9-4e13-9a93-14ea3dfba7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:26.509933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a53dbd-68d9-4e13-9a93-14ea3dfba7c8 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:26.515733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a53dbd-68d9-4e13-9a93-14ea3dfba7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:26.516664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a53dbd-68d9-4e13-9a93-14ea3dfba7c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:26.558655 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a53dbd-68d9-4e13-9a93-14ea3dfba7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-a6a53dbd-68d9-4e13-9a93-14ea3dfba7c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:26.589342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:26.592277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:26.593932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:26.593932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:26.593932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:26.593932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:26.593932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:26.593932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:26.593932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:26.593932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:26.593932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:26.593932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:26.593932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:26.593932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:26.612713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 236/488] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:36:26.618294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a53dbd-68d9-4e13-9a93-14ea3dfba7c8 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:26.649686 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b7bc9-55b4-4b36-9284-1fb92f6cdab9 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:26.669531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:26.734651 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3061167-7577-438d-a278-6c799d28d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:26.735341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3061167-7577-438d-a278-6c799d28d186 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:26.735628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3061167-7577-438d-a278-6c799d28d186 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:26.735908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3061167-7577-438d-a278-6c799d28d186 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:26.736928 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3061167-7577-438d-a278-6c799d28d186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:26.737241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3061167-7577-438d-a278-6c799d28d186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:26.739604 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3061167-7577-438d-a278-6c799d28d186 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:26.755403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 253/489] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:26.757859 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefc63a-8234-4c00-9742-a9e525f76624 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:26.758343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefc63a-8234-4c00-9742-a9e525f76624 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:26.758827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefc63a-8234-4c00-9742-a9e525f76624 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:26.766820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 254/490] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:26.766820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefc63a-8234-4c00-9742-a9e525f76624 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:26.843280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a53dbd-68d9-4e13-9a93-14ea3dfba7c8 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:26.888910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:26.911286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08607278-3aa4-462a-bd7c-9fadd81bd3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:26.912458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08607278-3aa4-462a-bd7c-9fadd81bd3c3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:26.913025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08607278-3aa4-462a-bd7c-9fadd81bd3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:26.913534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08607278-3aa4-462a-bd7c-9fadd81bd3c3 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:26.914998 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08607278-3aa4-462a-bd7c-9fadd81bd3c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:26.915661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08607278-3aa4-462a-bd7c-9fadd81bd3c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:26.918552 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08607278-3aa4-462a-bd7c-9fadd81bd3c3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:26.936005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 237/491] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:36:26.940024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3ac97-c898-424f-9e17-65c6ce41d6c9 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:26.940590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3ac97-c898-424f-9e17-65c6ce41d6c9 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:26.941116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3ac97-c898-424f-9e17-65c6ce41d6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:26.950851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefc63a-8234-4c00-9742-a9e525f76624 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:26.973036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d3d3ac97-c898-424f-9e17-65c6ce41d6c9 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:26.975255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d3d3ac97-c898-424f-9e17-65c6ce41d6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:27.025210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6c1d7-74d2-44cf-b219-3bd430e8b61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:27.026620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6c1d7-74d2-44cf-b219-3bd430e8b61d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:27.027659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6c1d7-74d2-44cf-b219-3bd430e8b61d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:27.028165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6c1d7-74d2-44cf-b219-3bd430e8b61d None admin] PATH_INFO: `/v3/users/nova` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:27.044890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6c1d7-74d2-44cf-b219-3bd430e8b61d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:27.047763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6c1d7-74d2-44cf-b219-3bd430e8b61d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-42f6c1d7-74d2-44cf-b219-3bd430e8b61d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:27.079951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:27.080937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:27.081829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:27.081829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:27.081829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:27.081829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:27.081829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:27.081829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:27.081829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:27.081829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:27.081829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:36:27.081829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:27.091571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 255/492] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 20 17:36:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:27.093302 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6c1d7-74d2-44cf-b219-3bd430e8b61d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:27.126572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 238/493] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:27.128179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3ac97-c898-424f-9e17-65c6ce41d6c9 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:27.132898 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:27.280896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3ac97-c898-424f-9e17-65c6ce41d6c9 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:27.294440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6c1d7-74d2-44cf-b219-3bd430e8b61d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:27.326703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded45b83-99a0-48fe-82a6-8250aef8f225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:27.327397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded45b83-99a0-48fe-82a6-8250aef8f225 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:27.328078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded45b83-99a0-48fe-82a6-8250aef8f225 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:27.328363 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded45b83-99a0-48fe-82a6-8250aef8f225 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:27.329286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded45b83-99a0-48fe-82a6-8250aef8f225 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:27.329601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded45b83-99a0-48fe-82a6-8250aef8f225 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:27.331104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded45b83-99a0-48fe-82a6-8250aef8f225 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:27.352953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:27.359713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b74b4-5b6b-4d09-990a-9244700e60dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:27.361267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b74b4-5b6b-4d09-990a-9244700e60dc None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:27.361855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b74b4-5b6b-4d09-990a-9244700e60dc None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:27.362447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b74b4-5b6b-4d09-990a-9244700e60dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:27.380277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b74b4-5b6b-4d09-990a-9244700e60dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:27.382236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b74b4-5b6b-4d09-990a-9244700e60dc None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:27.394866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 239/494] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 20 17:36:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:27.397232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded45b83-99a0-48fe-82a6-8250aef8f225 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-7a5b74b4-5b6b-4d09-990a-9244700e60dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:27.412920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:27.413867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:27.415026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:27.415026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:27.415026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:27.415026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:27.415026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 256/495] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:27.416394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209f13a-331d-4b7d-b53b-f546d7fe19f5 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:27.416736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209f13a-331d-4b7d-b53b-f546d7fe19f5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:27.417004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209f13a-331d-4b7d-b53b-f546d7fe19f5 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:27.423840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 257/496] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:27.423840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209f13a-331d-4b7d-b53b-f546d7fe19f5 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:27.507770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:27.548200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209f13a-331d-4b7d-b53b-f546d7fe19f5 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:27.566613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded45b83-99a0-48fe-82a6-8250aef8f225 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:27.592141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bff90f-2e79-4e5d-adae-74d6b627593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:27.593693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bff90f-2e79-4e5d-adae-74d6b627593a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:27.594133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bff90f-2e79-4e5d-adae-74d6b627593a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:27.594573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bff90f-2e79-4e5d-adae-74d6b627593a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:27.610612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f33069-d98c-452a-b23a-a04261729d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:27.611433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f33069-d98c-452a-b23a-a04261729d61 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:27.611710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f33069-d98c-452a-b23a-a04261729d61 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:27.611983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f33069-d98c-452a-b23a-a04261729d61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:27.625952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f33069-d98c-452a-b23a-a04261729d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-02f33069-d98c-452a-b23a-a04261729d61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:27.634019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:27.635120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:27.636026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:27.636026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:27.636026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:27.636026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:27.636026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:27.636026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:27.636026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:27.636026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:27.636026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:27.636026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:27.636026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:27.636026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:27.640924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 240/497] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:27.641993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f33069-d98c-452a-b23a-a04261729d61 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:27.662094 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:27.706298 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bff90f-2e79-4e5d-adae-74d6b627593a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:27.709168 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bff90f-2e79-4e5d-adae-74d6b627593a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:27.771954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f33069-d98c-452a-b23a-a04261729d61 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:27.800248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:27.829067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e2223-6f45-486f-b258-c624e981a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:27.830122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e2223-6f45-486f-b258-c624e981a455 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:27.830571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e2223-6f45-486f-b258-c624e981a455 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:27.831026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e2223-6f45-486f-b258-c624e981a455 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:27.832283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e2223-6f45-486f-b258-c624e981a455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:27.832783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e2223-6f45-486f-b258-c624e981a455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:27.835256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e2223-6f45-486f-b258-c624e981a455 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:27.853451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 258/498] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:27.855508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fddde6-9ebc-43ca-8de9-7eb9744d357d None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:27.855964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fddde6-9ebc-43ca-8de9-7eb9744d357d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:27.856420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fddde6-9ebc-43ca-8de9-7eb9744d357d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:27.857660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 241/499] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:27.858887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e2223-6f45-486f-b258-c624e981a455 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:27.882095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-60fddde6-9ebc-43ca-8de9-7eb9744d357d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:27.883500 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-60fddde6-9ebc-43ca-8de9-7eb9744d357d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:27.987272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 259/500] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:27.989682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1df888-a0f3-411a-8785-ef0b50f14d5b None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:27.990204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1df888-a0f3-411a-8785-ef0b50f14d5b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:27.990706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1df888-a0f3-411a-8785-ef0b50f14d5b None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:27.996726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e2223-6f45-486f-b258-c624e981a455 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:27.996930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 260/501] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:27.996930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1df888-a0f3-411a-8785-ef0b50f14d5b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:28.013396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:28.036446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985af002-8527-4c55-98ea-686f8202a93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:28.037245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985af002-8527-4c55-98ea-686f8202a93e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:28.037530 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985af002-8527-4c55-98ea-686f8202a93e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:28.037814 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985af002-8527-4c55-98ea-686f8202a93e None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:28.038584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985af002-8527-4c55-98ea-686f8202a93e None admin] RBAC: Adding query filter params (name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:28.038898 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985af002-8527-4c55-98ea-686f8202a93e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:28.040329 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985af002-8527-4c55-98ea-686f8202a93e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:28.050952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 242/502] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:28.052367 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985af002-8527-4c55-98ea-686f8202a93e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:28.118263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:28.162741 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1df888-a0f3-411a-8785-ef0b50f14d5b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:28.222498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985af002-8527-4c55-98ea-686f8202a93e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:28.225757 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe9323-4495-4a42-ab6d-4e96de799c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:28.227123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe9323-4495-4a42-ab6d-4e96de799c34 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:28.227615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe9323-4495-4a42-ab6d-4e96de799c34 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:28.228083 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe9323-4495-4a42-ab6d-4e96de799c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:28.248527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe9323-4495-4a42-ab6d-4e96de799c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:28.251426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe9323-4495-4a42-ab6d-4e96de799c34 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-4abe9323-4495-4a42-ab6d-4e96de799c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:28.285299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:28.286378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:28.287305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:28.287305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:28.287305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:28.287305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:28.287550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19355c3e-e421-4efb-8731-839d4239f755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:28.287984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 261/503] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:28.288244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19355c3e-e421-4efb-8731-839d4239f755 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:28.288785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19355c3e-e421-4efb-8731-839d4239f755 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:28.289293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19355c3e-e421-4efb-8731-839d4239f755 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:28.289844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4dfa-a26f-41a9-bf45-90b33f8e6216 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:28.290404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4dfa-a26f-41a9-bf45-90b33f8e6216 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:28.290836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4dfa-a26f-41a9-bf45-90b33f8e6216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:28.304441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19355c3e-e421-4efb-8731-839d4239f755 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:28.307202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19355c3e-e421-4efb-8731-839d4239f755 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:28.321005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-546a4dfa-a26f-41a9-bf45-90b33f8e6216 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:28.323026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-546a4dfa-a26f-41a9-bf45-90b33f8e6216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-19355c3e-e421-4efb-8731-839d4239f755 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:28.338923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:28.339972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:28.340897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:28.340897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:28.340897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:28.340897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:28.340897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:28.340897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:28.340897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:28.340897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:28.340897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 17:36:28.340897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:28.346875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 243/504] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:28.346875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19355c3e-e421-4efb-8731-839d4239f755 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:28.416308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:28.431076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 262/505] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:28.431959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4dfa-a26f-41a9-bf45-90b33f8e6216 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:28.501896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:28.505355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19355c3e-e421-4efb-8731-839d4239f755 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:28.546697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51fde3-3746-4e7e-94d7-ea04597a173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:28.547487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51fde3-3746-4e7e-94d7-ea04597a173b None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:28.547766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51fde3-3746-4e7e-94d7-ea04597a173b None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:28.548035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51fde3-3746-4e7e-94d7-ea04597a173b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:28.559518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51fde3-3746-4e7e-94d7-ea04597a173b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:28.560961 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51fde3-3746-4e7e-94d7-ea04597a173b None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:28.564057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4dfa-a26f-41a9-bf45-90b33f8e6216 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-4c51fde3-3746-4e7e-94d7-ea04597a173b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:28.580093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:28.581939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:28.584111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:28.584111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:28.584111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:28.584111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:28.584111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 244/506] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:28.584111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51fde3-3746-4e7e-94d7-ea04597a173b None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:28.611466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8813b0-578a-489f-b22f-f8dbe25799ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:28.612541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8813b0-578a-489f-b22f-f8dbe25799ef None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:28.612940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8813b0-578a-489f-b22f-f8dbe25799ef None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:28.613453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8813b0-578a-489f-b22f-f8dbe25799ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:28.627654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8813b0-578a-489f-b22f-f8dbe25799ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:28.629332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8813b0-578a-489f-b22f-f8dbe25799ef None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-4d8813b0-578a-489f-b22f-f8dbe25799ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:28.648989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:28.650560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:28.651527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:28.651527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:28.651527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:28.651527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:28.651527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 263/507] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:28.651527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8813b0-578a-489f-b22f-f8dbe25799ef None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:28.709663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:28.735054 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51fde3-3746-4e7e-94d7-ea04597a173b None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:28.772469 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a691ae-c46b-4b3f-a6c8-6640a1ce826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:28.773169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a691ae-c46b-4b3f-a6c8-6640a1ce826e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:28.773455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a691ae-c46b-4b3f-a6c8-6640a1ce826e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:28.773747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a691ae-c46b-4b3f-a6c8-6640a1ce826e None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:28.774473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a691ae-c46b-4b3f-a6c8-6640a1ce826e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:28.774780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a691ae-c46b-4b3f-a6c8-6640a1ce826e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:28.776255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a691ae-c46b-4b3f-a6c8-6640a1ce826e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:28.789498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 245/508] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:28.790368 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a691ae-c46b-4b3f-a6c8-6640a1ce826e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:28.795956 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8813b0-578a-489f-b22f-f8dbe25799ef None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:28.807300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:28.840591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1a0b4-01bd-49c9-9647-737ea32fe4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:28.841379 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1a0b4-01bd-49c9-9647-737ea32fe4cf None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:28.841954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1a0b4-01bd-49c9-9647-737ea32fe4cf None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:28.842313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1a0b4-01bd-49c9-9647-737ea32fe4cf None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:28.843239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1a0b4-01bd-49c9-9647-737ea32fe4cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:28.843615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1a0b4-01bd-49c9-9647-737ea32fe4cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:28.845488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1a0b4-01bd-49c9-9647-737ea32fe4cf None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:28.893976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 264/509] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jul 20 17:36:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:28.893976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1a0b4-01bd-49c9-9647-737ea32fe4cf None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:28.918669 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a691ae-c46b-4b3f-a6c8-6640a1ce826e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:28.959742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc34d3-4ebb-45eb-8ca9-e7390bfdc34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:28.960789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc34d3-4ebb-45eb-8ca9-e7390bfdc34e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:28.961226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc34d3-4ebb-45eb-8ca9-e7390bfdc34e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:28.961627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc34d3-4ebb-45eb-8ca9-e7390bfdc34e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:28.975018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc34d3-4ebb-45eb-8ca9-e7390bfdc34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-3ecc34d3-4ebb-45eb-8ca9-e7390bfdc34e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:28.984193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:28.985886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 246/510] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:28.987427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc34d3-4ebb-45eb-8ca9-e7390bfdc34e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:29.016292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:29.020371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1a0b4-01bd-49c9-9647-737ea32fe4cf None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:29.058940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbacacf-8a62-4ede-a228-cd1af27d7642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:29.059977 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbacacf-8a62-4ede-a228-cd1af27d7642 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:29.060429 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbacacf-8a62-4ede-a228-cd1af27d7642 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:29.060807 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbacacf-8a62-4ede-a228-cd1af27d7642 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:29.061802 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbacacf-8a62-4ede-a228-cd1af27d7642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:29.062230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbacacf-8a62-4ede-a228-cd1af27d7642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:29.063978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbacacf-8a62-4ede-a228-cd1af27d7642 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:29.083934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 265/511] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:29.085166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbacacf-8a62-4ede-a228-cd1af27d7642 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:29.105924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:29.140924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc34d3-4ebb-45eb-8ca9-e7390bfdc34e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:29.187560 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fbaae-14cd-4920-bd6e-ae4765c97d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:29.188412 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fbaae-14cd-4920-bd6e-ae4765c97d6c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:29.188847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fbaae-14cd-4920-bd6e-ae4765c97d6c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:29.189165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fbaae-14cd-4920-bd6e-ae4765c97d6c None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:29.189959 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fbaae-14cd-4920-bd6e-ae4765c97d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:29.190306 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fbaae-14cd-4920-bd6e-ae4765c97d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:29.191989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fbaae-14cd-4920-bd6e-ae4765c97d6c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:29.206586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 247/512] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:29.207645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fbaae-14cd-4920-bd6e-ae4765c97d6c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:29.218936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbacacf-8a62-4ede-a228-cd1af27d7642 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:29.265518 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7994-4f53-45c6-b589-cfa6171c594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:29.266326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7994-4f53-45c6-b589-cfa6171c594c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:29.266675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7994-4f53-45c6-b589-cfa6171c594c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:29.267034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7994-4f53-45c6-b589-cfa6171c594c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:29.274642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da7994-4f53-45c6-b589-cfa6171c594c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:29.276157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da7994-4f53-45c6-b589-cfa6171c594c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-44da7994-4f53-45c6-b589-cfa6171c594c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:29.295428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:29.297304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:29.299854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:29.299854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:29.299854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:29.299854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:29.299854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:29.299854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:29.299854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:29.299854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:29.299854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 266/513] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:29.299854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7994-4f53-45c6-b589-cfa6171c594c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:29.328107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:29.346782 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fbaae-14cd-4920-bd6e-ae4765c97d6c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:29.404443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:29.413111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1824705-678c-4bb8-a130-d766db077a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:29.414215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1824705-678c-4bb8-a130-d766db077a38 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:29.414984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1824705-678c-4bb8-a130-d766db077a38 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:29.415463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1824705-678c-4bb8-a130-d766db077a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:29.446612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7994-4f53-45c6-b589-cfa6171c594c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:29.485357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a7ffc-dc26-49fd-bdd4-1615f38888f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:29.486030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a7ffc-dc26-49fd-bdd4-1615f38888f0 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:29.486318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a7ffc-dc26-49fd-bdd4-1615f38888f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:29.486590 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a7ffc-dc26-49fd-bdd4-1615f38888f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:29.487341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a7ffc-dc26-49fd-bdd4-1615f38888f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:29.487647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a7ffc-dc26-49fd-bdd4-1615f38888f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:29.489077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a7ffc-dc26-49fd-bdd4-1615f38888f0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:29.498061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 267/514] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:29.498905 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a7ffc-dc26-49fd-bdd4-1615f38888f0 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:29.534803 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1824705-678c-4bb8-a130-d766db077a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:29.536458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1824705-678c-4bb8-a130-d766db077a38 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:29.603846 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:29.624254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a7ffc-dc26-49fd-bdd4-1615f38888f0 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:29.667532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20ea8c-f3bd-4ab4-adba-914d7e252209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:29.668411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 248/515] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:29.668603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20ea8c-f3bd-4ab4-adba-914d7e252209 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:29.673463 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20ea8c-f3bd-4ab4-adba-914d7e252209 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:29.673463 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20ea8c-f3bd-4ab4-adba-914d7e252209 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:29.673690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1824705-678c-4bb8-a130-d766db077a38 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:29.673803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20ea8c-f3bd-4ab4-adba-914d7e252209 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:29.673803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20ea8c-f3bd-4ab4-adba-914d7e252209 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:29.711155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:29.787610 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1824705-678c-4bb8-a130-d766db077a38 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:29.824992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f61d2-6c86-4697-8df6-91a638d314f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:29.826104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f61d2-6c86-4697-8df6-91a638d314f4 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:29.826429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f61d2-6c86-4697-8df6-91a638d314f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:29.826774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f61d2-6c86-4697-8df6-91a638d314f4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:29.835394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f61d2-6c86-4697-8df6-91a638d314f4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:29.836977 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f61d2-6c86-4697-8df6-91a638d314f4 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:29.845309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 268/516] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:36:29 2022] POST /identity/v3/users => generated 247 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:36:29.850455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20ea8c-f3bd-4ab4-adba-914d7e252209 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-6d7f61d2-6c86-4697-8df6-91a638d314f4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:29.862414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:29.863473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:29.865134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:29.865134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:29.865134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:29.865134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:29.865134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:29.865134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:29.865134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:29.865134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:29.865134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 17:36:29.865134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:29.865134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 249/517] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:29.866224 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f61d2-6c86-4697-8df6-91a638d314f4 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:30.013413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:30.025224 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f61d2-6c86-4697-8df6-91a638d314f4 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:30.038583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20ea8c-f3bd-4ab4-adba-914d7e252209 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:30.072968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efae02-5562-46f9-86ed-a24bda337cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:30.073778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efae02-5562-46f9-86ed-a24bda337cb8 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:30.074106 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efae02-5562-46f9-86ed-a24bda337cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:30.074359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efae02-5562-46f9-86ed-a24bda337cb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:30.088993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efae02-5562-46f9-86ed-a24bda337cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:30.091051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efae02-5562-46f9-86ed-a24bda337cb8 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:30.109572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c3f98-7f9c-4a3b-90d4-7cb0ee121830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:30.110316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c3f98-7f9c-4a3b-90d4-7cb0ee121830 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:30.110598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c3f98-7f9c-4a3b-90d4-7cb0ee121830 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:30.110871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c3f98-7f9c-4a3b-90d4-7cb0ee121830 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:30.111704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c3f98-7f9c-4a3b-90d4-7cb0ee121830 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:30.112005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c3f98-7f9c-4a3b-90d4-7cb0ee121830 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:30.113559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c3f98-7f9c-4a3b-90d4-7cb0ee121830 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-b7efae02-5562-46f9-86ed-a24bda337cb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:30.118050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:30.119869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:30.122293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:30.122293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:30.122293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:30.122293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:30.122293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 250/518] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:30.122293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efae02-5562-46f9-86ed-a24bda337cb8 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:30.134019 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:30.139347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 269/519] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:30.140251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c3f98-7f9c-4a3b-90d4-7cb0ee121830 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:30.310065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efae02-5562-46f9-86ed-a24bda337cb8 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:30.314195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c3f98-7f9c-4a3b-90d4-7cb0ee121830 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:30.364543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feed4a-f333-4d40-9edd-c505632eb67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:30.365917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feed4a-f333-4d40-9edd-c505632eb67a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:30.366480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feed4a-f333-4d40-9edd-c505632eb67a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:30.367103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feed4a-f333-4d40-9edd-c505632eb67a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:30.385393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6631b4-e1e2-48f6-976a-dada013935da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:30.387007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6631b4-e1e2-48f6-976a-dada013935da None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:30.387188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feed4a-f333-4d40-9edd-c505632eb67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:30.387449 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6631b4-e1e2-48f6-976a-dada013935da None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:30.387901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6631b4-e1e2-48f6-976a-dada013935da None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:30.391754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6631b4-e1e2-48f6-976a-dada013935da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:30.391933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feed4a-f333-4d40-9edd-c505632eb67a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:30.392012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6631b4-e1e2-48f6-976a-dada013935da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:30.394781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6631b4-e1e2-48f6-976a-dada013935da None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:30.406245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:30.431916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 270/520] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Jul 20 17:36:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:30.431916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6631b4-e1e2-48f6-976a-dada013935da None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-00feed4a-f333-4d40-9edd-c505632eb67a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:30.432195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:30.433022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:30.434416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:30.434416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:30.434416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:30.434416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:30.434416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 251/521] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:30.434731 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feed4a-f333-4d40-9edd-c505632eb67a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:30.541086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:30.614211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6631b4-e1e2-48f6-976a-dada013935da None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:30.631341 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feed4a-f333-4d40-9edd-c505632eb67a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:30.677510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2150e8-6da0-400f-847e-b3318fb380ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:30.678477 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2150e8-6da0-400f-847e-b3318fb380ca None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:30.678921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2150e8-6da0-400f-847e-b3318fb380ca None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:30.679367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2150e8-6da0-400f-847e-b3318fb380ca None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:30.680609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2150e8-6da0-400f-847e-b3318fb380ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:30.681129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2150e8-6da0-400f-847e-b3318fb380ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:30.683143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2150e8-6da0-400f-847e-b3318fb380ca None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:30.696592 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145122d-6101-4a73-8c1b-14d54c6d1a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:30.697665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145122d-6101-4a73-8c1b-14d54c6d1a13 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:30.698127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145122d-6101-4a73-8c1b-14d54c6d1a13 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:30.698576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145122d-6101-4a73-8c1b-14d54c6d1a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:30.700173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145122d-6101-4a73-8c1b-14d54c6d1a13 None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=3b52e88df44d49b186d54a8d045595ed) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:30.701381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145122d-6101-4a73-8c1b-14d54c6d1a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:30.703874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145122d-6101-4a73-8c1b-14d54c6d1a13 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:30.713863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 271/522] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:30.713863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2150e8-6da0-400f-847e-b3318fb380ca None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:30.723561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 252/523] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:36:30 2022] GET /identity/v3/role_assignments?user.id=3b52e88df44d49b186d54a8d045595ed&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:30.724858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145122d-6101-4a73-8c1b-14d54c6d1a13 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:30.875104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:30.903243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2150e8-6da0-400f-847e-b3318fb380ca None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:30.930813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:30.968638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22249e5-61a2-472b-85b7-395943c4e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:30.971640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22249e5-61a2-472b-85b7-395943c4e155 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:30.971640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22249e5-61a2-472b-85b7-395943c4e155 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:30.971640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22249e5-61a2-472b-85b7-395943c4e155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:30.972174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145122d-6101-4a73-8c1b-14d54c6d1a13 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:31.033755 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c550a5d-4ac1-4cdd-8e5c-dece265d0474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:31.034874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c550a5d-4ac1-4cdd-8e5c-dece265d0474 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:31.035332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c550a5d-4ac1-4cdd-8e5c-dece265d0474 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:31.035776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c550a5d-4ac1-4cdd-8e5c-dece265d0474 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:31.037073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c550a5d-4ac1-4cdd-8e5c-dece265d0474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:31.037571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c550a5d-4ac1-4cdd-8e5c-dece265d0474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:31.039994 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c550a5d-4ac1-4cdd-8e5c-dece265d0474 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:31.062159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 253/524] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:31.063647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c550a5d-4ac1-4cdd-8e5c-dece265d0474 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:31.097076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22249e5-61a2-472b-85b7-395943c4e155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:31.099675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22249e5-61a2-472b-85b7-395943c4e155 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:31.245387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c550a5d-4ac1-4cdd-8e5c-dece265d0474 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:31.280996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 272/525] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:31.282851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22249e5-61a2-472b-85b7-395943c4e155 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:31.283461 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:31.309189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebb265-6608-41eb-8580-2cf9926d293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:31.310966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebb265-6608-41eb-8580-2cf9926d293a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:31.311617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebb265-6608-41eb-8580-2cf9926d293a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:31.312257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebb265-6608-41eb-8580-2cf9926d293a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:31.327589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebb265-6608-41eb-8580-2cf9926d293a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:31.330561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebb265-6608-41eb-8580-2cf9926d293a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:31.332892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-69ebb265-6608-41eb-8580-2cf9926d293a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:31.359955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:31.362051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:31.364069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:31.364069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:31.364069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:31.364069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:31.364069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:31.364069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:31.364069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:31.364069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:31.364069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 17:36:31.364069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:31.368557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 254/526] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:31.370201 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebb265-6608-41eb-8580-2cf9926d293a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:31.475709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22249e5-61a2-472b-85b7-395943c4e155 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:31.536732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302101e-b6d2-4a30-bcdf-d01379c3cf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:31.537593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302101e-b6d2-4a30-bcdf-d01379c3cf3b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:31.538166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302101e-b6d2-4a30-bcdf-d01379c3cf3b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:31.538734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302101e-b6d2-4a30-bcdf-d01379c3cf3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:31.551864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302101e-b6d2-4a30-bcdf-d01379c3cf3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:31.554993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302101e-b6d2-4a30-bcdf-d01379c3cf3b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:31.560174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebb265-6608-41eb-8580-2cf9926d293a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-e302101e-b6d2-4a30-bcdf-d01379c3cf3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:31.581700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:31.583391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:31.585071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:31.585071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:31.585071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:31.585071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:31.585071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:31.585071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:31.585071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:31.585071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:31.585071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 273/527] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:31.585966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302101e-b6d2-4a30-bcdf-d01379c3cf3b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:31.629504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639a972-aed1-456c-9281-56d366338365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:31.631156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639a972-aed1-456c-9281-56d366338365 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:31.631854 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639a972-aed1-456c-9281-56d366338365 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:31.632613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639a972-aed1-456c-9281-56d366338365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:31.653897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639a972-aed1-456c-9281-56d366338365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:31.657039 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639a972-aed1-456c-9281-56d366338365 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-3639a972-aed1-456c-9281-56d366338365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:31.690168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:31.691849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:31.693554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:31.693554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:31.693554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:31.693554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:31.696885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 255/528] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:31.698528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639a972-aed1-456c-9281-56d366338365 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:31.752818 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:31.755274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:31.773146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302101e-b6d2-4a30-bcdf-d01379c3cf3b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:31.834068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc158-ec3a-46be-965a-6cb6291ca49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:31.835122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc158-ec3a-46be-965a-6cb6291ca49b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:31.835667 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc158-ec3a-46be-965a-6cb6291ca49b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:31.836200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc158-ec3a-46be-965a-6cb6291ca49b None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:31.837820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dc158-ec3a-46be-965a-6cb6291ca49b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:31.838476 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dc158-ec3a-46be-965a-6cb6291ca49b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:31.841218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dc158-ec3a-46be-965a-6cb6291ca49b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:31.875374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 274/529] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jul 20 17:36:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:31.876960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc158-ec3a-46be-965a-6cb6291ca49b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:31.886181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639a972-aed1-456c-9281-56d366338365 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:31.951108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85e417-4341-4a43-87d8-f4ee05b18cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:31.952564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85e417-4341-4a43-87d8-f4ee05b18cb7 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:31.953256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85e417-4341-4a43-87d8-f4ee05b18cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:31.954025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85e417-4341-4a43-87d8-f4ee05b18cb7 None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:31.955446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85e417-4341-4a43-87d8-f4ee05b18cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:31.956227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85e417-4341-4a43-87d8-f4ee05b18cb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:31.959084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85e417-4341-4a43-87d8-f4ee05b18cb7 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:31.993132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 256/530] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:31.995115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85e417-4341-4a43-87d8-f4ee05b18cb7 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:32.065203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc158-ec3a-46be-965a-6cb6291ca49b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:32.134381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ba7c6-9e65-4fd2-badd-b7d47b72938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:32.135367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ba7c6-9e65-4fd2-badd-b7d47b72938a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:32.135844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ba7c6-9e65-4fd2-badd-b7d47b72938a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:32.136315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ba7c6-9e65-4fd2-badd-b7d47b72938a None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:32.138241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ba7c6-9e65-4fd2-badd-b7d47b72938a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:32.138761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ba7c6-9e65-4fd2-badd-b7d47b72938a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:32.141278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ba7c6-9e65-4fd2-badd-b7d47b72938a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:32.154501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:32.164528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 275/531] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:32.166355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ba7c6-9e65-4fd2-badd-b7d47b72938a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:32.176330 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:32.189179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85e417-4341-4a43-87d8-f4ee05b18cb7 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:32.235696 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a6bc0-0676-449b-8c3c-27e021a6648c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:32.236390 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a6bc0-0676-449b-8c3c-27e021a6648c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:32.236705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a6bc0-0676-449b-8c3c-27e021a6648c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:32.236992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a6bc0-0676-449b-8c3c-27e021a6648c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:32.319776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a6bc0-0676-449b-8c3c-27e021a6648c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:32.321438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a6bc0-0676-449b-8c3c-27e021a6648c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:32.336181 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ba7c6-9e65-4fd2-badd-b7d47b72938a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:32.386013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d9d5-cd2f-4cd6-9f4c-492c28edcace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:32.387605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d9d5-cd2f-4cd6-9f4c-492c28edcace None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:32.387906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d9d5-cd2f-4cd6-9f4c-492c28edcace None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:32.388200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d9d5-cd2f-4cd6-9f4c-492c28edcace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:32.393061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3d9d5-cd2f-4cd6-9f4c-492c28edcace None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=259d506eb54e4766a8fe3fa5bb514e89) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:32.393061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3d9d5-cd2f-4cd6-9f4c-492c28edcace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:32.393061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3d9d5-cd2f-4cd6-9f4c-492c28edcace None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:32.412519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 276/532] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:36:32 2022] GET /identity/v3/role_assignments?user.id=259d506eb54e4766a8fe3fa5bb514e89&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:32.412519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d9d5-cd2f-4cd6-9f4c-492c28edcace None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:32.479253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:32.483015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:32.500447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 257/533] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:32.502857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284851f-4d18-4a7a-98db-f29953167596 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:32.503339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284851f-4d18-4a7a-98db-f29953167596 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:32.503811 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284851f-4d18-4a7a-98db-f29953167596 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:32.506802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 258/534] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:32.514298 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284851f-4d18-4a7a-98db-f29953167596 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:32.557767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d9d5-cd2f-4cd6-9f4c-492c28edcace None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:32.613533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6dc966-3f56-4190-8292-d51f59627992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:32.614729 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dc966-3f56-4190-8292-d51f59627992 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:32.615217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dc966-3f56-4190-8292-d51f59627992 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:32.615709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dc966-3f56-4190-8292-d51f59627992 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:32.624567 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6dc966-3f56-4190-8292-d51f59627992 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:32.626509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6dc966-3f56-4190-8292-d51f59627992 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-8f6dc966-3f56-4190-8292-d51f59627992 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:32.643053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:32.643934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:32.644890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:32.644890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:32.644890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:32.644890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:32.644890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:32.644890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:32.644890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:32.644890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:32.647511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 277/535] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:32.649269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c7553-5e7a-47af-b2dd-c7066dd23ec4 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:32.649766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c7553-5e7a-47af-b2dd-c7066dd23ec4 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:32.650235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c7553-5e7a-47af-b2dd-c7066dd23ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:32.669814 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-493c7553-5e7a-47af-b2dd-c7066dd23ec4 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:32.671436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-493c7553-5e7a-47af-b2dd-c7066dd23ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:32.704094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284851f-4d18-4a7a-98db-f29953167596 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:32.754732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 278/536] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:32.755958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c7553-5e7a-47af-b2dd-c7066dd23ec4 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:32.797244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac08d1-677f-44e6-b97e-c4a86c6c8ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:32.798667 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac08d1-677f-44e6-b97e-c4a86c6c8ecf None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:32.799234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac08d1-677f-44e6-b97e-c4a86c6c8ecf None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:32.799727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac08d1-677f-44e6-b97e-c4a86c6c8ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:32.812342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:32.841130 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac08d1-677f-44e6-b97e-c4a86c6c8ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:32.844089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac08d1-677f-44e6-b97e-c4a86c6c8ecf None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:32.876497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c7553-5e7a-47af-b2dd-c7066dd23ec4 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-c3ac08d1-677f-44e6-b97e-c4a86c6c8ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:32.886288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:32.887372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:32.888222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:32.888222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:32.888222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:32.888222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:32.889086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 259/537] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:32.890687 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac08d1-677f-44e6-b97e-c4a86c6c8ecf None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:32.921261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba9eac-fc30-4840-94e3-a334e5e54f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:32.922478 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba9eac-fc30-4840-94e3-a334e5e54f93 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:32.922984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba9eac-fc30-4840-94e3-a334e5e54f93 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:32.923576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba9eac-fc30-4840-94e3-a334e5e54f93 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:32.924638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba9eac-fc30-4840-94e3-a334e5e54f93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:32.925157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba9eac-fc30-4840-94e3-a334e5e54f93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:32.926883 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba9eac-fc30-4840-94e3-a334e5e54f93 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:32.941713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 279/538] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:32.942909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba9eac-fc30-4840-94e3-a334e5e54f93 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:32.987350 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:33.059445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba9eac-fc30-4840-94e3-a334e5e54f93 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:33.068173 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:33.097715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac08d1-677f-44e6-b97e-c4a86c6c8ecf None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:33.101732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe132aae-13d5-40f6-b83c-01e25a2e31d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:33.102963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe132aae-13d5-40f6-b83c-01e25a2e31d8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:33.103503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe132aae-13d5-40f6-b83c-01e25a2e31d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:33.104026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe132aae-13d5-40f6-b83c-01e25a2e31d8 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:33.105092 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe132aae-13d5-40f6-b83c-01e25a2e31d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:33.105650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe132aae-13d5-40f6-b83c-01e25a2e31d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:33.107358 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe132aae-13d5-40f6-b83c-01e25a2e31d8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:33.122650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 280/539] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:33.123929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe132aae-13d5-40f6-b83c-01e25a2e31d8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:33.174820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76cb1d-7259-4cf2-bcac-c1c920499788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:33.176044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76cb1d-7259-4cf2-bcac-c1c920499788 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:33.176569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76cb1d-7259-4cf2-bcac-c1c920499788 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:33.177078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76cb1d-7259-4cf2-bcac-c1c920499788 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:33.194615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76cb1d-7259-4cf2-bcac-c1c920499788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-1d76cb1d-7259-4cf2-bcac-c1c920499788 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:33.205980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:33.206943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:33.207773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:33.207773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:33.207773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:33.207773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:33.207773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:33.207773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:33.207773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:33.207773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:33.207773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:33.207773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:33.207773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:33.207773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:33.210585 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 260/540] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:33.211702 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76cb1d-7259-4cf2-bcac-c1c920499788 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:33.329880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe132aae-13d5-40f6-b83c-01e25a2e31d8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:33.380559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f47d-36eb-4099-9579-9139f73e0643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:33.381597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f47d-36eb-4099-9579-9139f73e0643 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:33.382078 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f47d-36eb-4099-9579-9139f73e0643 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:33.382576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306f47d-36eb-4099-9579-9139f73e0643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:33.383625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306f47d-36eb-4099-9579-9139f73e0643 None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=11930f08a1324902a083436649660130) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:33.384149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306f47d-36eb-4099-9579-9139f73e0643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:33.385851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306f47d-36eb-4099-9579-9139f73e0643 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:33.401209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76cb1d-7259-4cf2-bcac-c1c920499788 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:33.403548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 281/541] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:36:33 2022] GET /identity/v3/role_assignments?user.id=11930f08a1324902a083436649660130&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:33.406820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:33.410332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f47d-36eb-4099-9579-9139f73e0643 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:33.550735 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7200b-48fc-400f-8335-dd35339645a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:33.551982 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:33.556052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7200b-48fc-400f-8335-dd35339645a7 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:33.558340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7200b-48fc-400f-8335-dd35339645a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:33.559026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7200b-48fc-400f-8335-dd35339645a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:33.576529 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7200b-48fc-400f-8335-dd35339645a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:33.580216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7200b-48fc-400f-8335-dd35339645a7 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-48a7200b-48fc-400f-8335-dd35339645a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:33.619454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:33.620540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:33.621968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:33.621968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:33.621968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:33.621968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:33.621968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:33.621968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:33.621968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:33.621968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:33.625039 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 261/542] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:33.634089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7200b-48fc-400f-8335-dd35339645a7 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:33.700285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306f47d-36eb-4099-9579-9139f73e0643 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:33.774736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff68359-78a8-4cd7-afc8-fc435c11d4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:33.775433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68359-78a8-4cd7-afc8-fc435c11d4d0 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:33.775718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68359-78a8-4cd7-afc8-fc435c11d4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:33.775989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff68359-78a8-4cd7-afc8-fc435c11d4d0 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:33.776785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff68359-78a8-4cd7-afc8-fc435c11d4d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:33.777098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff68359-78a8-4cd7-afc8-fc435c11d4d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:33.779406 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff68359-78a8-4cd7-afc8-fc435c11d4d0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:33.796455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 282/543] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:33.802064 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff68359-78a8-4cd7-afc8-fc435c11d4d0 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:33.838132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7200b-48fc-400f-8335-dd35339645a7 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:33.899773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f894a5-0f2b-407b-aab3-d07d7266c795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:33.901518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f894a5-0f2b-407b-aab3-d07d7266c795 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:33.903274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f894a5-0f2b-407b-aab3-d07d7266c795 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:33.903907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f894a5-0f2b-407b-aab3-d07d7266c795 None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:33.905466 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f894a5-0f2b-407b-aab3-d07d7266c795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:33.906057 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f894a5-0f2b-407b-aab3-d07d7266c795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:33.909413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f894a5-0f2b-407b-aab3-d07d7266c795 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:33.936326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 262/544] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:36:33.938499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b8784-7b1c-404f-8cc0-4dfcd51d8d7f None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:33.939014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b8784-7b1c-404f-8cc0-4dfcd51d8d7f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:33.939649 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b8784-7b1c-404f-8cc0-4dfcd51d8d7f None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:33.942790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 263/545] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:33.947914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b8784-7b1c-404f-8cc0-4dfcd51d8d7f None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:33.975127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:33.985522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff68359-78a8-4cd7-afc8-fc435c11d4d0 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:33.997638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:34.036706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c691c5-9c78-454b-b695-d758c94ade5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:34.038214 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c691c5-9c78-454b-b695-d758c94ade5c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:34.038856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c691c5-9c78-454b-b695-d758c94ade5c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:34.039318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c691c5-9c78-454b-b695-d758c94ade5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:34.071902 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c691c5-9c78-454b-b695-d758c94ade5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:34.075651 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c691c5-9c78-454b-b695-d758c94ade5c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:34.090690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b8784-7b1c-404f-8cc0-4dfcd51d8d7f None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-94c691c5-9c78-454b-b695-d758c94ade5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:34.110999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:34.112702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:34.115068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:34.115068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:34.115068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:34.115068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:34.119008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 283/546] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:36:34.121735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642a5d7-a591-4cad-baa4-4f011bde2fb0 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:34.122555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642a5d7-a591-4cad-baa4-4f011bde2fb0 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:34.123506 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642a5d7-a591-4cad-baa4-4f011bde2fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:34.138033 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89470357-78b6-4c6e-9532-0111596352a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:34.138847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89470357-78b6-4c6e-9532-0111596352a1 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:34.139195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89470357-78b6-4c6e-9532-0111596352a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:34.139582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89470357-78b6-4c6e-9532-0111596352a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:34.140518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89470357-78b6-4c6e-9532-0111596352a1 None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=4dfd634e889c4b53a1ed6b90cc1a25e9) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:34.140908 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89470357-78b6-4c6e-9532-0111596352a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:34.142442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89470357-78b6-4c6e-9532-0111596352a1 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:34.156513 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 264/547] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:36:33 2022] GET /identity/v3/role_assignments?user.id=4dfd634e889c4b53a1ed6b90cc1a25e9&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:34.156513 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89470357-78b6-4c6e-9532-0111596352a1 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:34.159586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e642a5d7-a591-4cad-baa4-4f011bde2fb0 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:34.161290 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e642a5d7-a591-4cad-baa4-4f011bde2fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:34.341145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 284/548] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:34.368256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:34.385400 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642a5d7-a591-4cad-baa4-4f011bde2fb0 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:34.404859 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89470357-78b6-4c6e-9532-0111596352a1 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:34.511228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6494289-7ab8-49c2-beb9-b0adee1ea032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:34.511997 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6494289-7ab8-49c2-beb9-b0adee1ea032 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:34.512290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6494289-7ab8-49c2-beb9-b0adee1ea032 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:34.512798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6494289-7ab8-49c2-beb9-b0adee1ea032 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:34.513629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6494289-7ab8-49c2-beb9-b0adee1ea032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:34.513947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6494289-7ab8-49c2-beb9-b0adee1ea032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:34.516162 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6494289-7ab8-49c2-beb9-b0adee1ea032 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:34.547262 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 265/549] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:34.550736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:34.553314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6494289-7ab8-49c2-beb9-b0adee1ea032 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:34.609062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642a5d7-a591-4cad-baa4-4f011bde2fb0 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:34.685989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d353b-8de9-40a2-9fff-16aab01bffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:34.686813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d353b-8de9-40a2-9fff-16aab01bffca None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:34.687095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d353b-8de9-40a2-9fff-16aab01bffca None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:34.687371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d353b-8de9-40a2-9fff-16aab01bffca None admin] PATH_INFO: `/v3/roles/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:34.715208 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d353b-8de9-40a2-9fff-16aab01bffca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-632d353b-8de9-40a2-9fff-16aab01bffca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:34.731204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:34.733115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:34.734853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:34.734853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:34.734853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:34.734853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:34.734853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:34.734853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:34.734853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:34.734853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:34.734853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:34.734853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:34.734853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:34.734853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:34.738038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 285/550] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:34.747459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d353b-8de9-40a2-9fff-16aab01bffca None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:34.786554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6494289-7ab8-49c2-beb9-b0adee1ea032 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:34.870021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf954f56-6779-4423-8595-c6ef53f18cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:34.870726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf954f56-6779-4423-8595-c6ef53f18cf0 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:34.871566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf954f56-6779-4423-8595-c6ef53f18cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:34.871850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf954f56-6779-4423-8595-c6ef53f18cf0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:34.882907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf954f56-6779-4423-8595-c6ef53f18cf0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:34.884388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf954f56-6779-4423-8595-c6ef53f18cf0 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-cf954f56-6779-4423-8595-c6ef53f18cf0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:34.900768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:34.903280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 266/551] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:36:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1da0a-8a8a-4c58-8a29-e89a8bee3ee1 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:34.905086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1da0a-8a8a-4c58-8a29-e89a8bee3ee1 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:34.909472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1da0a-8a8a-4c58-8a29-e89a8bee3ee1 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:34.909472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 267/552] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:34.909472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1da0a-8a8a-4c58-8a29-e89a8bee3ee1 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:34.924751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:34.987363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d353b-8de9-40a2-9fff-16aab01bffca None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:35.029857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1da0a-8a8a-4c58-8a29-e89a8bee3ee1 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:35.059363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9478a51-3a6c-4d3a-976f-4ef3f4eff435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:35.060925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9478a51-3a6c-4d3a-976f-4ef3f4eff435 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:35.061640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9478a51-3a6c-4d3a-976f-4ef3f4eff435 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:35.062233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9478a51-3a6c-4d3a-976f-4ef3f4eff435 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:35.063462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9478a51-3a6c-4d3a-976f-4ef3f4eff435 None admin] RBAC: Adding query filter params (name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:35.064195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9478a51-3a6c-4d3a-976f-4ef3f4eff435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:35.065772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9478a51-3a6c-4d3a-976f-4ef3f4eff435 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:35.068222 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:35.069900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb671f-b77d-482b-809c-222d294d5bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:35.070825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb671f-b77d-482b-809c-222d294d5bbb None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:35.071319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb671f-b77d-482b-809c-222d294d5bbb None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:35.071776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb671f-b77d-482b-809c-222d294d5bbb None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:35.072840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb671f-b77d-482b-809c-222d294d5bbb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:35.073360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb671f-b77d-482b-809c-222d294d5bbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:35.075645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb671f-b77d-482b-809c-222d294d5bbb None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:35.083091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 286/553] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:36:35.084725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c53dc-f99a-4be5-8c04-c0f5b2b43faa None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:35.085095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c53dc-f99a-4be5-8c04-c0f5b2b43faa None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:35.085692 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c53dc-f99a-4be5-8c04-c0f5b2b43faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:35.097671 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 268/554] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jul 20 17:36:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:35.098861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb671f-b77d-482b-809c-222d294d5bbb None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:35.106907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-3b4c53dc-f99a-4be5-8c04-c0f5b2b43faa None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:35.108366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3b4c53dc-f99a-4be5-8c04-c0f5b2b43faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:35.178019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:35.218045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 287/555] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:35.224209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb671f-b77d-482b-809c-222d294d5bbb None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:35.224543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c53dc-f99a-4be5-8c04-c0f5b2b43faa None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:35.275682 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e4bcd-0a8c-4477-91a6-dd7132ad6d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:35.277014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e4bcd-0a8c-4477-91a6-dd7132ad6d33 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:35.279036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e4bcd-0a8c-4477-91a6-dd7132ad6d33 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:35.279902 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e4bcd-0a8c-4477-91a6-dd7132ad6d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:35.297579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e4bcd-0a8c-4477-91a6-dd7132ad6d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:35.299534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e4bcd-0a8c-4477-91a6-dd7132ad6d33 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-6c7e4bcd-0a8c-4477-91a6-dd7132ad6d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:35.320899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:35.321884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:35.322771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:35.322771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:35.322771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:35.322771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:35.326245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 269/556] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:35.327518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e4bcd-0a8c-4477-91a6-dd7132ad6d33 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:35.446061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c53dc-f99a-4be5-8c04-c0f5b2b43faa None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:35.452591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e4bcd-0a8c-4477-91a6-dd7132ad6d33 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:35.472930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:35.492597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ef36d-a313-4b62-ba95-e78223b3bf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:35.493403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ef36d-a313-4b62-ba95-e78223b3bf88 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:35.493718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ef36d-a313-4b62-ba95-e78223b3bf88 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:35.494181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ef36d-a313-4b62-ba95-e78223b3bf88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:35.500170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:35.507936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ef36d-a313-4b62-ba95-e78223b3bf88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:35.517490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abb12f-4405-4954-8ab7-01ecada5962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-f53ef36d-a313-4b62-ba95-e78223b3bf88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:35.517765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:35.519749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 270/557] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:35.533703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ef36d-a313-4b62-ba95-e78223b3bf88 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:35.535553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abb12f-4405-4954-8ab7-01ecada5962b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:35.535553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abb12f-4405-4954-8ab7-01ecada5962b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:35.535553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abb12f-4405-4954-8ab7-01ecada5962b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:35.630742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ef36d-a313-4b62-ba95-e78223b3bf88 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:35.670020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e7ef-5b6e-4275-969e-dd646d2d8166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:35.670696 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e7ef-5b6e-4275-969e-dd646d2d8166 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:35.670978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e7ef-5b6e-4275-969e-dd646d2d8166 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:35.671252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e7ef-5b6e-4275-969e-dd646d2d8166 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:35.671977 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e7ef-5b6e-4275-969e-dd646d2d8166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:35.672281 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e7ef-5b6e-4275-969e-dd646d2d8166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:35.672520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abb12f-4405-4954-8ab7-01ecada5962b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:35.673685 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e7ef-5b6e-4275-969e-dd646d2d8166 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:35.676660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abb12f-4405-4954-8ab7-01ecada5962b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:35.692533 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 271/558] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:35.692533 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e7ef-5b6e-4275-969e-dd646d2d8166 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:35.739006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:35.834468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e7ef-5b6e-4275-969e-dd646d2d8166 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:35.834705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 288/559] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:35.834705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91bd11-c809-4dd3-b198-37d7389ffa69 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:35.834705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91bd11-c809-4dd3-b198-37d7389ffa69 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:35.834705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91bd11-c809-4dd3-b198-37d7389ffa69 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:35.836064 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 289/560] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:35.837422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91bd11-c809-4dd3-b198-37d7389ffa69 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:35.875035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d619e8-83f1-40dc-9a0b-f60132deed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:35.875709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d619e8-83f1-40dc-9a0b-f60132deed33 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:35.875988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d619e8-83f1-40dc-9a0b-f60132deed33 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:35.876262 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d619e8-83f1-40dc-9a0b-f60132deed33 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:35.877067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d619e8-83f1-40dc-9a0b-f60132deed33 None admin] RBAC: Adding query filter params (name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:35.877374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d619e8-83f1-40dc-9a0b-f60132deed33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:35.878775 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d619e8-83f1-40dc-9a0b-f60132deed33 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:35.887763 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 272/561] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:35.888635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d619e8-83f1-40dc-9a0b-f60132deed33 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:35.895001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:36.018159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91bd11-c809-4dd3-b198-37d7389ffa69 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:36.060745 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:36.063890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d619e8-83f1-40dc-9a0b-f60132deed33 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:36.070410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd7da4-e201-449b-af36-0a01f913a70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:36.071235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd7da4-e201-449b-af36-0a01f913a70e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:36.086227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd7da4-e201-449b-af36-0a01f913a70e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:36.086227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd7da4-e201-449b-af36-0a01f913a70e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:36.086227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd7da4-e201-449b-af36-0a01f913a70e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:36.086227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd7da4-e201-449b-af36-0a01f913a70e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-07fd7da4-e201-449b-af36-0a01f913a70e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:36.100412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:36.101507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 290/562] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 20 17:36:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61923d-c691-4d39-98f2-f7f446e15529 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:36.103915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61923d-c691-4d39-98f2-f7f446e15529 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:36.106704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61923d-c691-4d39-98f2-f7f446e15529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:36.113866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a2c64-967e-46b1-b4ff-6da094be4a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:36.114826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a2c64-967e-46b1-b4ff-6da094be4a9b None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:36.115228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a2c64-967e-46b1-b4ff-6da094be4a9b None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:36.115624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a2c64-967e-46b1-b4ff-6da094be4a9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:36.122695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-4b61923d-c691-4d39-98f2-f7f446e15529 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:36.123804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4b61923d-c691-4d39-98f2-f7f446e15529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:36.129174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a2c64-967e-46b1-b4ff-6da094be4a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:36.130851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a2c64-967e-46b1-b4ff-6da094be4a9b None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-108a2c64-967e-46b1-b4ff-6da094be4a9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:36.153659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:36.155031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:36.156988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:36.156988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:36.156988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:36.156988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:36.156988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 273/563] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:36.156988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a2c64-967e-46b1-b4ff-6da094be4a9b None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:36.228643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 291/564] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:36.231331 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61923d-c691-4d39-98f2-f7f446e15529 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:36.260344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:36.307785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a2c64-967e-46b1-b4ff-6da094be4a9b None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:36.359199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f3309-070e-41eb-8ec6-2a53e7a28310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:36.360746 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f3309-070e-41eb-8ec6-2a53e7a28310 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:36.361232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f3309-070e-41eb-8ec6-2a53e7a28310 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:36.361735 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f3309-070e-41eb-8ec6-2a53e7a28310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:36.376318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61923d-c691-4d39-98f2-f7f446e15529 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:36.381859 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f3309-070e-41eb-8ec6-2a53e7a28310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:36.384652 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f3309-070e-41eb-8ec6-2a53e7a28310 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:36.419301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bce55c-cd3f-4def-9501-c911a451adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:36.419975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bce55c-cd3f-4def-9501-c911a451adf2 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:36.420258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bce55c-cd3f-4def-9501-c911a451adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:36.420567 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bce55c-cd3f-4def-9501-c911a451adf2 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:36.421414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bce55c-cd3f-4def-9501-c911a451adf2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:36.421723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bce55c-cd3f-4def-9501-c911a451adf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:36.423153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bce55c-cd3f-4def-9501-c911a451adf2 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-fc9f3309-070e-41eb-8ec6-2a53e7a28310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:36.427683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:36.428690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:36.429746 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:36.429746 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:36.429746 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:36.429746 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:36.429981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 274/565] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:36.431301 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f3309-070e-41eb-8ec6-2a53e7a28310 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:36.437919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:36.443753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 292/566] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 20 17:36:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:36.444781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bce55c-cd3f-4def-9501-c911a451adf2 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:36.526151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:36.552208 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bce55c-cd3f-4def-9501-c911a451adf2 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:36.573222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f3309-070e-41eb-8ec6-2a53e7a28310 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:36.590969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2633d2-acd8-4ea3-9289-f01ac9d26bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:36.591923 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2633d2-acd8-4ea3-9289-f01ac9d26bdf None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:36.592370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2633d2-acd8-4ea3-9289-f01ac9d26bdf None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:36.592804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2633d2-acd8-4ea3-9289-f01ac9d26bdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:36.604253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2633d2-acd8-4ea3-9289-f01ac9d26bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:36.610825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dd8c7-8d91-4d9c-a299-63f0843e2429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:36.611490 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dd8c7-8d91-4d9c-a299-63f0843e2429 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:36.611779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dd8c7-8d91-4d9c-a299-63f0843e2429 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:36.612058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dd8c7-8d91-4d9c-a299-63f0843e2429 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-ae2633d2-acd8-4ea3-9289-f01ac9d26bdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:36.612715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:36.622532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:36.625097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:36.625097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:36.625097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:36.625097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:36.625097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:36.625097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:36.625097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:36.625097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:36.625097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:36.625097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:36.625097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:36.625097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:36.626505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dd8c7-8d91-4d9c-a299-63f0843e2429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:36.626505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dd8c7-8d91-4d9c-a299-63f0843e2429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:36.626815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 293/567] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:36.626941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dd8c7-8d91-4d9c-a299-63f0843e2429 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:36.627067 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a63af6-d033-45be-aae3-e6dd3f2125e3 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:36.627067 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a63af6-d033-45be-aae3-e6dd3f2125e3 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:36.627067 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a63af6-d033-45be-aae3-e6dd3f2125e3 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:36.627067 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 294/568] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:36.627067 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a63af6-d033-45be-aae3-e6dd3f2125e3 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:36.634814 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 275/569] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:36.635684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dd8c7-8d91-4d9c-a299-63f0843e2429 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:36.703295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:36.739507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a63af6-d033-45be-aae3-e6dd3f2125e3 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:36.743554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dd8c7-8d91-4d9c-a299-63f0843e2429 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:36.775816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773a931-ae36-47fb-8159-492b06763cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:36.776967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773a931-ae36-47fb-8159-492b06763cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:36.778150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773a931-ae36-47fb-8159-492b06763cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:36.778618 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773a931-ae36-47fb-8159-492b06763cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:36.779794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773a931-ae36-47fb-8159-492b06763cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:36.780304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773a931-ae36-47fb-8159-492b06763cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:36.782611 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88083963-f025-49ac-8a47-2fbc0136b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:36.782768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773a931-ae36-47fb-8159-492b06763cd4 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:36.783845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88083963-f025-49ac-8a47-2fbc0136b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:36.784576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88083963-f025-49ac-8a47-2fbc0136b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:36.785024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88083963-f025-49ac-8a47-2fbc0136b0a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:36.785428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:36.800590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88083963-f025-49ac-8a47-2fbc0136b0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:36.801165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 295/570] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:36.802024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773a931-ae36-47fb-8159-492b06763cd4 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:36.802420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88083963-f025-49ac-8a47-2fbc0136b0a7 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-88083963-f025-49ac-8a47-2fbc0136b0a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:36.831844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:36.833014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:36.833952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:36.833952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:36.833952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:36.833952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:36.833952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 276/571] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:36.835924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fbb26-f6d0-4847-be2f-62e5c93c4627 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:36.836375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fbb26-f6d0-4847-be2f-62e5c93c4627 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:36.836850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fbb26-f6d0-4847-be2f-62e5c93c4627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:36.862954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-708fbb26-f6d0-4847-be2f-62e5c93c4627 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:36.864900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-708fbb26-f6d0-4847-be2f-62e5c93c4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:36.946970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773a931-ae36-47fb-8159-492b06763cd4 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:36.953266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 277/572] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:36.954299 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fbb26-f6d0-4847-be2f-62e5c93c4627 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:36.992231 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d0744-44e2-42ac-b54f-f9c8e6aa3085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:36.993323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d0744-44e2-42ac-b54f-f9c8e6aa3085 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:36.993897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d0744-44e2-42ac-b54f-f9c8e6aa3085 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:36.994206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d0744-44e2-42ac-b54f-f9c8e6aa3085 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:36.995353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d0744-44e2-42ac-b54f-f9c8e6aa3085 None admin] RBAC: Adding query filter params (name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:36.995852 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d0744-44e2-42ac-b54f-f9c8e6aa3085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:36.998084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d0744-44e2-42ac-b54f-f9c8e6aa3085 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:37.007687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 296/573] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:37.008592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d0744-44e2-42ac-b54f-f9c8e6aa3085 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:37.018050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:37.098839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:37.104759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fbb26-f6d0-4847-be2f-62e5c93c4627 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:37.152944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d1ecc-e72f-44c9-9b46-a679fe7f70c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:37.154865 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d1ecc-e72f-44c9-9b46-a679fe7f70c7 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:37.155256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d1ecc-e72f-44c9-9b46-a679fe7f70c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:37.155679 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d1ecc-e72f-44c9-9b46-a679fe7f70c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:37.157640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d0744-44e2-42ac-b54f-f9c8e6aa3085 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:37.163784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d1ecc-e72f-44c9-9b46-a679fe7f70c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:37.165540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d1ecc-e72f-44c9-9b46-a679fe7f70c7 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-0e8d1ecc-e72f-44c9-9b46-a679fe7f70c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:37.180172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:37.181911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:37.183718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:37.183718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:37.183718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:37.183718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:37.183718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:37.183718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:37.183718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:37.183718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:37.183718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 278/574] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:37.183718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d1ecc-e72f-44c9-9b46-a679fe7f70c7 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:37.211359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5fe1-aa6d-4ee0-ab30-f27c29621e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:37.212683 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5fe1-aa6d-4ee0-ab30-f27c29621e85 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:37.213152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5fe1-aa6d-4ee0-ab30-f27c29621e85 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:37.213607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5fe1-aa6d-4ee0-ab30-f27c29621e85 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:37.228343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5fe1-aa6d-4ee0-ab30-f27c29621e85 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:37.232098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5fe1-aa6d-4ee0-ab30-f27c29621e85 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-d5ef5fe1-aa6d-4ee0-ab30-f27c29621e85 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:37.260402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:37.262416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:37.263962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:37.263962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:37.263962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:37.263962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:37.263962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:37.263962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:37.263962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:37.263962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:37.263962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 17:36:37.263962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:37.263962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 297/575] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:37.264785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5fe1-aa6d-4ee0-ab30-f27c29621e85 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:37.302726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d1ecc-e72f-44c9-9b46-a679fe7f70c7 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:37.311018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:37.352461 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9e076-606d-44af-a7d5-7f2cba18030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:37.353454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9e076-606d-44af-a7d5-7f2cba18030d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:37.353835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9e076-606d-44af-a7d5-7f2cba18030d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:37.354178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9e076-606d-44af-a7d5-7f2cba18030d None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:37.355038 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9e076-606d-44af-a7d5-7f2cba18030d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:37.355433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9e076-606d-44af-a7d5-7f2cba18030d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:37.357235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9e076-606d-44af-a7d5-7f2cba18030d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:37.372766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 279/576] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:37.374213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9e076-606d-44af-a7d5-7f2cba18030d None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:37.391737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5fe1-aa6d-4ee0-ab30-f27c29621e85 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:37.413804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:37.434812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f7dfd-d345-4719-b89c-e955b4f93acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:37.436454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f7dfd-d345-4719-b89c-e955b4f93acd None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:37.437026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f7dfd-d345-4719-b89c-e955b4f93acd None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:37.437526 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f7dfd-d345-4719-b89c-e955b4f93acd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:37.457949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f7dfd-d345-4719-b89c-e955b4f93acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-f29f7dfd-d345-4719-b89c-e955b4f93acd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:37.473269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:37.475133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:37.476725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 298/577] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:37.478199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f7dfd-d345-4719-b89c-e955b4f93acd None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:37.508348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9e076-606d-44af-a7d5-7f2cba18030d None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:37.551378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7d477-546a-41f7-8a4b-aede3a7f65a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:37.552189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7d477-546a-41f7-8a4b-aede3a7f65a6 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:37.552498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7d477-546a-41f7-8a4b-aede3a7f65a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:37.552778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7d477-546a-41f7-8a4b-aede3a7f65a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:37.565201 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7d477-546a-41f7-8a4b-aede3a7f65a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:37.566671 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7d477-546a-41f7-8a4b-aede3a7f65a6 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-0fb7d477-546a-41f7-8a4b-aede3a7f65a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:37.585963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:37.587966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:37.589816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:37.589816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:37.589816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:37.589816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:37.591931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 280/578] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:37.592802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7d477-546a-41f7-8a4b-aede3a7f65a6 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:37.601225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f7dfd-d345-4719-b89c-e955b4f93acd None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:37.613707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:37.644351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209c1df-820b-46b8-9eea-35c3e918c929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:37.645268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209c1df-820b-46b8-9eea-35c3e918c929 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:37.645738 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209c1df-820b-46b8-9eea-35c3e918c929 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:37.646097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209c1df-820b-46b8-9eea-35c3e918c929 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:37.646941 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209c1df-820b-46b8-9eea-35c3e918c929 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:37.647385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209c1df-820b-46b8-9eea-35c3e918c929 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:37.649072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209c1df-820b-46b8-9eea-35c3e918c929 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:37.663127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 299/579] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:37.664589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209c1df-820b-46b8-9eea-35c3e918c929 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:37.711516 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:37.717473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7d477-546a-41f7-8a4b-aede3a7f65a6 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:37.763373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d536f-b513-44a3-8518-42f9717feec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:37.764420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d536f-b513-44a3-8518-42f9717feec4 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:37.764908 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d536f-b513-44a3-8518-42f9717feec4 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:37.765358 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d536f-b513-44a3-8518-42f9717feec4 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:37.766830 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d536f-b513-44a3-8518-42f9717feec4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:37.767336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d536f-b513-44a3-8518-42f9717feec4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:37.769651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d536f-b513-44a3-8518-42f9717feec4 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:37.794823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 281/580] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jul 20 17:36:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:37.802438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d536f-b513-44a3-8518-42f9717feec4 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:37.810748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209c1df-820b-46b8-9eea-35c3e918c929 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:37.852889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9effda-6b87-4847-848c-4f4c57669a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:37.853849 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9effda-6b87-4847-848c-4f4c57669a8e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:37.854219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9effda-6b87-4847-848c-4f4c57669a8e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:37.854583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9effda-6b87-4847-848c-4f4c57669a8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:37.864144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9effda-6b87-4847-848c-4f4c57669a8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:37.866179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9effda-6b87-4847-848c-4f4c57669a8e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-8e9effda-6b87-4847-848c-4f4c57669a8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:37.888581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:37.889676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:37.891139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:37.891139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:37.891139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:37.891139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:37.891139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:37.891139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:37.891139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:37.891139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:37.891139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 300/581] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:37.892193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9effda-6b87-4847-848c-4f4c57669a8e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:37.906639 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:37.938506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d536f-b513-44a3-8518-42f9717feec4 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:37.982694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcb09b-92f5-4599-bc59-930dd7f0e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:37.983723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcb09b-92f5-4599-bc59-930dd7f0e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:37.984187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcb09b-92f5-4599-bc59-930dd7f0e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:37.984592 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcb09b-92f5-4599-bc59-930dd7f0e4c0 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:37.985482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcb09b-92f5-4599-bc59-930dd7f0e4c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:37.985842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcb09b-92f5-4599-bc59-930dd7f0e4c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:37.987309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcb09b-92f5-4599-bc59-930dd7f0e4c0 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:37.997721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 282/582] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:37.999227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcb09b-92f5-4599-bc59-930dd7f0e4c0 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:38.022275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:38.029716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9effda-6b87-4847-848c-4f4c57669a8e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:38.075978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569ee8d-bef1-4007-b5b4-862552e734c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:38.076681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569ee8d-bef1-4007-b5b4-862552e734c4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:38.076965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569ee8d-bef1-4007-b5b4-862552e734c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:38.077242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569ee8d-bef1-4007-b5b4-862552e734c4 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:38.077978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569ee8d-bef1-4007-b5b4-862552e734c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:38.078285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569ee8d-bef1-4007-b5b4-862552e734c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:38.079680 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569ee8d-bef1-4007-b5b4-862552e734c4 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:38.092741 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 301/583] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:38.093616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569ee8d-bef1-4007-b5b4-862552e734c4 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:38.146543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcb09b-92f5-4599-bc59-930dd7f0e4c0 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:38.196339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a80da-631a-4118-af98-cc4d9b22b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:38.197539 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a80da-631a-4118-af98-cc4d9b22b3d1 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:38.197999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a80da-631a-4118-af98-cc4d9b22b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:38.198453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a80da-631a-4118-af98-cc4d9b22b3d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:38.200791 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a80da-631a-4118-af98-cc4d9b22b3d1 None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=9566befd16fc4b0c84d2bed34c4a5d28) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:38.201333 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a80da-631a-4118-af98-cc4d9b22b3d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:38.204131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a80da-631a-4118-af98-cc4d9b22b3d1 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:38.211094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 283/584] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:36:37 2022] GET /identity/v3/role_assignments?user.id=9566befd16fc4b0c84d2bed34c4a5d28&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:38.212186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a80da-631a-4118-af98-cc4d9b22b3d1 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:38.216243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:38.250897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569ee8d-bef1-4007-b5b4-862552e734c4 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:38.312944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868aa4d-1004-4bac-83e3-f457e7d27b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:38.314364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868aa4d-1004-4bac-83e3-f457e7d27b0d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:38.314964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868aa4d-1004-4bac-83e3-f457e7d27b0d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:38.315553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868aa4d-1004-4bac-83e3-f457e7d27b0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:38.331881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868aa4d-1004-4bac-83e3-f457e7d27b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:38.335519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868aa4d-1004-4bac-83e3-f457e7d27b0d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-c868aa4d-1004-4bac-83e3-f457e7d27b0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:38.368002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:38.369014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:38.371556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:38.371556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:38.371556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:38.371556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:38.371556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 302/585] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:38.371556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868aa4d-1004-4bac-83e3-f457e7d27b0d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:38.391804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:38.396218 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a80da-631a-4118-af98-cc4d9b22b3d1 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:38.445180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd814c9-76c4-475f-bf69-570c52a8ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:38.446531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd814c9-76c4-475f-bf69-570c52a8ae5b None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:38.447021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd814c9-76c4-475f-bf69-570c52a8ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:38.447493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd814c9-76c4-475f-bf69-570c52a8ae5b None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:38.449042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd814c9-76c4-475f-bf69-570c52a8ae5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:38.450210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd814c9-76c4-475f-bf69-570c52a8ae5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:38.452787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd814c9-76c4-475f-bf69-570c52a8ae5b None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:38.480929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 284/586] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:38.483219 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd814c9-76c4-475f-bf69-570c52a8ae5b None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:38.540071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868aa4d-1004-4bac-83e3-f457e7d27b0d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:38.574536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:38.603960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d59b-41cd-4395-a3e2-3dc9fd99f323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:38.605206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d59b-41cd-4395-a3e2-3dc9fd99f323 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:38.606446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d59b-41cd-4395-a3e2-3dc9fd99f323 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:38.606805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8d59b-41cd-4395-a3e2-3dc9fd99f323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:38.624702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8d59b-41cd-4395-a3e2-3dc9fd99f323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:38.627300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8d59b-41cd-4395-a3e2-3dc9fd99f323 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:38.643526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd814c9-76c4-475f-bf69-570c52a8ae5b None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-f4e8d59b-41cd-4395-a3e2-3dc9fd99f323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:38.656866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:38.658801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:38.661058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:38.661058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:38.661058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:38.661058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:38.666208 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 303/587] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:38.667700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d59b-41cd-4395-a3e2-3dc9fd99f323 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:38.710141 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136405c2-0a49-4386-8f6b-9de11b44d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:38.710954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136405c2-0a49-4386-8f6b-9de11b44d384 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:38.711285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136405c2-0a49-4386-8f6b-9de11b44d384 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:38.711514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136405c2-0a49-4386-8f6b-9de11b44d384 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:38.720535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136405c2-0a49-4386-8f6b-9de11b44d384 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:38.722022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136405c2-0a49-4386-8f6b-9de11b44d384 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-136405c2-0a49-4386-8f6b-9de11b44d384 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:38.737726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:38.739084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:38.741124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:38.741124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:38.741124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:38.741124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:38.741124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:38.741124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:38.741124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:38.741124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:38.741124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 17:36:38.741124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:38.741124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 285/588] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:38.741124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136405c2-0a49-4386-8f6b-9de11b44d384 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:38.786709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:38.857912 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136405c2-0a49-4386-8f6b-9de11b44d384 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:38.867058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8d59b-41cd-4395-a3e2-3dc9fd99f323 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:38.884436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:38.898698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd60e8-8994-4c29-bf35-af851bd95283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:38.899663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd60e8-8994-4c29-bf35-af851bd95283 None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:38.899866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd60e8-8994-4c29-bf35-af851bd95283 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:38.900155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd60e8-8994-4c29-bf35-af851bd95283 None admin] PATH_INFO: `/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/3b52e88df44d49b186d54a8d045595ed/roles/645163d4e8634094bb7d2a16f75bd1b0` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:38.918229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd60e8-8994-4c29-bf35-af851bd95283 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f0f8db3986541468c474b78a9b3740a, user_id=3b52e88df44d49b186d54a8d045595ed, role_id=645163d4e8634094bb7d2a16f75bd1b0)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:38.920694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd60e8-8994-4c29-bf35-af851bd95283 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:38.931922 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ee87-9019-4d45-ac25-68cf7eaa7bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:38.933253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ee87-9019-4d45-ac25-68cf7eaa7bdb None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:38.934340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ee87-9019-4d45-ac25-68cf7eaa7bdb None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:38.934863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814ee87-9019-4d45-ac25-68cf7eaa7bdb None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:38.936160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ee87-9019-4d45-ac25-68cf7eaa7bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:38.936766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ee87-9019-4d45-ac25-68cf7eaa7bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:38.939377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814ee87-9019-4d45-ac25-68cf7eaa7bdb None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:38.969808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 304/589] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:38.969808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ee87-9019-4d45-ac25-68cf7eaa7bdb None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:39.044882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 286/590] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:36:38 2022] PUT /identity/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/3b52e88df44d49b186d54a8d045595ed/roles/645163d4e8634094bb7d2a16f75bd1b0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:36:39.046508 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd60e8-8994-4c29-bf35-af851bd95283 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:39.122302 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814ee87-9019-4d45-ac25-68cf7eaa7bdb None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:39.160910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:39.185152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2806a9f-fd99-4c80-8b28-f86f085f40fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:39.186221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2806a9f-fd99-4c80-8b28-f86f085f40fa None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:39.186788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2806a9f-fd99-4c80-8b28-f86f085f40fa None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:39.187308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2806a9f-fd99-4c80-8b28-f86f085f40fa None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:39.188286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2806a9f-fd99-4c80-8b28-f86f085f40fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:39.188834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2806a9f-fd99-4c80-8b28-f86f085f40fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:39.190445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2806a9f-fd99-4c80-8b28-f86f085f40fa None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:39.211360 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 305/591] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:39.211360 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2806a9f-fd99-4c80-8b28-f86f085f40fa None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:39.239867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd60e8-8994-4c29-bf35-af851bd95283 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:39.298257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9836dd-3435-46fa-80cc-6074f6f050c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:39.299779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9836dd-3435-46fa-80cc-6074f6f050c6 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:39.300982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9836dd-3435-46fa-80cc-6074f6f050c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:39.300982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9836dd-3435-46fa-80cc-6074f6f050c6 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:39.304454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9836dd-3435-46fa-80cc-6074f6f050c6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:39.304454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9836dd-3435-46fa-80cc-6074f6f050c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:39.306122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9836dd-3435-46fa-80cc-6074f6f050c6 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:39.349039 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 287/592] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Jul 20 17:36:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:39.352059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9836dd-3435-46fa-80cc-6074f6f050c6 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:39.394076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:39.425606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2806a9f-fd99-4c80-8b28-f86f085f40fa None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:39.479327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9836dd-3435-46fa-80cc-6074f6f050c6 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:39.487844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d34b78-5701-42f1-85a0-e1cdf670f7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:39.489258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d34b78-5701-42f1-85a0-e1cdf670f7eb None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:39.489862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d34b78-5701-42f1-85a0-e1cdf670f7eb None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:39.490446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d34b78-5701-42f1-85a0-e1cdf670f7eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:39.503017 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d34b78-5701-42f1-85a0-e1cdf670f7eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:39.505600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d34b78-5701-42f1-85a0-e1cdf670f7eb None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:39.520426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f5dc5-1464-4e46-9a26-f7726581ede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:39.521248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f5dc5-1464-4e46-9a26-f7726581ede2 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:39.521536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f5dc5-1464-4e46-9a26-f7726581ede2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:39.521807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f5dc5-1464-4e46-9a26-f7726581ede2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-d0d34b78-5701-42f1-85a0-e1cdf670f7eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:39.528598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:39.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:39.531221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:39.531221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:39.531221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:39.531221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:39.531221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:39.531221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:39.531221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:39.531221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:39.532395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f5dc5-1464-4e46-9a26-f7726581ede2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:39.532395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f5dc5-1464-4e46-9a26-f7726581ede2 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:39.540599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 306/593] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:39.542187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d34b78-5701-42f1-85a0-e1cdf670f7eb None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-5f5f5dc5-1464-4e46-9a26-f7726581ede2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:39.549002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:39.551222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:39.553600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:39.553600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:39.553600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:39.553600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:39.553600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:39.553600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:39.553600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:39.553600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:39.553600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 17:36:39.553600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:39.553600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 288/594] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:39.560520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f5dc5-1464-4e46-9a26-f7726581ede2 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:39.600179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:39.661681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:39.665969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d34b78-5701-42f1-85a0-e1cdf670f7eb None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:39.673968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f5dc5-1464-4e46-9a26-f7726581ede2 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:39.713510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce37819-9f0b-4f07-9319-f8b5b4d65de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:39.714305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce37819-9f0b-4f07-9319-f8b5b4d65de8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:39.714591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce37819-9f0b-4f07-9319-f8b5b4d65de8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:39.715391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce37819-9f0b-4f07-9319-f8b5b4d65de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:39.718684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d1613-4856-4aa5-b96b-4ea07f398e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:39.719684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d1613-4856-4aa5-b96b-4ea07f398e2f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:39.720114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d1613-4856-4aa5-b96b-4ea07f398e2f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:39.720580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d1613-4856-4aa5-b96b-4ea07f398e2f None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:39.722028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d1613-4856-4aa5-b96b-4ea07f398e2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:39.722517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d1613-4856-4aa5-b96b-4ea07f398e2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:39.724307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d1613-4856-4aa5-b96b-4ea07f398e2f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:39.728303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce37819-9f0b-4f07-9319-f8b5b4d65de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:39.729973 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce37819-9f0b-4f07-9319-f8b5b4d65de8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:39.740732 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 289/595] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:39.741843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d1613-4856-4aa5-b96b-4ea07f398e2f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-2ce37819-9f0b-4f07-9319-f8b5b4d65de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:39.756200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:39.757384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:39.758372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:39.758372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:39.758372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:39.758372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:39.762425 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 307/596] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:39.763412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce37819-9f0b-4f07-9319-f8b5b4d65de8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:39.879316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d1613-4856-4aa5-b96b-4ea07f398e2f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:39.893644 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:39.907494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce37819-9f0b-4f07-9319-f8b5b4d65de8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:39.935957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44429b-aebb-4027-b2c8-d5d44ed8178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:39.937355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44429b-aebb-4027-b2c8-d5d44ed8178e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:39.937948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44429b-aebb-4027-b2c8-d5d44ed8178e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:39.938483 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44429b-aebb-4027-b2c8-d5d44ed8178e None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:39.940257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44429b-aebb-4027-b2c8-d5d44ed8178e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:39.941395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44429b-aebb-4027-b2c8-d5d44ed8178e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:39.944873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44429b-aebb-4027-b2c8-d5d44ed8178e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:39.976812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f9dc8-4c33-49a9-9acb-8d4060f86617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:39.984614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 290/597] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jul 20 17:36:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:39.984614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44429b-aebb-4027-b2c8-d5d44ed8178e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:39.984953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f9dc8-4c33-49a9-9acb-8d4060f86617 None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:39.985107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f9dc8-4c33-49a9-9acb-8d4060f86617 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:39.985592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f9dc8-4c33-49a9-9acb-8d4060f86617 None admin] PATH_INFO: `/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/259d506eb54e4766a8fe3fa5bb514e89/roles/645163d4e8634094bb7d2a16f75bd1b0` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:40.009974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:40.014967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f9dc8-4c33-49a9-9acb-8d4060f86617 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f0f8db3986541468c474b78a9b3740a, user_id=259d506eb54e4766a8fe3fa5bb514e89, role_id=645163d4e8634094bb7d2a16f75bd1b0)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:40.017554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f9dc8-4c33-49a9-9acb-8d4060f86617 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:40.133546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 308/598] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:36:39 2022] PUT /identity/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/259d506eb54e4766a8fe3fa5bb514e89/roles/645163d4e8634094bb7d2a16f75bd1b0 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:36:40.135680 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f9dc8-4c33-49a9-9acb-8d4060f86617 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:40.191904 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44429b-aebb-4027-b2c8-d5d44ed8178e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:40.261058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372552f-09ae-432d-8f24-992e6a455087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:40.261895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372552f-09ae-432d-8f24-992e6a455087 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:40.262212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372552f-09ae-432d-8f24-992e6a455087 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:40.263060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372552f-09ae-432d-8f24-992e6a455087 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:40.264537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372552f-09ae-432d-8f24-992e6a455087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:40.264537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372552f-09ae-432d-8f24-992e6a455087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:40.273474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372552f-09ae-432d-8f24-992e6a455087 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:40.295662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 291/599] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:40.302357 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372552f-09ae-432d-8f24-992e6a455087 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:40.384794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f9dc8-4c33-49a9-9acb-8d4060f86617 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:40.443149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdc1cc-0412-4336-9605-44410afbc171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:40.444098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdc1cc-0412-4336-9605-44410afbc171 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:40.444410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdc1cc-0412-4336-9605-44410afbc171 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:40.444784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdc1cc-0412-4336-9605-44410afbc171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:40.455837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:40.457311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdc1cc-0412-4336-9605-44410afbc171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:40.458796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdc1cc-0412-4336-9605-44410afbc171 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:40.460977 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-11cdc1cc-0412-4336-9605-44410afbc171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:40.482480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:40.484736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:40.486851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:40.486851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:40.486851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:40.486851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:40.486851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 309/600] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:40.493906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdc1cc-0412-4336-9605-44410afbc171 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:40.510824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372552f-09ae-432d-8f24-992e6a455087 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:40.560723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57620a-2584-4d08-a582-ad6b11d458fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:40.561988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57620a-2584-4d08-a582-ad6b11d458fb None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:40.562302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57620a-2584-4d08-a582-ad6b11d458fb None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:40.562558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57620a-2584-4d08-a582-ad6b11d458fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:40.573184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57620a-2584-4d08-a582-ad6b11d458fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:40.574779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57620a-2584-4d08-a582-ad6b11d458fb None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-dd57620a-2584-4d08-a582-ad6b11d458fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:40.594786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:40.596626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:40.598524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:40.598524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:40.598524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:40.598524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:40.598524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:40.598524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:40.598524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:40.598524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:40.604511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 292/601] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:40.604511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edf67e-987c-446c-b48a-3c423f3e7897 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:40.604511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edf67e-987c-446c-b48a-3c423f3e7897 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:40.604511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edf67e-987c-446c-b48a-3c423f3e7897 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:40.607952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 293/602] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:40.609341 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edf67e-987c-446c-b48a-3c423f3e7897 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:40.679324 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdc1cc-0412-4336-9605-44410afbc171 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:40.739628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f90e2-f52e-47bd-9e8f-223e404c6b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:40.741749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f90e2-f52e-47bd-9e8f-223e404c6b3b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:40.742271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f90e2-f52e-47bd-9e8f-223e404c6b3b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:40.742915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f90e2-f52e-47bd-9e8f-223e404c6b3b None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:40.744876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f90e2-f52e-47bd-9e8f-223e404c6b3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:40.745431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f90e2-f52e-47bd-9e8f-223e404c6b3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:40.748860 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f90e2-f52e-47bd-9e8f-223e404c6b3b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:40.784620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 310/603] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:40.786639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c5d17-e0ae-406e-bc6f-6f2dd762ec80 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:40.787219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c5d17-e0ae-406e-bc6f-6f2dd762ec80 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:40.787816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c5d17-e0ae-406e-bc6f-6f2dd762ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:40.821203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f98c5d17-e0ae-406e-bc6f-6f2dd762ec80 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:40.823348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f98c5d17-e0ae-406e-bc6f-6f2dd762ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:40.831744 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edf67e-987c-446c-b48a-3c423f3e7897 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:40.911127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:40.911787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:40.922262 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ffe71-ab8b-4171-86dc-8677c864a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:40.923371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ffe71-ab8b-4171-86dc-8677c864a298 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:40.923907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ffe71-ab8b-4171-86dc-8677c864a298 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:40.924378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ffe71-ab8b-4171-86dc-8677c864a298 None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:40.925929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ffe71-ab8b-4171-86dc-8677c864a298 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:40.926505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ffe71-ab8b-4171-86dc-8677c864a298 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:40.929442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ffe71-ab8b-4171-86dc-8677c864a298 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:40.935852 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 311/604] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:40.937127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c5d17-e0ae-406e-bc6f-6f2dd762ec80 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:40.960709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 294/605] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:40.968656 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ffe71-ab8b-4171-86dc-8677c864a298 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:41.053158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c5d17-e0ae-406e-bc6f-6f2dd762ec80 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:41.091090 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87696476-51d8-42a3-a50f-ec1f118a9eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:41.092153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87696476-51d8-42a3-a50f-ec1f118a9eb0 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:41.092622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87696476-51d8-42a3-a50f-ec1f118a9eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:41.093059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87696476-51d8-42a3-a50f-ec1f118a9eb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:41.100776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87696476-51d8-42a3-a50f-ec1f118a9eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:41.102503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87696476-51d8-42a3-a50f-ec1f118a9eb0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-87696476-51d8-42a3-a50f-ec1f118a9eb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:41.118091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:41.119943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:41.120992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:41.120992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:41.120992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:41.120992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:41.120992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:41.120992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:41.120992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:41.120992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:41.128404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 312/606] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:41.129838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87696476-51d8-42a3-a50f-ec1f118a9eb0 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:41.187451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:41.190937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ffe71-ab8b-4171-86dc-8677c864a298 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:41.248861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87696476-51d8-42a3-a50f-ec1f118a9eb0 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:41.262831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c201ee-6944-4817-8ca5-7b9a05b3fb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:41.264627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c201ee-6944-4817-8ca5-7b9a05b3fb36 None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:41.265544 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c201ee-6944-4817-8ca5-7b9a05b3fb36 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:41.265870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c201ee-6944-4817-8ca5-7b9a05b3fb36 None admin] PATH_INFO: `/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/11930f08a1324902a083436649660130/roles/645163d4e8634094bb7d2a16f75bd1b0` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:41.288396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372146ce-421a-4158-a232-017b4bcdc0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:41.289654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372146ce-421a-4158-a232-017b4bcdc0bc None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:41.290102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372146ce-421a-4158-a232-017b4bcdc0bc None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:41.290533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372146ce-421a-4158-a232-017b4bcdc0bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:41.297833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c201ee-6944-4817-8ca5-7b9a05b3fb36 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f0f8db3986541468c474b78a9b3740a, user_id=11930f08a1324902a083436649660130, role_id=645163d4e8634094bb7d2a16f75bd1b0)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:41.301063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c201ee-6944-4817-8ca5-7b9a05b3fb36 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:41.303130 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372146ce-421a-4158-a232-017b4bcdc0bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-372146ce-421a-4158-a232-017b4bcdc0bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:41.312238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:41.313417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:41.314272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:41.314272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:41.314272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:41.314272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:41.314272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:41.314272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:41.314272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:41.314272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:41.314272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:41.314272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:41.314272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:41.314272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:41.316867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 313/607] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:41.317974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372146ce-421a-4158-a232-017b4bcdc0bc None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:41.429012 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 295/608] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:36:40 2022] PUT /identity/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/11930f08a1324902a083436649660130/roles/645163d4e8634094bb7d2a16f75bd1b0 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:36:41.436857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c201ee-6944-4817-8ca5-7b9a05b3fb36 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:41.437077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372146ce-421a-4158-a232-017b4bcdc0bc None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:41.438257 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:41.476033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a8980-f126-4064-b031-7e127f7ccb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:41.476920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a8980-f126-4064-b031-7e127f7ccb95 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:41.477400 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a8980-f126-4064-b031-7e127f7ccb95 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:41.477813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a8980-f126-4064-b031-7e127f7ccb95 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:41.478774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a8980-f126-4064-b031-7e127f7ccb95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:41.479144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a8980-f126-4064-b031-7e127f7ccb95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:41.481392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a8980-f126-4064-b031-7e127f7ccb95 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:41.495434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 314/609] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:41.501899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a8980-f126-4064-b031-7e127f7ccb95 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:41.533302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:41.602756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c201ee-6944-4817-8ca5-7b9a05b3fb36 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:41.647847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37036afd-220f-4c1c-a16b-9cb8656e8de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:41.648581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036afd-220f-4c1c-a16b-9cb8656e8de3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:41.648870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036afd-220f-4c1c-a16b-9cb8656e8de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:41.649151 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036afd-220f-4c1c-a16b-9cb8656e8de3 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:41.649931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37036afd-220f-4c1c-a16b-9cb8656e8de3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:41.650244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37036afd-220f-4c1c-a16b-9cb8656e8de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:41.651671 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37036afd-220f-4c1c-a16b-9cb8656e8de3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:41.664108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 296/610] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:41.675733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37036afd-220f-4c1c-a16b-9cb8656e8de3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:41.758826 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a8980-f126-4064-b031-7e127f7ccb95 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:41.831042 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af980a-8119-4518-b631-fcb1a66d57e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:41.833004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af980a-8119-4518-b631-fcb1a66d57e0 None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:41.833485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af980a-8119-4518-b631-fcb1a66d57e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:41.834111 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af980a-8119-4518-b631-fcb1a66d57e0 None admin] PATH_INFO: `/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/4dfd634e889c4b53a1ed6b90cc1a25e9/roles/645163d4e8634094bb7d2a16f75bd1b0` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:41.864604 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af980a-8119-4518-b631-fcb1a66d57e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f0f8db3986541468c474b78a9b3740a, user_id=4dfd634e889c4b53a1ed6b90cc1a25e9, role_id=645163d4e8634094bb7d2a16f75bd1b0)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:41.867627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af980a-8119-4518-b631-fcb1a66d57e0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:41.950760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:41.960823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37036afd-220f-4c1c-a16b-9cb8656e8de3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:41.975191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 315/611] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:36:41 2022] PUT /identity/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/4dfd634e889c4b53a1ed6b90cc1a25e9/roles/645163d4e8634094bb7d2a16f75bd1b0 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:36:41.992166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf4b55-db41-4546-a324-355525cbe9a6 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:41.992454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf4b55-db41-4546-a324-355525cbe9a6 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:41.992812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf4b55-db41-4546-a324-355525cbe9a6 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:41.995055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 316/612] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:36:42.005713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aefec7-a728-47f9-9842-927688d1e20d None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:42.006755 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aefec7-a728-47f9-9842-927688d1e20d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:42.007600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aefec7-a728-47f9-9842-927688d1e20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:42.049677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f9aefec7-a728-47f9-9842-927688d1e20d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:42.050962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f9aefec7-a728-47f9-9842-927688d1e20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:42.068007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509435bd-9e93-47bd-aadf-d499882f9dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:42.068883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509435bd-9e93-47bd-aadf-d499882f9dcd None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:42.069165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509435bd-9e93-47bd-aadf-d499882f9dcd None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:42.069438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509435bd-9e93-47bd-aadf-d499882f9dcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:42.076395 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:42.097335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509435bd-9e93-47bd-aadf-d499882f9dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:42.098927 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509435bd-9e93-47bd-aadf-d499882f9dcd None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-509435bd-9e93-47bd-aadf-d499882f9dcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:42.162415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:42.163432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:42.164319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:42.164319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:42.164319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:42.164319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:42.165319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 297/613] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 490 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:36:42.176947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509435bd-9e93-47bd-aadf-d499882f9dcd None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:42.266281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 317/614] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:36:42.297330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aefec7-a728-47f9-9842-927688d1e20d None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:42.431534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509435bd-9e93-47bd-aadf-d499882f9dcd None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:42.457447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aefec7-a728-47f9-9842-927688d1e20d None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:42.508967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c1d3f-4497-43f2-bbdc-3df60d00dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:42.510080 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c1d3f-4497-43f2-bbdc-3df60d00dd9b None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:42.510539 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c1d3f-4497-43f2-bbdc-3df60d00dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:42.511002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c1d3f-4497-43f2-bbdc-3df60d00dd9b None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:42.515978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c1d3f-4497-43f2-bbdc-3df60d00dd9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:42.516615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c1d3f-4497-43f2-bbdc-3df60d00dd9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:42.519119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c1d3f-4497-43f2-bbdc-3df60d00dd9b None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:42.556560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59d20-1c6f-4f4c-b847-bfb9c69958fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:42.557920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59d20-1c6f-4f4c-b847-bfb9c69958fc None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:42.558401 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59d20-1c6f-4f4c-b847-bfb9c69958fc None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:42.558932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59d20-1c6f-4f4c-b847-bfb9c69958fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:42.567862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 298/615] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:42.573979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c1d3f-4497-43f2-bbdc-3df60d00dd9b None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:42.599469 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba59d20-1c6f-4f4c-b847-bfb9c69958fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-bba59d20-1c6f-4f4c-b847-bfb9c69958fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:42.612268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:42.613325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:42.614304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:42.614304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:42.614304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:42.614304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:42.614304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:42.614304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:42.614304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:42.614304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:42.614304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:42.614304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:42.614304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:42.614304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:42.623999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 318/616] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:36:42.636927 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:42.637752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59d20-1c6f-4f4c-b847-bfb9c69958fc None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:42.657087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:42.816955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59d20-1c6f-4f4c-b847-bfb9c69958fc None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:42.854863 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c1d3f-4497-43f2-bbdc-3df60d00dd9b None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:42.874105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b6bf5-385d-4631-96ae-f172a7588b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:42.875287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b6bf5-385d-4631-96ae-f172a7588b2d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:42.875788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b6bf5-385d-4631-96ae-f172a7588b2d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:42.876078 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b6bf5-385d-4631-96ae-f172a7588b2d None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:42.877053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b6bf5-385d-4631-96ae-f172a7588b2d None admin] RBAC: Adding query filter params (name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:42.877687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b6bf5-385d-4631-96ae-f172a7588b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:42.882754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b6bf5-385d-4631-96ae-f172a7588b2d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:42.900266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 319/617] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:42.921885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b6bf5-385d-4631-96ae-f172a7588b2d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:42.948747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ff1b5-c4d1-4f66-a35e-3a82b5d27851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:42.949701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ff1b5-c4d1-4f66-a35e-3a82b5d27851 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:42.950022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ff1b5-c4d1-4f66-a35e-3a82b5d27851 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:42.950387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ff1b5-c4d1-4f66-a35e-3a82b5d27851 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:42.970779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ff1b5-c4d1-4f66-a35e-3a82b5d27851 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:42.972270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ff1b5-c4d1-4f66-a35e-3a82b5d27851 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-657ff1b5-c4d1-4f66-a35e-3a82b5d27851 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:43.001538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:43.002612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:43.003574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:43.003574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:43.003574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:43.003574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:43.003574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:43.003574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:43.003574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:43.003574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:43.003574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 17:36:43.003574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:43.018847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 299/618] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:36:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:43.022613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ff1b5-c4d1-4f66-a35e-3a82b5d27851 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:43.065029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:43.133995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b6bf5-385d-4631-96ae-f172a7588b2d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:43.180920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:43.203633 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8a58a-20ea-4867-83fa-8f58f9caf866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:43.205628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a58a-20ea-4867-83fa-8f58f9caf866 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:43.206465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a58a-20ea-4867-83fa-8f58f9caf866 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:43.207243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a58a-20ea-4867-83fa-8f58f9caf866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:43.216940 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ff1b5-c4d1-4f66-a35e-3a82b5d27851 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:43.234320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8a58a-20ea-4867-83fa-8f58f9caf866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:43.238092 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8a58a-20ea-4867-83fa-8f58f9caf866 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:43.261819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca131a8-93ca-4830-8d70-93d86e817959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:43.262831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca131a8-93ca-4830-8d70-93d86e817959 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:43.263254 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca131a8-93ca-4830-8d70-93d86e817959 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:43.263519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca131a8-93ca-4830-8d70-93d86e817959 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:43.264414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca131a8-93ca-4830-8d70-93d86e817959 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:43.264783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca131a8-93ca-4830-8d70-93d86e817959 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:43.266296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca131a8-93ca-4830-8d70-93d86e817959 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-85c8a58a-20ea-4867-83fa-8f58f9caf866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:43.280341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:43.282096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:43.283916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:43.283916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:43.283916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:43.283916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:43.287789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 300/619] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jul 20 17:36:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:43.290065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35692a-af9a-40f0-85b7-03a9a2db2022 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:43.290065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35692a-af9a-40f0-85b7-03a9a2db2022 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:43.290065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35692a-af9a-40f0-85b7-03a9a2db2022 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:43.294263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 301/621] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:43.296720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 320/621] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:43.298164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35692a-af9a-40f0-85b7-03a9a2db2022 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:43.300455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07702f-12d2-4f02-8486-554c1f06f41b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:43.300803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07702f-12d2-4f02-8486-554c1f06f41b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:43.301039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07702f-12d2-4f02-8486-554c1f06f41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:43.333803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-7b07702f-12d2-4f02-8486-554c1f06f41b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:43.336636 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7b07702f-12d2-4f02-8486-554c1f06f41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:43.423969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35692a-af9a-40f0-85b7-03a9a2db2022 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:43.457536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:43.463850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ae5c-8268-4c6f-bd40-032e0accfa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:43.468750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ae5c-8268-4c6f-bd40-032e0accfa73 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:43.468750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ae5c-8268-4c6f-bd40-032e0accfa73 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:43.468750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ae5c-8268-4c6f-bd40-032e0accfa73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:43.478035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5ae5c-8268-4c6f-bd40-032e0accfa73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:43.479570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5ae5c-8268-4c6f-bd40-032e0accfa73 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:43.498065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 321/622] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:43.500024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07702f-12d2-4f02-8486-554c1f06f41b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-e2e5ae5c-8268-4c6f-bd40-032e0accfa73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:43.508825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:43.510939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:43.513447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:43.513447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:43.513447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:43.513447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:43.513447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 302/623] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:43.519955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ae5c-8268-4c6f-bd40-032e0accfa73 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:43.606312 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:43.644213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ae5c-8268-4c6f-bd40-032e0accfa73 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:43.685066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb02ba5-9d7d-4e7a-9da9-267bd9d16ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:43.685358 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb02ba5-9d7d-4e7a-9da9-267bd9d16ab9 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:43.685506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb02ba5-9d7d-4e7a-9da9-267bd9d16ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:43.685854 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb02ba5-9d7d-4e7a-9da9-267bd9d16ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:43.686472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb02ba5-9d7d-4e7a-9da9-267bd9d16ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:43.686784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb02ba5-9d7d-4e7a-9da9-267bd9d16ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:43.688356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb02ba5-9d7d-4e7a-9da9-267bd9d16ab9 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:43.703090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 303/624] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:36:43.703982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb02ba5-9d7d-4e7a-9da9-267bd9d16ab9 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:43.723337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07702f-12d2-4f02-8486-554c1f06f41b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:43.753578 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:43.797222 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4075a4-544f-4741-9bef-6fa04774bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:43.799127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4075a4-544f-4741-9bef-6fa04774bb9a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:43.799982 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4075a4-544f-4741-9bef-6fa04774bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:43.800784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4075a4-544f-4741-9bef-6fa04774bb9a None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:43.802686 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4075a4-544f-4741-9bef-6fa04774bb9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:43.803530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4075a4-544f-4741-9bef-6fa04774bb9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:43.806625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4075a4-544f-4741-9bef-6fa04774bb9a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:43.818052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb02ba5-9d7d-4e7a-9da9-267bd9d16ab9 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:43.839371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 322/625] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:43.842915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4075a4-544f-4741-9bef-6fa04774bb9a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:43.856580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d583f4b-2dc2-4e18-9fc8-292b270c2326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:43.857034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d583f4b-2dc2-4e18-9fc8-292b270c2326 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:43.857377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d583f4b-2dc2-4e18-9fc8-292b270c2326 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:43.857531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d583f4b-2dc2-4e18-9fc8-292b270c2326 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:43.869402 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d583f4b-2dc2-4e18-9fc8-292b270c2326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-5d583f4b-2dc2-4e18-9fc8-292b270c2326 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:43.877717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:43.880066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 304/626] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:43.882255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d583f4b-2dc2-4e18-9fc8-292b270c2326 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:44.001742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d583f4b-2dc2-4e18-9fc8-292b270c2326 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:44.003458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:44.054684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec3e6-ca65-4854-8527-f71abb265d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:44.055510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec3e6-ca65-4854-8527-f71abb265d11 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:44.055795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec3e6-ca65-4854-8527-f71abb265d11 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:44.056125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec3e6-ca65-4854-8527-f71abb265d11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:44.067254 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ec3e6-ca65-4854-8527-f71abb265d11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:44.068890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ec3e6-ca65-4854-8527-f71abb265d11 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:44.071472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4075a4-544f-4741-9bef-6fa04774bb9a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-5b9ec3e6-ca65-4854-8527-f71abb265d11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:44.085600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:44.087444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:44.089881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:44.089881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:44.089881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:44.089881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:44.089881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:44.089881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:44.089881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:44.089881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:44.089881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:36:44.089881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:44.091692 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 305/627] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 20 17:36:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:44.092506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec3e6-ca65-4854-8527-f71abb265d11 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:44.101140 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:44.145658 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de1d33-a830-4e01-9a73-137b828a25f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:44.146894 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de1d33-a830-4e01-9a73-137b828a25f0 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:44.147414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de1d33-a830-4e01-9a73-137b828a25f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:44.147918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de1d33-a830-4e01-9a73-137b828a25f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:44.157327 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de1d33-a830-4e01-9a73-137b828a25f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:44.159309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de1d33-a830-4e01-9a73-137b828a25f0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-63de1d33-a830-4e01-9a73-137b828a25f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:44.177592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:44.178552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:44.179424 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:44.179424 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:44.179424 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:44.179424 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:44.179424 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:44.179424 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:44.179424 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:44.179424 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:44.182310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 323/628] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:44.183775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de1d33-a830-4e01-9a73-137b828a25f0 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:44.232299 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec3e6-ca65-4854-8527-f71abb265d11 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:44.280023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4faefa-594b-4208-acfd-93a3d4d5ccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:44.281680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4faefa-594b-4208-acfd-93a3d4d5ccb6 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:44.282276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4faefa-594b-4208-acfd-93a3d4d5ccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:44.282767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4faefa-594b-4208-acfd-93a3d4d5ccb6 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:44.284021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4faefa-594b-4208-acfd-93a3d4d5ccb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:44.285249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4faefa-594b-4208-acfd-93a3d4d5ccb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:44.287335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4faefa-594b-4208-acfd-93a3d4d5ccb6 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:44.299934 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 306/629] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:44.301209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4faefa-594b-4208-acfd-93a3d4d5ccb6 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:44.311961 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de1d33-a830-4e01-9a73-137b828a25f0 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:44.336124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:44.359079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb895764-7311-4b0d-9c46-c413f182bfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:44.359779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb895764-7311-4b0d-9c46-c413f182bfcf None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:44.360063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb895764-7311-4b0d-9c46-c413f182bfcf None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:44.360337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb895764-7311-4b0d-9c46-c413f182bfcf None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:44.361248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb895764-7311-4b0d-9c46-c413f182bfcf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:44.361559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb895764-7311-4b0d-9c46-c413f182bfcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:44.363616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb895764-7311-4b0d-9c46-c413f182bfcf None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:44.388795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 324/630] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 20 17:36:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:44.392092 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb895764-7311-4b0d-9c46-c413f182bfcf None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:44.423415 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:44.460451 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4faefa-594b-4208-acfd-93a3d4d5ccb6 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:44.502464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b77931-beb3-4566-967f-852959579b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:44.503506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b77931-beb3-4566-967f-852959579b8c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:44.504003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b77931-beb3-4566-967f-852959579b8c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:44.504510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b77931-beb3-4566-967f-852959579b8c None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:44.505502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b77931-beb3-4566-967f-852959579b8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:44.506009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b77931-beb3-4566-967f-852959579b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:44.507334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb895764-7311-4b0d-9c46-c413f182bfcf None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:44.507899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b77931-beb3-4566-967f-852959579b8c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:44.522809 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 307/631] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:44.524081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b77931-beb3-4566-967f-852959579b8c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:44.547150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3e94c-43a9-4163-b857-ba5e04374b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:44.547880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3e94c-43a9-4163-b857-ba5e04374b59 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:44.548160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3e94c-43a9-4163-b857-ba5e04374b59 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:44.548433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3e94c-43a9-4163-b857-ba5e04374b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:44.560065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3e94c-43a9-4163-b857-ba5e04374b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:44.561596 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3e94c-43a9-4163-b857-ba5e04374b59 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-dcd3e94c-43a9-4163-b857-ba5e04374b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:44.581255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:44.582204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:44.583072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:44.583072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:44.583072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:44.583072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:44.587238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 325/632] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:44.588189 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3e94c-43a9-4163-b857-ba5e04374b59 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:44.628980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:44.648119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b77931-beb3-4566-967f-852959579b8c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:44.676799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:44.689630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26415c04-fdba-4b55-9ecf-bef6c26c6ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:44.690680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26415c04-fdba-4b55-9ecf-bef6c26c6ed9 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:44.691164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26415c04-fdba-4b55-9ecf-bef6c26c6ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:44.691640 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26415c04-fdba-4b55-9ecf-bef6c26c6ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:44.701880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3e94c-43a9-4163-b857-ba5e04374b59 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:44.739518 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16c39c-256b-40a4-8dc6-060a3cffc33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:44.740434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16c39c-256b-40a4-8dc6-060a3cffc33c None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:44.740745 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16c39c-256b-40a4-8dc6-060a3cffc33c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:44.741023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16c39c-256b-40a4-8dc6-060a3cffc33c None admin] PATH_INFO: `/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/9566befd16fc4b0c84d2bed34c4a5d28/roles/645163d4e8634094bb7d2a16f75bd1b0` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:44.759899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16c39c-256b-40a4-8dc6-060a3cffc33c None admin] RBAC: Authorizing `identity:create_grant(project_id=5f0f8db3986541468c474b78a9b3740a, user_id=9566befd16fc4b0c84d2bed34c4a5d28, role_id=645163d4e8634094bb7d2a16f75bd1b0)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:44.761409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16c39c-256b-40a4-8dc6-060a3cffc33c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:44.780325 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26415c04-fdba-4b55-9ecf-bef6c26c6ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:44.783609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26415c04-fdba-4b55-9ecf-bef6c26c6ed9 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:44.834088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 326/633] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:36:44 2022] PUT /identity/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/9566befd16fc4b0c84d2bed34c4a5d28/roles/645163d4e8634094bb7d2a16f75bd1b0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:36:44.835722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16c39c-256b-40a4-8dc6-060a3cffc33c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:44.998983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:45.031276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16c39c-256b-40a4-8dc6-060a3cffc33c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:45.061006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 308/634] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:45.066199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26415c04-fdba-4b55-9ecf-bef6c26c6ed9 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:45.070121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:45.082754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012fe9d-862e-44b0-882b-a6d150f75271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:45.088038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012fe9d-862e-44b0-882b-a6d150f75271 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:45.088038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012fe9d-862e-44b0-882b-a6d150f75271 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:45.088038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012fe9d-862e-44b0-882b-a6d150f75271 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:45.088038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012fe9d-862e-44b0-882b-a6d150f75271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:45.088038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012fe9d-862e-44b0-882b-a6d150f75271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:45.088705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012fe9d-862e-44b0-882b-a6d150f75271 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:45.107214 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 327/635] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:45.111944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012fe9d-862e-44b0-882b-a6d150f75271 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:45.231613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26415c04-fdba-4b55-9ecf-bef6c26c6ed9 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:45.296645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012fe9d-862e-44b0-882b-a6d150f75271 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:45.309444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21e853-a045-47c5-8127-983f10007f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:45.311854 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21e853-a045-47c5-8127-983f10007f00 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:45.312559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21e853-a045-47c5-8127-983f10007f00 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:45.313146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21e853-a045-47c5-8127-983f10007f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:45.333413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21e853-a045-47c5-8127-983f10007f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:45.336304 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21e853-a045-47c5-8127-983f10007f00 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:45.346692 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c59e2d-eb0d-4022-992f-07ed6d38a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:45.347717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c59e2d-eb0d-4022-992f-07ed6d38a142 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:45.348173 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c59e2d-eb0d-4022-992f-07ed6d38a142 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:45.349367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c59e2d-eb0d-4022-992f-07ed6d38a142 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:45.360795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c59e2d-eb0d-4022-992f-07ed6d38a142 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:45.362503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c59e2d-eb0d-4022-992f-07ed6d38a142 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-5c21e853-a045-47c5-8127-983f10007f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:45.370889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:45.373374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:45.375014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:45.375014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:45.375014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:45.375014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:45.375014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 309/636] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:36:45.376499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b07fa-2482-489d-9bd1-90f23f0bf5e2 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:45.377024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b07fa-2482-489d-9bd1-90f23f0bf5e2 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:45.377516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b07fa-2482-489d-9bd1-90f23f0bf5e2 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:45.379843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 310/637] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:45.382021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d004d8-d99f-4237-b8f7-241b9b5ecf62 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:45.382509 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d004d8-d99f-4237-b8f7-241b9b5ecf62 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:45.382983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d004d8-d99f-4237-b8f7-241b9b5ecf62 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:45.385397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 311/638] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:45.386729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d004d8-d99f-4237-b8f7-241b9b5ecf62 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-22c59e2d-eb0d-4022-992f-07ed6d38a142 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:45.402377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:45.404275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:45.406192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:45.406192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:45.406192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:45.406192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:45.406192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:45.406192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:45.406192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:45.406192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:45.406192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 17:36:45.406192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:45.406192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 328/639] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:45.407323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa79c1-e002-4956-b6fe-b3446033c0a9 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:45.407456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa79c1-e002-4956-b6fe-b3446033c0a9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:45.408423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa79c1-e002-4956-b6fe-b3446033c0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:45.437526 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-81aa79c1-e002-4956-b6fe-b3446033c0a9 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:45.438771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-81aa79c1-e002-4956-b6fe-b3446033c0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:45.455137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:45.497915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:45.526540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 329/640] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:45.528562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0a61d-948a-439b-b0c6-208bada88b41 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:45.528973 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0a61d-948a-439b-b0c6-208bada88b41 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:45.529446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0a61d-948a-439b-b0c6-208bada88b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:45.549307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e9b0a61d-948a-439b-b0c6-208bada88b41 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:45.550554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e9b0a61d-948a-439b-b0c6-208bada88b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:45.583144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d004d8-d99f-4237-b8f7-241b9b5ecf62 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:45.632584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eda74-dd35-4e68-854c-18d65181e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:45.633194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eda74-dd35-4e68-854c-18d65181e391 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:45.633477 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eda74-dd35-4e68-854c-18d65181e391 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:45.633749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eda74-dd35-4e68-854c-18d65181e391 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:45.634483 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579eda74-dd35-4e68-854c-18d65181e391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:45.634790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579eda74-dd35-4e68-854c-18d65181e391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:45.636166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579eda74-dd35-4e68-854c-18d65181e391 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:45.656673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 312/641] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:45.656673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eda74-dd35-4e68-854c-18d65181e391 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:45.657066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 330/642] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:45.657066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0a61d-948a-439b-b0c6-208bada88b41 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:45.786639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0a61d-948a-439b-b0c6-208bada88b41 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:45.798820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:45.800841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:45.808507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eda74-dd35-4e68-854c-18d65181e391 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:45.832421 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fd156-fc78-4093-8bff-096d586c81e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:45.833358 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fd156-fc78-4093-8bff-096d586c81e1 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:45.833646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fd156-fc78-4093-8bff-096d586c81e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:45.833930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fd156-fc78-4093-8bff-096d586c81e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:45.851277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fd156-fc78-4093-8bff-096d586c81e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:45.853625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d21c-9f81-4ffc-a520-5a49949113aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:45.854313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d21c-9f81-4ffc-a520-5a49949113aa None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:45.854666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d21c-9f81-4ffc-a520-5a49949113aa None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:45.854942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d21c-9f81-4ffc-a520-5a49949113aa None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:45.855861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d21c-9f81-4ffc-a520-5a49949113aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:45.856316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d21c-9f81-4ffc-a520-5a49949113aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:45.857970 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d21c-9f81-4ffc-a520-5a49949113aa None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-2b6fd156-fc78-4093-8bff-096d586c81e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:45.867382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:45.868676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:45.869712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:45.869712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:45.869712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:45.869712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:45.869712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:45.869712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:45.869712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:45.869712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:45.869712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:45.869712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:45.869712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:45.869712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:45.874316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 331/643] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:45.875505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fd156-fc78-4093-8bff-096d586c81e1 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:45.890053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 313/644] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jul 20 17:36:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:45.890053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d21c-9f81-4ffc-a520-5a49949113aa None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:46.034050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fd156-fc78-4093-8bff-096d586c81e1 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:46.053901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d21c-9f81-4ffc-a520-5a49949113aa None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:46.088233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6a287-cc4f-487a-9090-4392027892f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:46.089274 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6a287-cc4f-487a-9090-4392027892f0 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:46.089614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6a287-cc4f-487a-9090-4392027892f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:46.089941 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6a287-cc4f-487a-9090-4392027892f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:46.100397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6a287-cc4f-487a-9090-4392027892f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:46.101227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238c19-3620-4b6c-a8ca-377b3b018896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:46.102156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6a287-cc4f-487a-9090-4392027892f0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:46.102837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238c19-3620-4b6c-a8ca-377b3b018896 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:46.103120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238c19-3620-4b6c-a8ca-377b3b018896 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:46.103388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238c19-3620-4b6c-a8ca-377b3b018896 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:46.116866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9238c19-3620-4b6c-a8ca-377b3b018896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-fdd6a287-cc4f-487a-9090-4392027892f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:46.121275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:46.123743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:46.125709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:46.125709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:46.125709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:46.125709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:46.125709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:46.125709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:46.125709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:46.125709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:46.125709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 332/645] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:46.125709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6a287-cc4f-487a-9090-4392027892f0 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-a9238c19-3620-4b6c-a8ca-377b3b018896 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:46.129666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:46.138654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 314/646] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:46.140356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238c19-3620-4b6c-a8ca-377b3b018896 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:46.158409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:46.175331 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:46.262777 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238c19-3620-4b6c-a8ca-377b3b018896 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:46.283206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6a287-cc4f-487a-9090-4392027892f0 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:46.320584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a3e14-da80-4e86-b41a-1a3254615048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:46.321243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a3e14-da80-4e86-b41a-1a3254615048 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:46.321528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a3e14-da80-4e86-b41a-1a3254615048 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:46.321825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a3e14-da80-4e86-b41a-1a3254615048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:46.329126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba735fb-0370-47da-a7b9-7c04c4313c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:46.330264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba735fb-0370-47da-a7b9-7c04c4313c44 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:46.330756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba735fb-0370-47da-a7b9-7c04c4313c44 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:46.331249 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba735fb-0370-47da-a7b9-7c04c4313c44 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:46.332707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba735fb-0370-47da-a7b9-7c04c4313c44 None admin] RBAC: Adding query filter params (name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:46.333239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba735fb-0370-47da-a7b9-7c04c4313c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:46.336002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba735fb-0370-47da-a7b9-7c04c4313c44 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:46.358524 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 333/647] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:46.360891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba735fb-0370-47da-a7b9-7c04c4313c44 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:46.400817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a3e14-da80-4e86-b41a-1a3254615048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:46.403400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a3e14-da80-4e86-b41a-1a3254615048 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:46.425796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:46.495581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:46.507633 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba735fb-0370-47da-a7b9-7c04c4313c44 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:46.552332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 315/648] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:46.553242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a3e14-da80-4e86-b41a-1a3254615048 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:46.562040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25954de-07d7-4302-be76-89a19f526136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:46.562727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25954de-07d7-4302-be76-89a19f526136 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:46.563020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25954de-07d7-4302-be76-89a19f526136 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:46.563342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25954de-07d7-4302-be76-89a19f526136 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:46.564059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25954de-07d7-4302-be76-89a19f526136 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:46.564368 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25954de-07d7-4302-be76-89a19f526136 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:46.565832 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25954de-07d7-4302-be76-89a19f526136 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:46.580738 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 334/649] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:46.586452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25954de-07d7-4302-be76-89a19f526136 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:46.702820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a3e14-da80-4e86-b41a-1a3254615048 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:46.718200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25954de-07d7-4302-be76-89a19f526136 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:46.726599 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:46.754883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6940b62-f738-4e4e-9136-ac434fa76fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:46.756059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6940b62-f738-4e4e-9136-ac434fa76fc3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:46.756607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6940b62-f738-4e4e-9136-ac434fa76fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:46.757120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6940b62-f738-4e4e-9136-ac434fa76fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:46.758655 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6940b62-f738-4e4e-9136-ac434fa76fc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:46.759677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6940b62-f738-4e4e-9136-ac434fa76fc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:46.765958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6940b62-f738-4e4e-9136-ac434fa76fc3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:46.780644 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeef753-832a-4a2f-92a3-850ad1ad7fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:46.782001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeef753-832a-4a2f-92a3-850ad1ad7fc8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:46.787271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeef753-832a-4a2f-92a3-850ad1ad7fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:46.787428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 316/650] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:46.787543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeef753-832a-4a2f-92a3-850ad1ad7fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:46.787620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6940b62-f738-4e4e-9136-ac434fa76fc3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:46.806796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeef753-832a-4a2f-92a3-850ad1ad7fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:46.810507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeef753-832a-4a2f-92a3-850ad1ad7fc8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-cdeef753-832a-4a2f-92a3-850ad1ad7fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:46.844251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:46.845409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:46.846284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:46.846284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:46.846284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:46.846284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:46.851954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 335/651] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:46.851954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeef753-832a-4a2f-92a3-850ad1ad7fc8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:46.857384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:46.947537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6940b62-f738-4e4e-9136-ac434fa76fc3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:47.007976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a4191-9808-474a-a3d9-5a15ef83ba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:47.009208 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a4191-9808-474a-a3d9-5a15ef83ba37 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:47.009799 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a4191-9808-474a-a3d9-5a15ef83ba37 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:47.010300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a4191-9808-474a-a3d9-5a15ef83ba37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:47.031200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeef753-832a-4a2f-92a3-850ad1ad7fc8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:47.032383 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a4191-9808-474a-a3d9-5a15ef83ba37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:47.035203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a4191-9808-474a-a3d9-5a15ef83ba37 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-581a4191-9808-474a-a3d9-5a15ef83ba37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:47.071903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:47.073941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:47.083210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:47.083210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:47.083210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:47.083210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:47.083210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 317/652] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:47.083210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a4191-9808-474a-a3d9-5a15ef83ba37 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:47.083909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb045d47-6211-41e6-92ae-270ede0026e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:47.083909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb045d47-6211-41e6-92ae-270ede0026e3 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:47.084652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb045d47-6211-41e6-92ae-270ede0026e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:47.084922 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb045d47-6211-41e6-92ae-270ede0026e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:47.086447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb045d47-6211-41e6-92ae-270ede0026e3 None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=3b52e88df44d49b186d54a8d045595ed) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:47.088120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb045d47-6211-41e6-92ae-270ede0026e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:47.088963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb045d47-6211-41e6-92ae-270ede0026e3 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:47.100521 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 336/653] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:36:46 2022] GET /identity/v3/role_assignments?user.id=3b52e88df44d49b186d54a8d045595ed&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:47.105334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb045d47-6211-41e6-92ae-270ede0026e3 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:47.146172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:47.266010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:47.290947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a4191-9808-474a-a3d9-5a15ef83ba37 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:47.326223 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb045d47-6211-41e6-92ae-270ede0026e3 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:47.370902 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e13bc-852e-413a-ae72-385a72f5d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:47.372298 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e13bc-852e-413a-ae72-385a72f5d646 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:47.372803 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e13bc-852e-413a-ae72-385a72f5d646 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:47.373267 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e13bc-852e-413a-ae72-385a72f5d646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:47.378673 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c8e10-cd19-4318-a924-bc4fa4eea9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:47.379566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c8e10-cd19-4318-a924-bc4fa4eea9ca None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:47.380045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c8e10-cd19-4318-a924-bc4fa4eea9ca None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:47.380615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c8e10-cd19-4318-a924-bc4fa4eea9ca None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:47.382035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c8e10-cd19-4318-a924-bc4fa4eea9ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:47.382035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c8e10-cd19-4318-a924-bc4fa4eea9ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:47.383729 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c8e10-cd19-4318-a924-bc4fa4eea9ca None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:47.391746 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e13bc-852e-413a-ae72-385a72f5d646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:47.395411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e13bc-852e-413a-ae72-385a72f5d646 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:47.411063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 337/654] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:47.412518 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c8e10-cd19-4318-a924-bc4fa4eea9ca None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-6c0e13bc-852e-413a-ae72-385a72f5d646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:47.426665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:47.428410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:47.430199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:47.430199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:47.430199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:47.430199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:47.430199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 318/655] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:47.431639 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a59b78-794e-44e2-8aa4-e336d8882b0a None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:47.431639 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a59b78-794e-44e2-8aa4-e336d8882b0a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:47.431639 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a59b78-794e-44e2-8aa4-e336d8882b0a None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:47.432961 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 319/656] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:47.433759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a59b78-794e-44e2-8aa4-e336d8882b0a None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:47.556238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:47.565218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c8e10-cd19-4318-a924-bc4fa4eea9ca None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:47.585352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a59b78-794e-44e2-8aa4-e336d8882b0a None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:47.597669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:47.611104 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f45a1-eb54-4ba8-97d3-2cf1426dc7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:47.613132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f45a1-eb54-4ba8-97d3-2cf1426dc7c2 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:47.613602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f45a1-eb54-4ba8-97d3-2cf1426dc7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:47.614074 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f45a1-eb54-4ba8-97d3-2cf1426dc7c2 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:47.615347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f45a1-eb54-4ba8-97d3-2cf1426dc7c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:47.615856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f45a1-eb54-4ba8-97d3-2cf1426dc7c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:47.618294 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f45a1-eb54-4ba8-97d3-2cf1426dc7c2 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:47.636646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e7c39-b089-405f-a0a2-d6285d672984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:47.638160 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e7c39-b089-405f-a0a2-d6285d672984 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:47.643604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e7c39-b089-405f-a0a2-d6285d672984 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:47.643768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 338/657] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:47.643850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e7c39-b089-405f-a0a2-d6285d672984 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:47.643947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e095f1-13a3-4094-b2e1-135981e10e7e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:47.643947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e095f1-13a3-4094-b2e1-135981e10e7e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:47.643947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e095f1-13a3-4094-b2e1-135981e10e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:47.656613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e7c39-b089-405f-a0a2-d6285d672984 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:47.659296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e7c39-b089-405f-a0a2-d6285d672984 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:47.667535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a6e095f1-13a3-4094-b2e1-135981e10e7e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:47.669678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a6e095f1-13a3-4094-b2e1-135981e10e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-932e7c39-b089-405f-a0a2-d6285d672984 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:47.679178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:47.688055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:47.689336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:47.689336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:47.689336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:47.689336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:47.689336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:47.689336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:47.689336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:47.689336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:47.689336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 17:36:47.689336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:47.689336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 320/658] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:47.689336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e7c39-b089-405f-a0a2-d6285d672984 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:47.772512 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 339/659] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:47.772512 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e095f1-13a3-4094-b2e1-135981e10e7e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:47.828170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e7c39-b089-405f-a0a2-d6285d672984 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:47.883050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca339298-1127-4f97-ab5e-166e80755f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:47.883970 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339298-1127-4f97-ab5e-166e80755f37 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:47.884279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339298-1127-4f97-ab5e-166e80755f37 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:47.884607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339298-1127-4f97-ab5e-166e80755f37 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:47.885380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca339298-1127-4f97-ab5e-166e80755f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:47.885680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca339298-1127-4f97-ab5e-166e80755f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:47.887670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca339298-1127-4f97-ab5e-166e80755f37 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:47.898538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:47.911049 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 321/660] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:47.911049 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca339298-1127-4f97-ab5e-166e80755f37 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:47.940405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e095f1-13a3-4094-b2e1-135981e10e7e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:47.970572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:47.996218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186969b-743c-4018-9235-92ea06394570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:47.998330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186969b-743c-4018-9235-92ea06394570 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:47.999072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186969b-743c-4018-9235-92ea06394570 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:48.000016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186969b-743c-4018-9235-92ea06394570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:48.020701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186969b-743c-4018-9235-92ea06394570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:48.023661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186969b-743c-4018-9235-92ea06394570 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-e186969b-743c-4018-9235-92ea06394570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:48.051714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:48.052945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:48.053844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:48.053844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:48.053844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:48.053844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:48.053844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:48.053844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:48.053844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:48.053844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:48.054281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 340/661] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:48.055670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186969b-743c-4018-9235-92ea06394570 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:48.084042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca339298-1127-4f97-ab5e-166e80755f37 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:48.152098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe55f6f-31c9-4e68-97fd-fd6115e4d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:48.154434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe55f6f-31c9-4e68-97fd-fd6115e4d0ce None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:48.155127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe55f6f-31c9-4e68-97fd-fd6115e4d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:48.155753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe55f6f-31c9-4e68-97fd-fd6115e4d0ce None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:48.157451 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe55f6f-31c9-4e68-97fd-fd6115e4d0ce None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:48.157999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe55f6f-31c9-4e68-97fd-fd6115e4d0ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:48.160821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe55f6f-31c9-4e68-97fd-fd6115e4d0ce None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:48.205248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 322/662] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Jul 20 17:36:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:48.205248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe55f6f-31c9-4e68-97fd-fd6115e4d0ce None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:48.234969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186969b-743c-4018-9235-92ea06394570 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:48.295056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ef790-2492-4e27-8af5-b75c96546586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:48.296432 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ef790-2492-4e27-8af5-b75c96546586 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:48.296989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ef790-2492-4e27-8af5-b75c96546586 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:48.297155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ef790-2492-4e27-8af5-b75c96546586 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:48.319901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ef790-2492-4e27-8af5-b75c96546586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:48.322094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-ca6ef790-2492-4e27-8af5-b75c96546586 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:48.338946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:48.341361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:48.343156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:48.343156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:48.343156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:48.343156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:48.343156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:48.343156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:48.343156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:48.343156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:48.343156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:48.343156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:48.343156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:48.343156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:48.345098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 341/663] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:48.346288 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ef790-2492-4e27-8af5-b75c96546586 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:48.401982 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:48.417514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe55f6f-31c9-4e68-97fd-fd6115e4d0ce None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:48.478408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bec85-403b-4bde-9684-2be72d1fca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:48.480271 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bec85-403b-4bde-9684-2be72d1fca7f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:48.482114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bec85-403b-4bde-9684-2be72d1fca7f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:48.482919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bec85-403b-4bde-9684-2be72d1fca7f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:48.486847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ef790-2492-4e27-8af5-b75c96546586 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:48.501386 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bec85-403b-4bde-9684-2be72d1fca7f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:48.502899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bec85-403b-4bde-9684-2be72d1fca7f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-ae0bec85-403b-4bde-9684-2be72d1fca7f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:48.518397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:48.520268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:48.522145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:48.522145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:48.522145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:48.522145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:48.522145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:48.522145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:48.522145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:48.522145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:48.522145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 17:36:48.522145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:48.522145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 323/664] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:48.522145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bec85-403b-4bde-9684-2be72d1fca7f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:48.555901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c41a5-ec60-4204-a98f-e39ac8f83847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:48.557098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c41a5-ec60-4204-a98f-e39ac8f83847 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:48.557607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c41a5-ec60-4204-a98f-e39ac8f83847 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:48.558121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c41a5-ec60-4204-a98f-e39ac8f83847 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:48.560134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c41a5-ec60-4204-a98f-e39ac8f83847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:48.560609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c41a5-ec60-4204-a98f-e39ac8f83847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:48.563345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c41a5-ec60-4204-a98f-e39ac8f83847 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:48.585290 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 342/665] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:48.587213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c41a5-ec60-4204-a98f-e39ac8f83847 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:48.691002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bec85-403b-4bde-9684-2be72d1fca7f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:48.713258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:48.735695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17452f-4cb9-4f43-aaad-1d127241c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:48.736594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17452f-4cb9-4f43-aaad-1d127241c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:48.736882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17452f-4cb9-4f43-aaad-1d127241c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:48.737156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17452f-4cb9-4f43-aaad-1d127241c1b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:48.765962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:48.776343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c41a5-ec60-4204-a98f-e39ac8f83847 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:48.833065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17452f-4cb9-4f43-aaad-1d127241c1b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:48.834528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17452f-4cb9-4f43-aaad-1d127241c1b7 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:48.838806 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a965aed-863b-488b-8d2f-11b3d65bca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:48.839962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a965aed-863b-488b-8d2f-11b3d65bca06 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:48.841509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a965aed-863b-488b-8d2f-11b3d65bca06 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:48.841989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a965aed-863b-488b-8d2f-11b3d65bca06 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:48.843461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a965aed-863b-488b-8d2f-11b3d65bca06 None admin] RBAC: Adding query filter params (name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:48.844027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a965aed-863b-488b-8d2f-11b3d65bca06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:48.846700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a965aed-863b-488b-8d2f-11b3d65bca06 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:48.868531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 343/666] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:48.868531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a965aed-863b-488b-8d2f-11b3d65bca06 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:48.971812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 324/667] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:48.972960 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17452f-4cb9-4f43-aaad-1d127241c1b7 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:48.994122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:49.051846 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a965aed-863b-488b-8d2f-11b3d65bca06 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:49.108029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17452f-4cb9-4f43-aaad-1d127241c1b7 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:49.112301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439f961-4dcd-44dd-9654-5d0f31667534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:49.113916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439f961-4dcd-44dd-9654-5d0f31667534 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:49.113916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439f961-4dcd-44dd-9654-5d0f31667534 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:49.113916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439f961-4dcd-44dd-9654-5d0f31667534 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:49.114439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439f961-4dcd-44dd-9654-5d0f31667534 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:49.114731 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439f961-4dcd-44dd-9654-5d0f31667534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:49.116205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439f961-4dcd-44dd-9654-5d0f31667534 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:49.143980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 344/668] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Jul 20 17:36:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:49.150056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439f961-4dcd-44dd-9654-5d0f31667534 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:49.173348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3fa87-987b-4692-b82b-5b00e5957c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:49.174350 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3fa87-987b-4692-b82b-5b00e5957c9a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:49.174765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3fa87-987b-4692-b82b-5b00e5957c9a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:49.175170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3fa87-987b-4692-b82b-5b00e5957c9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:49.176191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3fa87-987b-4692-b82b-5b00e5957c9a None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=259d506eb54e4766a8fe3fa5bb514e89) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:49.176752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3fa87-987b-4692-b82b-5b00e5957c9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:49.178525 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3fa87-987b-4692-b82b-5b00e5957c9a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:49.191002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:49.194399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 325/669] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:36:48 2022] GET /identity/v3/role_assignments?user.id=259d506eb54e4766a8fe3fa5bb514e89&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:49.196563 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3fa87-987b-4692-b82b-5b00e5957c9a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:49.371283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:49.383767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439f961-4dcd-44dd-9654-5d0f31667534 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:49.407511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3fa87-987b-4692-b82b-5b00e5957c9a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:49.447974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9ddfa-7c76-448d-922a-6ffa0414967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:49.448925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9ddfa-7c76-448d-922a-6ffa0414967e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:49.449226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9ddfa-7c76-448d-922a-6ffa0414967e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:49.449543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9ddfa-7c76-448d-922a-6ffa0414967e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:49.458358 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3515553-2cbf-404b-95d1-34a279b23aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:49.459874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3515553-2cbf-404b-95d1-34a279b23aec None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:49.460165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3515553-2cbf-404b-95d1-34a279b23aec None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:49.460450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3515553-2cbf-404b-95d1-34a279b23aec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:49.467857 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9ddfa-7c76-448d-922a-6ffa0414967e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:49.472047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9ddfa-7c76-448d-922a-6ffa0414967e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:49.479132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3515553-2cbf-404b-95d1-34a279b23aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:49.481734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3515553-2cbf-404b-95d1-34a279b23aec None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-d3515553-2cbf-404b-95d1-34a279b23aec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:49.504564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:49.506167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:49.507798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:49.507798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:49.507798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:49.507798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-8af9ddfa-7c76-448d-922a-6ffa0414967e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:49.508192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:49.511701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:49.516643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:49.516643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:49.516643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:49.516643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:49.516643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 345/671] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:49.517312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 326/671] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:49.517452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9ddfa-7c76-448d-922a-6ffa0414967e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:49.517613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3515553-2cbf-404b-95d1-34a279b23aec None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:49.611723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:49.659212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9ddfa-7c76-448d-922a-6ffa0414967e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:49.706533 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3515553-2cbf-404b-95d1-34a279b23aec None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:49.707441 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734e79d-1a20-46b2-a9c0-23d3c3982301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:49.708220 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734e79d-1a20-46b2-a9c0-23d3c3982301 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:49.708649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734e79d-1a20-46b2-a9c0-23d3c3982301 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:49.709033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734e79d-1a20-46b2-a9c0-23d3c3982301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:49.757406 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcff31-eeaa-4eb7-9e95-0052d0c4bb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:49.758864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcff31-eeaa-4eb7-9e95-0052d0c4bb35 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:49.758996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcff31-eeaa-4eb7-9e95-0052d0c4bb35 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:49.759478 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcff31-eeaa-4eb7-9e95-0052d0c4bb35 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:49.760843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcff31-eeaa-4eb7-9e95-0052d0c4bb35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:49.761395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcff31-eeaa-4eb7-9e95-0052d0c4bb35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:49.764747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcff31-eeaa-4eb7-9e95-0052d0c4bb35 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:49.767518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:49.784579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 327/672] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:49.786362 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcff31-eeaa-4eb7-9e95-0052d0c4bb35 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:49.806436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734e79d-1a20-46b2-a9c0-23d3c3982301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:49.810359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734e79d-1a20-46b2-a9c0-23d3c3982301 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:49.898543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcff31-eeaa-4eb7-9e95-0052d0c4bb35 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:49.924267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:49.939342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b43a6-a064-4cfe-a22d-320d59295a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:49.940021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b43a6-a064-4cfe-a22d-320d59295a9c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:49.942908 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b43a6-a064-4cfe-a22d-320d59295a9c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:49.942908 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b43a6-a064-4cfe-a22d-320d59295a9c None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:49.942908 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b43a6-a064-4cfe-a22d-320d59295a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:49.942908 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b43a6-a064-4cfe-a22d-320d59295a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:49.943351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b43a6-a064-4cfe-a22d-320d59295a9c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:49.961172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 328/673] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:49.961172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8abc24-20b3-4923-9458-652c1f5bb8d8 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:49.961172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8abc24-20b3-4923-9458-652c1f5bb8d8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:49.961172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8abc24-20b3-4923-9458-652c1f5bb8d8 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:49.961172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 329/674] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:49.961172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8abc24-20b3-4923-9458-652c1f5bb8d8 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:49.994641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 346/675] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:49.995962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734e79d-1a20-46b2-a9c0-23d3c3982301 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:50.031061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:50.099860 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8abc24-20b3-4923-9458-652c1f5bb8d8 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:50.142819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5c4d0-8d15-481a-ac7d-9d8a677ccc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:50.143036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734e79d-1a20-46b2-a9c0-23d3c3982301 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:50.143743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5c4d0-8d15-481a-ac7d-9d8a677ccc03 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:50.144031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5c4d0-8d15-481a-ac7d-9d8a677ccc03 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:50.144305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5c4d0-8d15-481a-ac7d-9d8a677ccc03 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:50.153448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5c4d0-8d15-481a-ac7d-9d8a677ccc03 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:50.154903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5c4d0-8d15-481a-ac7d-9d8a677ccc03 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-b7d5c4d0-8d15-481a-ac7d-9d8a677ccc03 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:50.171518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:50.172596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:50.173976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:50.173976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:50.173976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:50.173976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:50.173976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:50.173976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:50.173976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:50.173976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:50.173976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 17:36:50.173976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:50.173976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 330/676] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:36:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:50.174639 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2d8c9-8a6d-405c-b0a0-2055c743ac93 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:50.174639 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2d8c9-8a6d-405c-b0a0-2055c743ac93 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:50.174775 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2d8c9-8a6d-405c-b0a0-2055c743ac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:50.195017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-2ff2d8c9-8a6d-405c-b0a0-2055c743ac93 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:50.196232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2ff2d8c9-8a6d-405c-b0a0-2055c743ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:50.208204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54361810-0309-4380-81cd-f72d9040aab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:50.209583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54361810-0309-4380-81cd-f72d9040aab9 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:50.210074 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54361810-0309-4380-81cd-f72d9040aab9 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:50.210544 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54361810-0309-4380-81cd-f72d9040aab9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:50.224013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54361810-0309-4380-81cd-f72d9040aab9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:50.226713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54361810-0309-4380-81cd-f72d9040aab9 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-54361810-0309-4380-81cd-f72d9040aab9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:50.253976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:50.255095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:50.256157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:50.256157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:50.256157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:50.256157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:50.256157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:50.256157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:50.256157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:50.256157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:50.256719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 347/677] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:50.257838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54361810-0309-4380-81cd-f72d9040aab9 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:50.276373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 331/678] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:50.277616 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2d8c9-8a6d-405c-b0a0-2055c743ac93 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:50.301638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:50.351411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:50.417545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54361810-0309-4380-81cd-f72d9040aab9 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:50.422090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2d8c9-8a6d-405c-b0a0-2055c743ac93 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:50.457846 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e301e-12c0-426b-8cce-6dca2c5c9332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:50.458508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e301e-12c0-426b-8cce-6dca2c5c9332 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:50.458796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e301e-12c0-426b-8cce-6dca2c5c9332 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:50.459069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e301e-12c0-426b-8cce-6dca2c5c9332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:50.464883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2e88-25ad-47e1-b19a-b2fd36c74b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:50.465877 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2e88-25ad-47e1-b19a-b2fd36c74b80 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:50.466249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2e88-25ad-47e1-b19a-b2fd36c74b80 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:50.466525 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2e88-25ad-47e1-b19a-b2fd36c74b80 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:50.467393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e2e88-25ad-47e1-b19a-b2fd36c74b80 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:50.467701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e2e88-25ad-47e1-b19a-b2fd36c74b80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:50.469322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e2e88-25ad-47e1-b19a-b2fd36c74b80 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:50.471273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e301e-12c0-426b-8cce-6dca2c5c9332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:50.472804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e301e-12c0-426b-8cce-6dca2c5c9332 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:50.488503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 332/679] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jul 20 17:36:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:50.489694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2e88-25ad-47e1-b19a-b2fd36c74b80 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-0b8e301e-12c0-426b-8cce-6dca2c5c9332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:50.507211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:50.508180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:50.509136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:50.509136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:50.509136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:50.509136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:50.509949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 348/680] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:50.512885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e301e-12c0-426b-8cce-6dca2c5c9332 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:50.612191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:50.614208 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2e88-25ad-47e1-b19a-b2fd36c74b80 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:50.615867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:50.634055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e301e-12c0-426b-8cce-6dca2c5c9332 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:50.653395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853ab78-235b-49d1-848e-13bbb3e6f3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:50.653813 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853ab78-235b-49d1-848e-13bbb3e6f3df None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:50.654095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853ab78-235b-49d1-848e-13bbb3e6f3df None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:50.654370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853ab78-235b-49d1-848e-13bbb3e6f3df None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:50.655228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853ab78-235b-49d1-848e-13bbb3e6f3df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:50.655553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853ab78-235b-49d1-848e-13bbb3e6f3df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:50.657156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853ab78-235b-49d1-848e-13bbb3e6f3df None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:50.671477 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 333/681] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:50.672347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853ab78-235b-49d1-848e-13bbb3e6f3df None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:50.681315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8f855-f16c-41e7-802c-a37aadaf3735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:50.682281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8f855-f16c-41e7-802c-a37aadaf3735 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:50.682693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8f855-f16c-41e7-802c-a37aadaf3735 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:50.683085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8f855-f16c-41e7-802c-a37aadaf3735 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:50.695742 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8f855-f16c-41e7-802c-a37aadaf3735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-80a8f855-f16c-41e7-802c-a37aadaf3735 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:50.703808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:50.705128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:50.706163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 349/682] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:36:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:50.707001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8f855-f16c-41e7-802c-a37aadaf3735 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:50.814236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853ab78-235b-49d1-848e-13bbb3e6f3df None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:50.833336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8f855-f16c-41e7-802c-a37aadaf3735 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:50.881368 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfda7d9-07bb-4214-b598-30cffb929c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:50.882482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfda7d9-07bb-4214-b598-30cffb929c0c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:50.882980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfda7d9-07bb-4214-b598-30cffb929c0c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:50.883472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfda7d9-07bb-4214-b598-30cffb929c0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:50.893913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f1b61-b078-48a2-b76a-abe5358d8842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:50.895100 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f1b61-b078-48a2-b76a-abe5358d8842 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:50.895615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f1b61-b078-48a2-b76a-abe5358d8842 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:50.896118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f1b61-b078-48a2-b76a-abe5358d8842 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:50.897541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f1b61-b078-48a2-b76a-abe5358d8842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:50.898075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f1b61-b078-48a2-b76a-abe5358d8842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:50.900681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f1b61-b078-48a2-b76a-abe5358d8842 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:50.919306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:50.935050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 350/683] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:50.936760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f1b61-b078-48a2-b76a-abe5358d8842 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:50.941978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:51.013039 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfda7d9-07bb-4214-b598-30cffb929c0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:51.015847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfda7d9-07bb-4214-b598-30cffb929c0c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:51.113766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f1b61-b078-48a2-b76a-abe5358d8842 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:51.177112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922aa12-cbd6-4f2b-906d-1a3fe3db838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:51.178737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922aa12-cbd6-4f2b-906d-1a3fe3db838e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:51.179448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922aa12-cbd6-4f2b-906d-1a3fe3db838e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:51.179948 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922aa12-cbd6-4f2b-906d-1a3fe3db838e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:51.181626 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922aa12-cbd6-4f2b-906d-1a3fe3db838e None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=11930f08a1324902a083436649660130) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:51.182200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922aa12-cbd6-4f2b-906d-1a3fe3db838e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:51.182468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 334/684] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:51.184055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfda7d9-07bb-4214-b598-30cffb929c0c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:51.185062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922aa12-cbd6-4f2b-906d-1a3fe3db838e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:51.197269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 351/685] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:36:50 2022] GET /identity/v3/role_assignments?user.id=11930f08a1324902a083436649660130&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:51.201147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922aa12-cbd6-4f2b-906d-1a3fe3db838e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:51.313488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:51.314180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:51.366283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922aa12-cbd6-4f2b-906d-1a3fe3db838e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:51.414446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfda7d9-07bb-4214-b598-30cffb929c0c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:51.417024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b065beb-48b0-4a9d-90fa-3000f4aab447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:51.418089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065beb-48b0-4a9d-90fa-3000f4aab447 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:51.419943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065beb-48b0-4a9d-90fa-3000f4aab447 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:51.420578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065beb-48b0-4a9d-90fa-3000f4aab447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:51.430283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b065beb-48b0-4a9d-90fa-3000f4aab447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:51.432614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b065beb-48b0-4a9d-90fa-3000f4aab447 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-1b065beb-48b0-4a9d-90fa-3000f4aab447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:51.451233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:51.452276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:51.453192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:51.453192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:51.453192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:51.453192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:51.453192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:51.453192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:51.453192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:51.453192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:51.456196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 352/686] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:51.457594 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b065beb-48b0-4a9d-90fa-3000f4aab447 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:51.507029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c1eb6-ddb5-462d-9466-384751189894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:51.508590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c1eb6-ddb5-462d-9466-384751189894 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:51.509090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c1eb6-ddb5-462d-9466-384751189894 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:51.509581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c1eb6-ddb5-462d-9466-384751189894 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:51.511330 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c1eb6-ddb5-462d-9466-384751189894 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:51.512553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c1eb6-ddb5-462d-9466-384751189894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:51.515992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c1eb6-ddb5-462d-9466-384751189894 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:51.540427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 335/687] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:51.542396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c1eb6-ddb5-462d-9466-384751189894 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:51.639861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b065beb-48b0-4a9d-90fa-3000f4aab447 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:51.704433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:51.733861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d6e0-c4ef-416d-9501-2f326b32737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:51.736677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d6e0-c4ef-416d-9501-2f326b32737e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:51.738013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d6e0-c4ef-416d-9501-2f326b32737e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:51.738823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d6e0-c4ef-416d-9501-2f326b32737e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:51.754835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c1eb6-ddb5-462d-9466-384751189894 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:51.768550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718d6e0-c4ef-416d-9501-2f326b32737e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:51.773036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718d6e0-c4ef-416d-9501-2f326b32737e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:51.812456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-4718d6e0-c4ef-416d-9501-2f326b32737e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:51.813393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:51.815095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:51.817635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:51.817635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:51.817635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:51.817635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:51.817635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 353/688] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:51.818206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d6e0-c4ef-416d-9501-2f326b32737e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:51.849693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0ea48-c9e3-4fb2-ae03-bf192dbe790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:51.851769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0ea48-c9e3-4fb2-ae03-bf192dbe790a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:51.853478 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0ea48-c9e3-4fb2-ae03-bf192dbe790a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:51.854307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0ea48-c9e3-4fb2-ae03-bf192dbe790a None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:51.857635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0ea48-c9e3-4fb2-ae03-bf192dbe790a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:51.858635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0ea48-c9e3-4fb2-ae03-bf192dbe790a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:51.863082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0ea48-c9e3-4fb2-ae03-bf192dbe790a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:51.899385 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 336/689] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:51.899385 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0ea48-c9e3-4fb2-ae03-bf192dbe790a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:52.001018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d6e0-c4ef-416d-9501-2f326b32737e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:52.064276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5ca0e-6767-4e8e-aac3-b79a65968af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:52.065480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5ca0e-6767-4e8e-aac3-b79a65968af0 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:52.065931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5ca0e-6767-4e8e-aac3-b79a65968af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:52.066381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5ca0e-6767-4e8e-aac3-b79a65968af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:52.081275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0ea48-c9e3-4fb2-ae03-bf192dbe790a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:52.083396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5ca0e-6767-4e8e-aac3-b79a65968af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:52.085994 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5ca0e-6767-4e8e-aac3-b79a65968af0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-c5f5ca0e-6767-4e8e-aac3-b79a65968af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:52.120727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:52.122353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:52.123756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:52.123756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:52.123756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:52.123756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:52.123756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 354/690] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:52.125287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f26369-fd52-4414-b5f0-b50fd1e28900 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:52.125795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f26369-fd52-4414-b5f0-b50fd1e28900 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:52.126292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f26369-fd52-4414-b5f0-b50fd1e28900 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:52.132750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 355/691] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:52.132750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f26369-fd52-4414-b5f0-b50fd1e28900 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:52.142520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b5676-61d1-4e27-a079-8937637c8180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:52.143643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b5676-61d1-4e27-a079-8937637c8180 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:52.144684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b5676-61d1-4e27-a079-8937637c8180 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:52.144995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b5676-61d1-4e27-a079-8937637c8180 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:52.145753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b5676-61d1-4e27-a079-8937637c8180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:52.146060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b5676-61d1-4e27-a079-8937637c8180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:52.147467 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b5676-61d1-4e27-a079-8937637c8180 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:52.169265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 337/692] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:52.169265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b5676-61d1-4e27-a079-8937637c8180 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:52.189778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:52.224800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:52.307713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f26369-fd52-4414-b5f0-b50fd1e28900 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:52.318716 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b5676-61d1-4e27-a079-8937637c8180 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:52.351261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e0997-9f44-4965-8632-5052f5f95472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:52.352043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e0997-9f44-4965-8632-5052f5f95472 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:52.352323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e0997-9f44-4965-8632-5052f5f95472 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:52.352636 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e0997-9f44-4965-8632-5052f5f95472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:52.353601 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e0997-9f44-4965-8632-5052f5f95472 None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=4dfd634e889c4b53a1ed6b90cc1a25e9) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:52.353903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e0997-9f44-4965-8632-5052f5f95472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:52.355330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e0997-9f44-4965-8632-5052f5f95472 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:52.364335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 356/693] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:36:52 2022] GET /identity/v3/role_assignments?user.id=4dfd634e889c4b53a1ed6b90cc1a25e9&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:52.366149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60283c6-a3f0-4129-a87f-333188698b44 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:52.366484 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60283c6-a3f0-4129-a87f-333188698b44 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:52.366968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60283c6-a3f0-4129-a87f-333188698b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:52.386444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3cf4e-27fa-445a-b73a-bdd769357993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:52.388721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3cf4e-27fa-445a-b73a-bdd769357993 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:52.389499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3cf4e-27fa-445a-b73a-bdd769357993 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:52.390228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3cf4e-27fa-445a-b73a-bdd769357993 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:52.391945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3cf4e-27fa-445a-b73a-bdd769357993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:52.392902 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3cf4e-27fa-445a-b73a-bdd769357993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:52.395596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3cf4e-27fa-445a-b73a-bdd769357993 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:52.415422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a60283c6-a3f0-4129-a87f-333188698b44 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:52.420330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a60283c6-a3f0-4129-a87f-333188698b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:52.431252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 338/694] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:52.432894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3cf4e-27fa-445a-b73a-bdd769357993 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:52.594453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 357/695] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:52.595997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60283c6-a3f0-4129-a87f-333188698b44 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:52.658357 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3cf4e-27fa-445a-b73a-bdd769357993 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:52.662093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:52.668171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:52.717120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8da273-574b-46b8-b4df-dca3b92754a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:52.717120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8da273-574b-46b8-b4df-dca3b92754a7 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:52.717120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8da273-574b-46b8-b4df-dca3b92754a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:52.717658 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8da273-574b-46b8-b4df-dca3b92754a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:52.726313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8da273-574b-46b8-b4df-dca3b92754a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:52.728300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8da273-574b-46b8-b4df-dca3b92754a7 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-bb8da273-574b-46b8-b4df-dca3b92754a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:52.747974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:52.749925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:52.751709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:52.751709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:52.751709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:52.751709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:52.751709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:52.751709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:52.751709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:52.751709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:52.751709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 339/696] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:52.751709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8da273-574b-46b8-b4df-dca3b92754a7 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:52.797613 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60283c6-a3f0-4129-a87f-333188698b44 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:52.838699 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89634-ed2d-437b-8df5-79ae3ed00fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:52.839522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89634-ed2d-437b-8df5-79ae3ed00fff None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:52.839812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89634-ed2d-437b-8df5-79ae3ed00fff None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:52.840085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89634-ed2d-437b-8df5-79ae3ed00fff None admin] PATH_INFO: `/v3/users/nova` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:52.848523 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a89634-ed2d-437b-8df5-79ae3ed00fff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:52.849838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a89634-ed2d-437b-8df5-79ae3ed00fff None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-32a89634-ed2d-437b-8df5-79ae3ed00fff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:52.865892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:52.867571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:52.869462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:52.869462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:52.869462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:52.869462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:52.869462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:52.869462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:52.869462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:52.869462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:52.869462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:36:52.869462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:52.869462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 358/697] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 20 17:36:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:52.869462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89634-ed2d-437b-8df5-79ae3ed00fff None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:52.965292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:52.970290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8da273-574b-46b8-b4df-dca3b92754a7 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:52.985652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89634-ed2d-437b-8df5-79ae3ed00fff None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:53.024935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494b4c6-4657-464d-9046-6fcea182c87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:53.025637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b4c6-4657-464d-9046-6fcea182c87d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:53.025919 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b4c6-4657-464d-9046-6fcea182c87d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:53.026219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b4c6-4657-464d-9046-6fcea182c87d None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:53.027024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494b4c6-4657-464d-9046-6fcea182c87d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:53.027465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494b4c6-4657-464d-9046-6fcea182c87d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:53.028963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494b4c6-4657-464d-9046-6fcea182c87d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:53.042560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 359/698] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:53.044032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494b4c6-4657-464d-9046-6fcea182c87d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:53.046275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32ebe2-8eaa-4f47-ae78-a458a81c8adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:53.048323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32ebe2-8eaa-4f47-ae78-a458a81c8adf None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:53.049223 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32ebe2-8eaa-4f47-ae78-a458a81c8adf None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:53.049911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32ebe2-8eaa-4f47-ae78-a458a81c8adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:53.073823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32ebe2-8eaa-4f47-ae78-a458a81c8adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:53.078034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32ebe2-8eaa-4f47-ae78-a458a81c8adf None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-bc32ebe2-8eaa-4f47-ae78-a458a81c8adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:53.113788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:53.115570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:53.118003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:53.118003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:53.118003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:53.118003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:53.127334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 340/699] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:53.129564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32ebe2-8eaa-4f47-ae78-a458a81c8adf None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:53.157974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494b4c6-4657-464d-9046-6fcea182c87d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:53.177502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:53.200857 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9822b6-2266-44b8-b436-09f2e54b0a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:53.201185 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9822b6-2266-44b8-b436-09f2e54b0a0d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:53.201505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9822b6-2266-44b8-b436-09f2e54b0a0d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:53.201827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9822b6-2266-44b8-b436-09f2e54b0a0d None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:53.203114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9822b6-2266-44b8-b436-09f2e54b0a0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:53.203114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9822b6-2266-44b8-b436-09f2e54b0a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:53.204613 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9822b6-2266-44b8-b436-09f2e54b0a0d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:53.222672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:53.226973 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 360/700] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 20 17:36:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:53.227909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9822b6-2266-44b8-b436-09f2e54b0a0d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:53.351086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9822b6-2266-44b8-b436-09f2e54b0a0d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:53.351786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32ebe2-8eaa-4f47-ae78-a458a81c8adf None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:53.396742 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863bd00-2358-43dc-9037-a5363755aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:53.397489 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863bd00-2358-43dc-9037-a5363755aeaf None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:53.397779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863bd00-2358-43dc-9037-a5363755aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:53.398063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863bd00-2358-43dc-9037-a5363755aeaf None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:53.398807 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863bd00-2358-43dc-9037-a5363755aeaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:53.399122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863bd00-2358-43dc-9037-a5363755aeaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:53.400598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863bd00-2358-43dc-9037-a5363755aeaf None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:53.414458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 361/701] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:53.415386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863bd00-2358-43dc-9037-a5363755aeaf None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:53.428340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3328a-3136-44a0-a6ae-67264efd04ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:53.429549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3328a-3136-44a0-a6ae-67264efd04ff None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:53.430263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3328a-3136-44a0-a6ae-67264efd04ff None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:53.431044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3328a-3136-44a0-a6ae-67264efd04ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:53.432691 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3328a-3136-44a0-a6ae-67264efd04ff None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=9566befd16fc4b0c84d2bed34c4a5d28) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:53.433533 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3328a-3136-44a0-a6ae-67264efd04ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:53.436258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3328a-3136-44a0-a6ae-67264efd04ff None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:53.452659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 341/702] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:36:53 2022] GET /identity/v3/role_assignments?user.id=9566befd16fc4b0c84d2bed34c4a5d28&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:53.454661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3328a-3136-44a0-a6ae-67264efd04ff None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:53.493170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:53.543945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863bd00-2358-43dc-9037-a5363755aeaf None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:53.587460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e40c2d-7455-46b7-97cf-1c2232f2c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:53.588144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e40c2d-7455-46b7-97cf-1c2232f2c932 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:53.588456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e40c2d-7455-46b7-97cf-1c2232f2c932 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:53.588739 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e40c2d-7455-46b7-97cf-1c2232f2c932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:53.693564 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e40c2d-7455-46b7-97cf-1c2232f2c932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:53.695135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e40c2d-7455-46b7-97cf-1c2232f2c932 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:53.720953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:53.729967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3328a-3136-44a0-a6ae-67264efd04ff None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:53.776527 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846b59-c35a-4d62-ad20-bd261f6dbfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:53.777764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846b59-c35a-4d62-ad20-bd261f6dbfac None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:53.778782 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846b59-c35a-4d62-ad20-bd261f6dbfac None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:53.779520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846b59-c35a-4d62-ad20-bd261f6dbfac None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:53.780415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21846b59-c35a-4d62-ad20-bd261f6dbfac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:53.781137 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:53.784251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21846b59-c35a-4d62-ad20-bd261f6dbfac None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:53.836558 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 362/703] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:53.838954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83474d7-d864-48cc-b2d7-936de22cf5bc None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:53.839510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83474d7-d864-48cc-b2d7-936de22cf5bc None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:53.840019 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83474d7-d864-48cc-b2d7-936de22cf5bc None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:53.843275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 363/704] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:53.844725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83474d7-d864-48cc-b2d7-936de22cf5bc None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:53.858366 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 342/705] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:36:53 2022] POST /identity/v3/users => generated 254 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:36:53.860007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef011-18be-449d-916a-085be3bcbef8 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:53.861184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef011-18be-449d-916a-085be3bcbef8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:53.861704 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef011-18be-449d-916a-085be3bcbef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:53.885350 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-9f7ef011-18be-449d-916a-085be3bcbef8 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:53.888384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9f7ef011-18be-449d-916a-085be3bcbef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:54.003696 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83474d7-d864-48cc-b2d7-936de22cf5bc None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:54.042304 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 343/706] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:54.052167 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67eb42-78bf-4838-9d9f-6318a89fde5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:54.053448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67eb42-78bf-4838-9d9f-6318a89fde5b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:54.053955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67eb42-78bf-4838-9d9f-6318a89fde5b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:54.054455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67eb42-78bf-4838-9d9f-6318a89fde5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:54.067980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67eb42-78bf-4838-9d9f-6318a89fde5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:54.069943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67eb42-78bf-4838-9d9f-6318a89fde5b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:54.074090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ef011-18be-449d-916a-085be3bcbef8 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-bd67eb42-78bf-4838-9d9f-6318a89fde5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:54.101968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:54.102947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:54.103901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:54.103901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:54.103901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:54.103901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:54.104593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 364/707] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:54.114127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67eb42-78bf-4838-9d9f-6318a89fde5b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:54.147023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:54.201553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:54.252968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ef011-18be-449d-916a-085be3bcbef8 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:54.300065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67eb42-78bf-4838-9d9f-6318a89fde5b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:54.302426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fc9a9-96f3-406a-9024-850d1b7d13ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:54.304197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fc9a9-96f3-406a-9024-850d1b7d13ee None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:54.304336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fc9a9-96f3-406a-9024-850d1b7d13ee None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:54.304808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fc9a9-96f3-406a-9024-850d1b7d13ee None admin] PATH_INFO: `/v3/services/network` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:54.306142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fc9a9-96f3-406a-9024-850d1b7d13ee None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:54.308991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fc9a9-96f3-406a-9024-850d1b7d13ee None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-7e3fc9a9-96f3-406a-9024-850d1b7d13ee None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:54.337711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:54.338978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 17:36:54.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:54.342835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 344/708] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:54 2022] GET /identity/v3/services/network => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:54.350883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fc9a9-96f3-406a-9024-850d1b7d13ee None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:54.352156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80f3af-e359-4a7f-97f4-689be58ac0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:54.352892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80f3af-e359-4a7f-97f4-689be58ac0db None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:54.353175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80f3af-e359-4a7f-97f4-689be58ac0db None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:54.353450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80f3af-e359-4a7f-97f4-689be58ac0db None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:54.354199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80f3af-e359-4a7f-97f4-689be58ac0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:54.354505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80f3af-e359-4a7f-97f4-689be58ac0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:54.359417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80f3af-e359-4a7f-97f4-689be58ac0db None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:54.374827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 365/709] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:54.383227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80f3af-e359-4a7f-97f4-689be58ac0db None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:54.573725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:54.581116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fc9a9-96f3-406a-9024-850d1b7d13ee None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:54.653685 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:54.666073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec828e3-f736-47f3-a0af-541c88b46fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:54.667803 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec828e3-f736-47f3-a0af-541c88b46fa2 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:54.669780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec828e3-f736-47f3-a0af-541c88b46fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:54.670824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec828e3-f736-47f3-a0af-541c88b46fa2 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:54.672399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec828e3-f736-47f3-a0af-541c88b46fa2 None admin] RBAC: Adding query filter params (name=network) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:54.673200 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec828e3-f736-47f3-a0af-541c88b46fa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:54.675103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80f3af-e359-4a7f-97f4-689be58ac0db None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:54.676239 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec828e3-f736-47f3-a0af-541c88b46fa2 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:54.689856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 345/710] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:36:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:54.704346 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec828e3-f736-47f3-a0af-541c88b46fa2 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:54.802557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cd237-9f0e-46f7-ab2e-768eee57541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:54.803543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cd237-9f0e-46f7-ab2e-768eee57541a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:54.803893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cd237-9f0e-46f7-ab2e-768eee57541a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:54.804262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cd237-9f0e-46f7-ab2e-768eee57541a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:54.829729 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30cd237-9f0e-46f7-ab2e-768eee57541a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:54.832797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30cd237-9f0e-46f7-ab2e-768eee57541a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-a30cd237-9f0e-46f7-ab2e-768eee57541a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:36:54.869661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:54.871345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:54.873129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:36:54.873129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:36:54.873129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:36:54.873129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:36:54.873129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:36:54.873129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:36:54.873129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:36:54.873129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:54.877620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 366/711] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 495 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:54.885756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cd237-9f0e-46f7-ab2e-768eee57541a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:54.987683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec828e3-f736-47f3-a0af-541c88b46fa2 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:55.059562 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c4fcb-4a3c-4519-838a-e9b9cc3ec2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:55.061603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c4fcb-4a3c-4519-838a-e9b9cc3ec2e1 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:55.063476 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c4fcb-4a3c-4519-838a-e9b9cc3ec2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:55.064464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c4fcb-4a3c-4519-838a-e9b9cc3ec2e1 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:55.066351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c4fcb-4a3c-4519-838a-e9b9cc3ec2e1 None admin] RBAC: Adding query filter params (type=network) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:55.071970 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c4fcb-4a3c-4519-838a-e9b9cc3ec2e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:55.075321 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c4fcb-4a3c-4519-838a-e9b9cc3ec2e1 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:55.096548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 346/712] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:36:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:55.213717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cd237-9f0e-46f7-ab2e-768eee57541a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:55.297202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:55.313866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455f42b-218a-4b5a-8b4c-432e448c8f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:55.315510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f42b-218a-4b5a-8b4c-432e448c8f59 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:55.316246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f42b-218a-4b5a-8b4c-432e448c8f59 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:55.317218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f42b-218a-4b5a-8b4c-432e448c8f59 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:55.319124 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455f42b-218a-4b5a-8b4c-432e448c8f59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:55.320035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455f42b-218a-4b5a-8b4c-432e448c8f59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:55.323313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455f42b-218a-4b5a-8b4c-432e448c8f59 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:55.356441 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 367/713] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:55.365660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c4fcb-4a3c-4519-838a-e9b9cc3ec2e1 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:55.471455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155628cf-023f-4694-9389-6a01a6abb0b5 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:55.472811 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155628cf-023f-4694-9389-6a01a6abb0b5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:55.474385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155628cf-023f-4694-9389-6a01a6abb0b5 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:55.480514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 368/714] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:55 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:55.486744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adfdbb-7b94-4812-8053-e4ad2ca6bead None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:55.487134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adfdbb-7b94-4812-8053-e4ad2ca6bead None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:55.487320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adfdbb-7b94-4812-8053-e4ad2ca6bead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:55.495714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:55.509858 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-90adfdbb-7b94-4812-8053-e4ad2ca6bead None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:55.511112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-90adfdbb-7b94-4812-8053-e4ad2ca6bead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:55.595543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c4fcb-4a3c-4519-838a-e9b9cc3ec2e1 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:55.598371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 369/715] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:55.622083 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adfdbb-7b94-4812-8053-e4ad2ca6bead None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:55.678333 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc44429-4d10-4e64-ab90-d25c5b54d850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:55.683582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc44429-4d10-4e64-ab90-d25c5b54d850 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:55.685505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc44429-4d10-4e64-ab90-d25c5b54d850 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:55.687620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc44429-4d10-4e64-ab90-d25c5b54d850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:55.691592 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc44429-4d10-4e64-ab90-d25c5b54d850 None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=3b52e88df44d49b186d54a8d045595ed) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:55.694145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc44429-4d10-4e64-ab90-d25c5b54d850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:55.703760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc44429-4d10-4e64-ab90-d25c5b54d850 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:55.731435 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 347/716] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:36:55 2022] GET /identity/v3/role_assignments?user.id=3b52e88df44d49b186d54a8d045595ed&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 259 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:55.829467 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adfdbb-7b94-4812-8053-e4ad2ca6bead None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:55.877097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:55.897947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c138b12-8382-4e40-8f7b-502805f43cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:55.899911 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138b12-8382-4e40-8f7b-502805f43cbd None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:55.900777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138b12-8382-4e40-8f7b-502805f43cbd None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:55.901759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c138b12-8382-4e40-8f7b-502805f43cbd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:55.903348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c138b12-8382-4e40-8f7b-502805f43cbd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:55.906200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c138b12-8382-4e40-8f7b-502805f43cbd None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-6c138b12-8382-4e40-8f7b-502805f43cbd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:55.936953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:55.938799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 17:36:55.940446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:55.945939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 370/717] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Jul 20 17:36:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:55.954342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc44429-4d10-4e64-ab90-d25c5b54d850 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:56.179103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc44429-4d10-4e64-ab90-d25c5b54d850 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:56.209090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:56.228215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0581ee9-7548-418d-85ad-05ee8e971de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:56.228924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0581ee9-7548-418d-85ad-05ee8e971de6 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:56.229212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0581ee9-7548-418d-85ad-05ee8e971de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:56.229493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0581ee9-7548-418d-85ad-05ee8e971de6 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:56.230219 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0581ee9-7548-418d-85ad-05ee8e971de6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:56.230531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0581ee9-7548-418d-85ad-05ee8e971de6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:56.232503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0581ee9-7548-418d-85ad-05ee8e971de6 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:56.237763 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 348/718] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jul 20 17:36:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:56.246283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c138b12-8382-4e40-8f7b-502805f43cbd None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:56.470341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c138b12-8382-4e40-8f7b-502805f43cbd None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:56.531527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dd7df-6171-472a-b890-65894295321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:56.532209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dd7df-6171-472a-b890-65894295321d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:56.532502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dd7df-6171-472a-b890-65894295321d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:56.532785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dd7df-6171-472a-b890-65894295321d None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:56.533505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dd7df-6171-472a-b890-65894295321d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:56.533808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dd7df-6171-472a-b890-65894295321d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:56.535537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dd7df-6171-472a-b890-65894295321d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:56.546249 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 371/719] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jul 20 17:36:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:56.915134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413e192-c169-4c55-8588-7bd56c3a4b20 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:56.915689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413e192-c169-4c55-8588-7bd56c3a4b20 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:56.915689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413e192-c169-4c55-8588-7bd56c3a4b20 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:56.917380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 349/720] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:56.923952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19bd84-42d9-40f1-bc45-bc964373217e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:56.924458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19bd84-42d9-40f1-bc45-bc964373217e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:56.924611 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19bd84-42d9-40f1-bc45-bc964373217e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:57.062279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-0d19bd84-42d9-40f1-bc45-bc964373217e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:57.063542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0d19bd84-42d9-40f1-bc45-bc964373217e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:57.131641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:57.162855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 372/721] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:57.211508 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413e192-c169-4c55-8588-7bd56c3a4b20 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:57.226086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab93bf6-256e-4d7d-a630-19a2266bbee6 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:57.226386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab93bf6-256e-4d7d-a630-19a2266bbee6 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:57.227157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab93bf6-256e-4d7d-a630-19a2266bbee6 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:57.229324 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 373/722] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:57.236117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b11f9-30c6-4b76-9404-d34ed29dec46 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:57.236438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b11f9-30c6-4b76-9404-d34ed29dec46 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:57.236885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b11f9-30c6-4b76-9404-d34ed29dec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:57.269277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f63b11f9-30c6-4b76-9404-d34ed29dec46 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:57.270591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f63b11f9-30c6-4b76-9404-d34ed29dec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:57.371686 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 374/723] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 17:36:57.383913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413e192-c169-4c55-8588-7bd56c3a4b20 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:57.411440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b11f9-30c6-4b76-9404-d34ed29dec46 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:57.462492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97c08f-4e80-4faa-bc1d-3c529ac05d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:57.463500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97c08f-4e80-4faa-bc1d-3c529ac05d9d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:57.463796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97c08f-4e80-4faa-bc1d-3c529ac05d9d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:57.464077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97c08f-4e80-4faa-bc1d-3c529ac05d9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:57.490434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97c08f-4e80-4faa-bc1d-3c529ac05d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-2d97c08f-4e80-4faa-bc1d-3c529ac05d9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:57.498677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:57.499614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:57.500459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:57.500459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:57.500459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:57.500459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:57.500459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:57.500459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:57.500459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:57.500459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:57.500459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:57.500459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:57.500459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:36:57.500459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:57.514193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 350/724] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:36:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:57.515144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97c08f-4e80-4faa-bc1d-3c529ac05d9d None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:57.587901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:57.642905 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b11f9-30c6-4b76-9404-d34ed29dec46 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:57.668029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97c08f-4e80-4faa-bc1d-3c529ac05d9d None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:57.672588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:57.717972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddd180-f265-4014-b7a4-b4dd8ac98109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:57.718579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddd180-f265-4014-b7a4-b4dd8ac98109 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:57.718873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddd180-f265-4014-b7a4-b4dd8ac98109 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:57.719156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddd180-f265-4014-b7a4-b4dd8ac98109 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:57.719930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddd180-f265-4014-b7a4-b4dd8ac98109 None admin] RBAC: Adding query filter params (name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:57.720248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddd180-f265-4014-b7a4-b4dd8ac98109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:57.721700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddd180-f265-4014-b7a4-b4dd8ac98109 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:57.739920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9ed9a-2543-468f-97b8-44d2f1ab2718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:57.742213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9ed9a-2543-468f-97b8-44d2f1ab2718 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:57.744438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 351/725] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:36:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:57.745080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9ed9a-2543-468f-97b8-44d2f1ab2718 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:57.745621 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9ed9a-2543-468f-97b8-44d2f1ab2718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:57.750195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddd180-f265-4014-b7a4-b4dd8ac98109 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:57.770972 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9ed9a-2543-468f-97b8-44d2f1ab2718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-0aa9ed9a-2543-468f-97b8-44d2f1ab2718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:57.782440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:57.783436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:57.784266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:57.784266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:57.784266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:57.784266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:57.784266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:57.784266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:57.784266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:57.784266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:57.784266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:57.784266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:57.784266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:36:57.784266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:57.797123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 375/726] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:57.800107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9ed9a-2543-468f-97b8-44d2f1ab2718 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:57.946982 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9ed9a-2543-468f-97b8-44d2f1ab2718 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:57.997637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddd180-f265-4014-b7a4-b4dd8ac98109 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:58.009657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a692b6e-eb4e-47d1-b6af-a8fac58f0f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:58.011075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a692b6e-eb4e-47d1-b6af-a8fac58f0f04 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:58.011847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a692b6e-eb4e-47d1-b6af-a8fac58f0f04 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:58.013206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a692b6e-eb4e-47d1-b6af-a8fac58f0f04 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:58.014951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a692b6e-eb4e-47d1-b6af-a8fac58f0f04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:58.020194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a692b6e-eb4e-47d1-b6af-a8fac58f0f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:58.023492 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a692b6e-eb4e-47d1-b6af-a8fac58f0f04 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:58.031020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:58.047556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 376/727] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:58.053335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a692b6e-eb4e-47d1-b6af-a8fac58f0f04 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:58.085968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e8b75-a6e4-49f0-9f34-05a21e6fffac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:58.087145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8b75-a6e4-49f0-9f34-05a21e6fffac None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:58.087649 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8b75-a6e4-49f0-9f34-05a21e6fffac None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:58.088134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8b75-a6e4-49f0-9f34-05a21e6fffac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:58.117602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e8b75-a6e4-49f0-9f34-05a21e6fffac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:58.119091 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e8b75-a6e4-49f0-9f34-05a21e6fffac None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:58.129816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-0f3e8b75-a6e4-49f0-9f34-05a21e6fffac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:58.149901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:58.152090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:58.154547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:58.154547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:58.154547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:58.154547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:58.154547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 352/728] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:36:58.158772 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e8b75-a6e4-49f0-9f34-05a21e6fffac None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:58.243654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a692b6e-eb4e-47d1-b6af-a8fac58f0f04 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:58.320931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a7773-323e-4e54-a4d1-4f78fd653c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:58.321750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a7773-323e-4e54-a4d1-4f78fd653c70 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:58.322089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a7773-323e-4e54-a4d1-4f78fd653c70 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:58.322346 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a7773-323e-4e54-a4d1-4f78fd653c70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:58.344069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a7773-323e-4e54-a4d1-4f78fd653c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:58.345594 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a7773-323e-4e54-a4d1-4f78fd653c70 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-cd9a7773-323e-4e54-a4d1-4f78fd653c70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:36:58.374646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:58.375669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:58.376641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:36:58.376641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:36:58.376641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:36:58.376641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:58.379803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 377/729] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:58.387904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a7773-323e-4e54-a4d1-4f78fd653c70 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:58.397758 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e8b75-a6e4-49f0-9f34-05a21e6fffac None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:58.453422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe12bfd-06bd-403b-b6ed-b656b30ed8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:58.454795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe12bfd-06bd-403b-b6ed-b656b30ed8c6 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:58.455751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe12bfd-06bd-403b-b6ed-b656b30ed8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:58.456500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe12bfd-06bd-403b-b6ed-b656b30ed8c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:58.457766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe12bfd-06bd-403b-b6ed-b656b30ed8c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:58.458724 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe12bfd-06bd-403b-b6ed-b656b30ed8c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:58.460951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe12bfd-06bd-403b-b6ed-b656b30ed8c6 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:58.477088 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 353/730] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:58.479125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4201d8-3c62-45df-a613-3b739a5b74b1 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:58.479633 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4201d8-3c62-45df-a613-3b739a5b74b1 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:58.480189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4201d8-3c62-45df-a613-3b739a5b74b1 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:58.482596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 354/731] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:58.483808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4201d8-3c62-45df-a613-3b739a5b74b1 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:58.494313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:58.518530 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:58.519735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a7773-323e-4e54-a4d1-4f78fd653c70 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:58.564357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da07d4-1776-4e63-9bff-4d3820df8ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:58.565503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da07d4-1776-4e63-9bff-4d3820df8ae0 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:58.565999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da07d4-1776-4e63-9bff-4d3820df8ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:58.566531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da07d4-1776-4e63-9bff-4d3820df8ae0 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:58.567504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da07d4-1776-4e63-9bff-4d3820df8ae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:58.568027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da07d4-1776-4e63-9bff-4d3820df8ae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:58.569940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da07d4-1776-4e63-9bff-4d3820df8ae0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:58.586530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 378/732] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:58.588289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076859d-f41b-48fa-b7fc-c82e6a4f063b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:58.588863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076859d-f41b-48fa-b7fc-c82e6a4f063b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:58.589423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076859d-f41b-48fa-b7fc-c82e6a4f063b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:58.613640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b076859d-f41b-48fa-b7fc-c82e6a4f063b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:58.615763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b076859d-f41b-48fa-b7fc-c82e6a4f063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:58.641521 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4201d8-3c62-45df-a613-3b739a5b74b1 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:58.689573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff337a1-d35e-41b0-b383-d5a817707f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:58.690408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff337a1-d35e-41b0-b383-d5a817707f99 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:58.691205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff337a1-d35e-41b0-b383-d5a817707f99 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:58.691504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff337a1-d35e-41b0-b383-d5a817707f99 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:58.702171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff337a1-d35e-41b0-b383-d5a817707f99 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:58.704347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff337a1-d35e-41b0-b383-d5a817707f99 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:58.709136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 379/733] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:58.710375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076859d-f41b-48fa-b7fc-c82e6a4f063b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-9ff337a1-d35e-41b0-b383-d5a817707f99 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:58.737933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:58.738963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:58.739901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:58.739901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:58.739901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:58.739901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:58.739901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:58.739901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:58.739901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:58.739901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:58.739901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 17:36:58.739901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:58.742864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 355/734] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 20 17:36:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:58.744042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff337a1-d35e-41b0-b383-d5a817707f99 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:58.823200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:58.855206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076859d-f41b-48fa-b7fc-c82e6a4f063b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:58.884529 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:58.900788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ea8a1-40ee-4c83-bbb4-99adc7bbab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:58.901653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ea8a1-40ee-4c83-bbb4-99adc7bbab1c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:58.901950 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ea8a1-40ee-4c83-bbb4-99adc7bbab1c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:58.902215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ea8a1-40ee-4c83-bbb4-99adc7bbab1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:58.910190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff337a1-d35e-41b0-b383-d5a817707f99 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:58.911867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ea8a1-40ee-4c83-bbb4-99adc7bbab1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:58.913766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ea8a1-40ee-4c83-bbb4-99adc7bbab1c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-a81ea8a1-40ee-4c83-bbb4-99adc7bbab1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:36:58.929365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:58.930931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:58.932205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:58.932205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:58.932205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:36:58.932205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:36:58.932205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:36:58.932205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:36:58.932205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:36:58.932205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:36:58.932205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 17:36:58.932205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:36:58.932205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 380/735] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:36:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:58.932205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ea8a1-40ee-4c83-bbb4-99adc7bbab1c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:58.955319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9f5bd-37ca-42ab-a4b5-2c26401e90a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:58.955997 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9f5bd-37ca-42ab-a4b5-2c26401e90a5 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:58.956279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9f5bd-37ca-42ab-a4b5-2c26401e90a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:58.956591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9f5bd-37ca-42ab-a4b5-2c26401e90a5 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:58.957334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9f5bd-37ca-42ab-a4b5-2c26401e90a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:58.958762 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9f5bd-37ca-42ab-a4b5-2c26401e90a5 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:59.060764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 356/736] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:36:58 2022] POST /identity/v3/services => generated 240 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:36:59.063351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc2ee1-0df9-4618-9a6b-15c183bba875 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:59.063804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc2ee1-0df9-4618-9a6b-15c183bba875 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:59.064247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc2ee1-0df9-4618-9a6b-15c183bba875 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:59.067799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ea8a1-40ee-4c83-bbb4-99adc7bbab1c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:59.073001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 357/737] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:59.074483 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc2ee1-0df9-4618-9a6b-15c183bba875 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:59.118006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:59.133533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1ad60-7fef-4640-b7ae-528d50ed08d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:59.134720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1ad60-7fef-4640-b7ae-528d50ed08d6 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:59.138897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1ad60-7fef-4640-b7ae-528d50ed08d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:59.138897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1ad60-7fef-4640-b7ae-528d50ed08d6 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:59.138897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1ad60-7fef-4640-b7ae-528d50ed08d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:59.138897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1ad60-7fef-4640-b7ae-528d50ed08d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:59.139739 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1ad60-7fef-4640-b7ae-528d50ed08d6 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:59.167442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 381/738] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jul 20 17:36:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:59.169632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f938-246f-4d93-a515-248b3e0e6b3d None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:59.170224 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f938-246f-4d93-a515-248b3e0e6b3d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:59.170705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f938-246f-4d93-a515-248b3e0e6b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:59.190211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e220f938-246f-4d93-a515-248b3e0e6b3d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:36:59.192063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e220f938-246f-4d93-a515-248b3e0e6b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:36:59.292614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc2ee1-0df9-4618-9a6b-15c183bba875 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:59.320014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 382/739] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:36:59 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:36:59.321850 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f938-246f-4d93-a515-248b3e0e6b3d None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:59.355412 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0656cd3-3003-4f5a-986f-c65ad8ffbf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:59.356593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0656cd3-3003-4f5a-986f-c65ad8ffbf27 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:59.357058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0656cd3-3003-4f5a-986f-c65ad8ffbf27 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:59.357587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0656cd3-3003-4f5a-986f-c65ad8ffbf27 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:59.359167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0656cd3-3003-4f5a-986f-c65ad8ffbf27 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:36:59.359719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0656cd3-3003-4f5a-986f-c65ad8ffbf27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:59.363334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0656cd3-3003-4f5a-986f-c65ad8ffbf27 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:59.386206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:59.405874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 358/740] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jul 20 17:36:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:36:59.408392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0656cd3-3003-4f5a-986f-c65ad8ffbf27 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:59.560036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f938-246f-4d93-a515-248b3e0e6b3d None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:59.597830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:59.632009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4425c-009b-434e-a76e-96b7d552b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:59.633124 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4425c-009b-434e-a76e-96b7d552b45b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:59.633613 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4425c-009b-434e-a76e-96b7d552b45b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:59.634101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4425c-009b-434e-a76e-96b7d552b45b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:59.637862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0656cd3-3003-4f5a-986f-c65ad8ffbf27 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:59.704719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52929690-6ebc-4683-8375-4ac86d7c2298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:59.707023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52929690-6ebc-4683-8375-4ac86d7c2298 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:59.707505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52929690-6ebc-4683-8375-4ac86d7c2298 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:59.707960 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52929690-6ebc-4683-8375-4ac86d7c2298 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:59.727357 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52929690-6ebc-4683-8375-4ac86d7c2298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-52929690-6ebc-4683-8375-4ac86d7c2298 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:36:59.743249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:36:59.744238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:36:59.745431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:36:59.745431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:36:59.745431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:36:59.745431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:36:59.745431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:36:59.745431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:36:59.745431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:36:59.745431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:36:59.745431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:36:59.745431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:36:59.745431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:36:59.745431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:36:59.746357 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 359/741] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:36:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:36:59.748128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52929690-6ebc-4683-8375-4ac86d7c2298 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:59.752973 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4425c-009b-434e-a76e-96b7d552b45b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:36:59.754647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4425c-009b-434e-a76e-96b7d552b45b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:36:59.842732 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:59.925453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 383/742] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:59 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:36:59.926061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52929690-6ebc-4683-8375-4ac86d7c2298 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:36:59.928437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5253b7-9c7c-4904-a544-23f9bebbc225 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:59.929231 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5253b7-9c7c-4904-a544-23f9bebbc225 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:59.929897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5253b7-9c7c-4904-a544-23f9bebbc225 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:36:59.933034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 384/743] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:36:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:36:59.934816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5253b7-9c7c-4904-a544-23f9bebbc225 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:36:59.971722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:36:59.979418 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168255ce-e841-4111-8f7a-b7a3c8ca5596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:36:59.983894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168255ce-e841-4111-8f7a-b7a3c8ca5596 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:36:59.983894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168255ce-e841-4111-8f7a-b7a3c8ca5596 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:36:59.983894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168255ce-e841-4111-8f7a-b7a3c8ca5596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:00.091100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168255ce-e841-4111-8f7a-b7a3c8ca5596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:00.093284 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168255ce-e841-4111-8f7a-b7a3c8ca5596 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:00.123063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5253b7-9c7c-4904-a544-23f9bebbc225 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:00.167700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:00.188287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26769ed-e0b6-43f0-a1c4-0decb0da82f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:00.189372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26769ed-e0b6-43f0-a1c4-0decb0da82f7 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:00.189871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26769ed-e0b6-43f0-a1c4-0decb0da82f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:00.190258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26769ed-e0b6-43f0-a1c4-0decb0da82f7 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:00.191303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26769ed-e0b6-43f0-a1c4-0decb0da82f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:00.191822 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26769ed-e0b6-43f0-a1c4-0decb0da82f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:00.194487 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26769ed-e0b6-43f0-a1c4-0decb0da82f7 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:00.210643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 385/744] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:00.213453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26769ed-e0b6-43f0-a1c4-0decb0da82f7 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:00.237323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 360/745] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:36:59 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 17:37:00.239802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55c646-2d1f-4f0c-b196-d9e9e2f342c1 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:00.240304 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55c646-2d1f-4f0c-b196-d9e9e2f342c1 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:00.240798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55c646-2d1f-4f0c-b196-d9e9e2f342c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:00.267838 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-8d55c646-2d1f-4f0c-b196-d9e9e2f342c1 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:00.269885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8d55c646-2d1f-4f0c-b196-d9e9e2f342c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:00.335710 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:00.372633 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 361/746] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:00 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 17:37:00.372889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26769ed-e0b6-43f0-a1c4-0decb0da82f7 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:00.382373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55c646-2d1f-4f0c-b196-d9e9e2f342c1 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:00.443583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e053f4c-a6c5-4ae3-a6ac-d78e1dd161f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:00.445095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e053f4c-a6c5-4ae3-a6ac-d78e1dd161f6 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:00.445676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e053f4c-a6c5-4ae3-a6ac-d78e1dd161f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:00.446285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e053f4c-a6c5-4ae3-a6ac-d78e1dd161f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:00.467648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e053f4c-a6c5-4ae3-a6ac-d78e1dd161f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:00.470719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e053f4c-a6c5-4ae3-a6ac-d78e1dd161f6 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-7e053f4c-a6c5-4ae3-a6ac-d78e1dd161f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:00.494330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:00.496376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:00.498587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:00.498587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:00.498587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:00.498587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:00.498587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 386/747] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:00.499384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e053f4c-a6c5-4ae3-a6ac-d78e1dd161f6 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:00.534542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:00.549383 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55c646-2d1f-4f0c-b196-d9e9e2f342c1 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:00.612087 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b608e1-db38-456a-9b7f-2210744f0b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:00.613676 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b608e1-db38-456a-9b7f-2210744f0b82 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:00.614311 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b608e1-db38-456a-9b7f-2210744f0b82 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:00.614766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b608e1-db38-456a-9b7f-2210744f0b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:00.636318 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b608e1-db38-456a-9b7f-2210744f0b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:00.639968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b608e1-db38-456a-9b7f-2210744f0b82 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:00.657666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e053f4c-a6c5-4ae3-a6ac-d78e1dd161f6 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-51b608e1-db38-456a-9b7f-2210744f0b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:00.685163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:00.686909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:00.688701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:00.688701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:00.688701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:00.688701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:00.688701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 362/748] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:00.690585 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b608e1-db38-456a-9b7f-2210744f0b82 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:00.702784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:00.711701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ec6c3-1112-48ad-94cb-c981ff51071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:00.713052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ec6c3-1112-48ad-94cb-c981ff51071b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:00.713549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ec6c3-1112-48ad-94cb-c981ff51071b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:00.717814 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ec6c3-1112-48ad-94cb-c981ff51071b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:00.734153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ec6c3-1112-48ad-94cb-c981ff51071b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:00.737050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ec6c3-1112-48ad-94cb-c981ff51071b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-5e0ec6c3-1112-48ad-94cb-c981ff51071b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:00.761929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:00.763442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:00.764598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:00.764598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:00.764598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:00.764598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:00.764598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 387/749] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:00.764896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ec6c3-1112-48ad-94cb-c981ff51071b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:00.836594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b608e1-db38-456a-9b7f-2210744f0b82 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:00.879256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d353e-0380-4555-a515-df1b8ffd81b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:00.879925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d353e-0380-4555-a515-df1b8ffd81b0 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:00.880321 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d353e-0380-4555-a515-df1b8ffd81b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:00.880619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d353e-0380-4555-a515-df1b8ffd81b0 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:00.881352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d353e-0380-4555-a515-df1b8ffd81b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:00.882719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d353e-0380-4555-a515-df1b8ffd81b0 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:00.892905 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ec6c3-1112-48ad-94cb-c981ff51071b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:00.941284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9c99b-7757-4915-99c4-dd95e8e21099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:00.942440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9c99b-7757-4915-99c4-dd95e8e21099 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:00.942918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9c99b-7757-4915-99c4-dd95e8e21099 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:00.943398 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9c99b-7757-4915-99c4-dd95e8e21099 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:00.944810 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9c99b-7757-4915-99c4-dd95e8e21099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:00.945351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9c99b-7757-4915-99c4-dd95e8e21099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:00.947851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9c99b-7757-4915-99c4-dd95e8e21099 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:00.963399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:00.975377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 363/750] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:37:00 2022] POST /identity/v3/services => generated 251 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:37:00.975377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d353e-0380-4555-a515-df1b8ffd81b0 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:00.975820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 388/751] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:00.975820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9c99b-7757-4915-99c4-dd95e8e21099 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:01.054021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:01.165363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9c99b-7757-4915-99c4-dd95e8e21099 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:01.195296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d353e-0380-4555-a515-df1b8ffd81b0 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:01.236206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e9638-a18a-4913-a06e-5353bf05f9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:01.237214 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e9638-a18a-4913-a06e-5353bf05f9db None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:01.237690 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e9638-a18a-4913-a06e-5353bf05f9db None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:01.238159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e9638-a18a-4913-a06e-5353bf05f9db None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:01.240443 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e9638-a18a-4913-a06e-5353bf05f9db None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:01.240443 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e9638-a18a-4913-a06e-5353bf05f9db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:01.242241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e9638-a18a-4913-a06e-5353bf05f9db None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:01.266062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 389/752] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:01.271757 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e9638-a18a-4913-a06e-5353bf05f9db None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:01.272727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974eecd-da78-4682-865a-ce5d2978a0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:01.273790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974eecd-da78-4682-865a-ce5d2978a0eb None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:01.274266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974eecd-da78-4682-865a-ce5d2978a0eb None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:01.274647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974eecd-da78-4682-865a-ce5d2978a0eb None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:01.275707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974eecd-da78-4682-865a-ce5d2978a0eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:01.276163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974eecd-da78-4682-865a-ce5d2978a0eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:01.278875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974eecd-da78-4682-865a-ce5d2978a0eb None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:01.305421 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 364/753] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:01.305421 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974eecd-da78-4682-865a-ce5d2978a0eb None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:01.383168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:01.443608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974eecd-da78-4682-865a-ce5d2978a0eb None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:01.462999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e9638-a18a-4913-a06e-5353bf05f9db None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:01.468322 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:01.485143 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaac5d5-745e-46e5-b184-4a8e60397258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:01.488973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaac5d5-745e-46e5-b184-4a8e60397258 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:01.488973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaac5d5-745e-46e5-b184-4a8e60397258 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:01.488973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaac5d5-745e-46e5-b184-4a8e60397258 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:01.496008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaac5d5-745e-46e5-b184-4a8e60397258 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:01.498786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaac5d5-745e-46e5-b184-4a8e60397258 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-fbaac5d5-745e-46e5-b184-4a8e60397258 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:01.515205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:01.516287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:01.517317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:01.517317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:01.517317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:01.517317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:01.517317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:01.517317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:01.517317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:01.517317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:01.519416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 365/754] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:01.520460 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaac5d5-745e-46e5-b184-4a8e60397258 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:01.530476 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29a0eb-128a-46d1-add3-5016bf950db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:01.532279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29a0eb-128a-46d1-add3-5016bf950db5 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:01.532535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29a0eb-128a-46d1-add3-5016bf950db5 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:01.532962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29a0eb-128a-46d1-add3-5016bf950db5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:01.547029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29a0eb-128a-46d1-add3-5016bf950db5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:01.549948 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29a0eb-128a-46d1-add3-5016bf950db5 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-0c29a0eb-128a-46d1-add3-5016bf950db5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:01.581174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:01.582145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:01.583057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:01.583057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:01.583057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:01.583057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:01.583057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:01.583057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:01.583057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:01.583057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:01.584052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 390/755] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:01.585282 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29a0eb-128a-46d1-add3-5016bf950db5 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:01.643697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaac5d5-745e-46e5-b184-4a8e60397258 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:01.664465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:01.685800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b620a-c0b7-4f19-8b96-702d585b9e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:01.686537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b620a-c0b7-4f19-8b96-702d585b9e11 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:01.686980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b620a-c0b7-4f19-8b96-702d585b9e11 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:01.687389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b620a-c0b7-4f19-8b96-702d585b9e11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:01.696060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b620a-c0b7-4f19-8b96-702d585b9e11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:01.698132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b620a-c0b7-4f19-8b96-702d585b9e11 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-6a0b620a-c0b7-4f19-8b96-702d585b9e11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:01.718266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:01.719294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:01.721401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:01.721401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:01.721401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:01.721401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:01.721401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:01.721401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:01.721401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:01.721401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:01.721401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:37:01.721401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:01.721401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 366/756] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 20 17:37:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:01.721401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b620a-c0b7-4f19-8b96-702d585b9e11 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:01.771209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29a0eb-128a-46d1-add3-5016bf950db5 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:01.824107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafbc48-d3e4-4979-a72f-cd92ac8bcde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:01.825858 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafbc48-d3e4-4979-a72f-cd92ac8bcde4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:01.826359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafbc48-d3e4-4979-a72f-cd92ac8bcde4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:01.826676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafbc48-d3e4-4979-a72f-cd92ac8bcde4 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:01.827883 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafbc48-d3e4-4979-a72f-cd92ac8bcde4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:01.828443 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafbc48-d3e4-4979-a72f-cd92ac8bcde4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:01.831227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafbc48-d3e4-4979-a72f-cd92ac8bcde4 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:01.858540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 391/757] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:01.858540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba43b00-53d0-45f7-968e-52ec54c01158 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:01.858540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba43b00-53d0-45f7-968e-52ec54c01158 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:01.858540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba43b00-53d0-45f7-968e-52ec54c01158 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:01.858540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 392/758] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:01.859099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba43b00-53d0-45f7-968e-52ec54c01158 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:01.876821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b620a-c0b7-4f19-8b96-702d585b9e11 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:01.896573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:01.934685 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266059f2-d411-4962-b615-9f4a554ea62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:01.935856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266059f2-d411-4962-b615-9f4a554ea62e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:01.936336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266059f2-d411-4962-b615-9f4a554ea62e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:01.936873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266059f2-d411-4962-b615-9f4a554ea62e None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:01.938375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266059f2-d411-4962-b615-9f4a554ea62e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:01.938940 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266059f2-d411-4962-b615-9f4a554ea62e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:01.941526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266059f2-d411-4962-b615-9f4a554ea62e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:01.960365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 367/759] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:01.961713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266059f2-d411-4962-b615-9f4a554ea62e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:02.002327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:02.020610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba43b00-53d0-45f7-968e-52ec54c01158 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:02.076468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ed60f-61a8-4911-9ca7-44bd0aa2978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:02.077096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ed60f-61a8-4911-9ca7-44bd0aa2978a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:02.077393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ed60f-61a8-4911-9ca7-44bd0aa2978a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:02.077645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ed60f-61a8-4911-9ca7-44bd0aa2978a None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:02.078495 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ed60f-61a8-4911-9ca7-44bd0aa2978a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:02.078876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ed60f-61a8-4911-9ca7-44bd0aa2978a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:02.080307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ed60f-61a8-4911-9ca7-44bd0aa2978a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:02.092450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266059f2-d411-4962-b615-9f4a554ea62e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:02.100322 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 393/760] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 20 17:37:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:02.101584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7fbad-6437-4143-a225-88acfbfbc68a None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:02.101891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7fbad-6437-4143-a225-88acfbfbc68a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:02.102137 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7fbad-6437-4143-a225-88acfbfbc68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:02.124123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-29e7fbad-6437-4143-a225-88acfbfbc68a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:02.125371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-29e7fbad-6437-4143-a225-88acfbfbc68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:02.143070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2c691-fe42-47f4-a0ef-5e08e79aeafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:02.144027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2c691-fe42-47f4-a0ef-5e08e79aeafc None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:02.144537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2c691-fe42-47f4-a0ef-5e08e79aeafc None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:02.144897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2c691-fe42-47f4-a0ef-5e08e79aeafc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:02.146163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2c691-fe42-47f4-a0ef-5e08e79aeafc None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=9566befd16fc4b0c84d2bed34c4a5d28) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:02.146619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2c691-fe42-47f4-a0ef-5e08e79aeafc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:02.148517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2c691-fe42-47f4-a0ef-5e08e79aeafc None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:02.155968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 368/761] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:37:01 2022] GET /identity/v3/role_assignments?user.id=9566befd16fc4b0c84d2bed34c4a5d28&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:02.157408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2c691-fe42-47f4-a0ef-5e08e79aeafc None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:02.256980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 394/762] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:02.259713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7fbad-6437-4143-a225-88acfbfbc68a None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:02.323235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:02.360326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:02.366085 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2c691-fe42-47f4-a0ef-5e08e79aeafc None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:02.443565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3678028-bb11-41a2-949f-1800efecf19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:02.444978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678028-bb11-41a2-949f-1800efecf19a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:02.445229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678028-bb11-41a2-949f-1800efecf19a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:02.445685 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678028-bb11-41a2-949f-1800efecf19a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:02.447222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3678028-bb11-41a2-949f-1800efecf19a None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=f518137b54ee4e668f41c0f660a54d90) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:02.447748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3678028-bb11-41a2-949f-1800efecf19a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:02.451339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3678028-bb11-41a2-949f-1800efecf19a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:02.462177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 369/763] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:37:02 2022] GET /identity/v3/role_assignments?user.id=f518137b54ee4e668f41c0f660a54d90&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:02.463573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3678028-bb11-41a2-949f-1800efecf19a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:02.498352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7fbad-6437-4143-a225-88acfbfbc68a None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:02.564301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c0050-0618-4293-8251-78f72a3e75ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:02.565960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c0050-0618-4293-8251-78f72a3e75ed None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:02.566604 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c0050-0618-4293-8251-78f72a3e75ed None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:02.567206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c0050-0618-4293-8251-78f72a3e75ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:02.587798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c0050-0618-4293-8251-78f72a3e75ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:02.592350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c0050-0618-4293-8251-78f72a3e75ed None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-753c0050-0618-4293-8251-78f72a3e75ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:02.625311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:02.626978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:02.628754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:02.628754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:02.628754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:02.628754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:02.631877 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 395/764] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:02.641835 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c0050-0618-4293-8251-78f72a3e75ed None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:02.776202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3678028-bb11-41a2-949f-1800efecf19a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:02.824287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:02.836785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b245b62-568a-430c-8f2b-6e3f1397469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:02.842285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b245b62-568a-430c-8f2b-6e3f1397469d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:02.842285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b245b62-568a-430c-8f2b-6e3f1397469d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:02.842285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b245b62-568a-430c-8f2b-6e3f1397469d None admin] PATH_INFO: `/v3/services/network` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:02.842285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b245b62-568a-430c-8f2b-6e3f1397469d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:02.842285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b245b62-568a-430c-8f2b-6e3f1397469d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-5b245b62-568a-430c-8f2b-6e3f1397469d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:02.854587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:02.855826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:02.856788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 370/765] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:02 2022] GET /identity/v3/services/network => generated 88 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:02.867501 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b245b62-568a-430c-8f2b-6e3f1397469d None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:02.910734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c0050-0618-4293-8251-78f72a3e75ed None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:02.932882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:03.006943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b245b62-568a-430c-8f2b-6e3f1397469d None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:03.010834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe20f52-1d05-455d-ab4c-5f3096acbb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:03.011993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe20f52-1d05-455d-ab4c-5f3096acbb5e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:03.013354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe20f52-1d05-455d-ab4c-5f3096acbb5e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:03.013851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe20f52-1d05-455d-ab4c-5f3096acbb5e None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:03.015234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe20f52-1d05-455d-ab4c-5f3096acbb5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:03.015785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe20f52-1d05-455d-ab4c-5f3096acbb5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:03.018417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe20f52-1d05-455d-ab4c-5f3096acbb5e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:03.064585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 396/766] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:03.073074 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe20f52-1d05-455d-ab4c-5f3096acbb5e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:03.100002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf823a3b-bf25-4fee-9af1-34cbb0f6bd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:03.101171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823a3b-bf25-4fee-9af1-34cbb0f6bd2a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:03.101664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823a3b-bf25-4fee-9af1-34cbb0f6bd2a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:03.102231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823a3b-bf25-4fee-9af1-34cbb0f6bd2a None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:03.104397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf823a3b-bf25-4fee-9af1-34cbb0f6bd2a None admin] RBAC: Adding query filter params (name=network) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:03.105165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf823a3b-bf25-4fee-9af1-34cbb0f6bd2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:03.109708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf823a3b-bf25-4fee-9af1-34cbb0f6bd2a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:03.120235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 371/767] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:37:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:03.127521 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf823a3b-bf25-4fee-9af1-34cbb0f6bd2a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:03.390024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe20f52-1d05-455d-ab4c-5f3096acbb5e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:03.420439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:03.432301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0a112-01e1-4b22-a574-98c837b5f278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:03.433454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0a112-01e1-4b22-a574-98c837b5f278 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:03.433897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0a112-01e1-4b22-a574-98c837b5f278 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:03.434387 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0a112-01e1-4b22-a574-98c837b5f278 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:03.442437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0a112-01e1-4b22-a574-98c837b5f278 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:03.443901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0a112-01e1-4b22-a574-98c837b5f278 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:03.446096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-9cf0a112-01e1-4b22-a574-98c837b5f278 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:03.459595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:03.461747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:03.463456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:03.463456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:03.463456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:03.463456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:03.463456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:03.463456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:03.463456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:03.463456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:03.463456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 397/768] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:03.472459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0a112-01e1-4b22-a574-98c837b5f278 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:03.488850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf823a3b-bf25-4fee-9af1-34cbb0f6bd2a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:03.609446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2c73e-c759-4a78-b2e9-6b00bb8dd26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:03.613576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2c73e-c759-4a78-b2e9-6b00bb8dd26a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:03.615597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2c73e-c759-4a78-b2e9-6b00bb8dd26a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:03.616525 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2c73e-c759-4a78-b2e9-6b00bb8dd26a None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:03.618342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2c73e-c759-4a78-b2e9-6b00bb8dd26a None admin] RBAC: Adding query filter params (type=network) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:03.620538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2c73e-c759-4a78-b2e9-6b00bb8dd26a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:03.624885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2c73e-c759-4a78-b2e9-6b00bb8dd26a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:03.650376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 372/769] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:37:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:03.658779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2c73e-c759-4a78-b2e9-6b00bb8dd26a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:03.785730 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0a112-01e1-4b22-a574-98c837b5f278 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:03.874693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65412075-c275-49dd-9bd3-242cc3e22b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:03.876272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65412075-c275-49dd-9bd3-242cc3e22b91 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:03.877057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65412075-c275-49dd-9bd3-242cc3e22b91 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:03.877803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65412075-c275-49dd-9bd3-242cc3e22b91 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:03.880408 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65412075-c275-49dd-9bd3-242cc3e22b91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:03.881250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65412075-c275-49dd-9bd3-242cc3e22b91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:03.885022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65412075-c275-49dd-9bd3-242cc3e22b91 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:03.902543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2c73e-c759-4a78-b2e9-6b00bb8dd26a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:03.913877 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 398/770] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:03.916218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630507b1-1605-4d8b-b3b4-cd71b0011427 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:03.916754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630507b1-1605-4d8b-b3b4-cd71b0011427 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:03.917262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630507b1-1605-4d8b-b3b4-cd71b0011427 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:03.927277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 399/771] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:03.928714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630507b1-1605-4d8b-b3b4-cd71b0011427 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:03.972448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f63541-db65-4e9c-af68-58d96d796c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:03.973635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f63541-db65-4e9c-af68-58d96d796c46 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:03.974144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f63541-db65-4e9c-af68-58d96d796c46 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:03.974504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f63541-db65-4e9c-af68-58d96d796c46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:03.976205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f63541-db65-4e9c-af68-58d96d796c46 None admin] RBAC: Adding query filter params (interface=public, service_id=9cab6d3fcfbf41fbbddc8dedb9cbd541, region_id=RegionOne) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:03.976835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f63541-db65-4e9c-af68-58d96d796c46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:03.979613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f63541-db65-4e9c-af68-58d96d796c46 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:03.995522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 373/772] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 20 17:37:03 2022] GET /identity/v3/endpoints?service_id=9cab6d3fcfbf41fbbddc8dedb9cbd541&interface=public®ion_id=RegionOne => generated 194 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:04.002025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532abec8-6993-4ba7-8b4b-e7bb4fd57b49 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:04.002518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532abec8-6993-4ba7-8b4b-e7bb4fd57b49 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:04.003019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532abec8-6993-4ba7-8b4b-e7bb4fd57b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:04.032054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:04.039880 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-532abec8-6993-4ba7-8b4b-e7bb4fd57b49 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:04.042272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-532abec8-6993-4ba7-8b4b-e7bb4fd57b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:04.069451 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:04.136887 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630507b1-1605-4d8b-b3b4-cd71b0011427 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:04.155501 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 374/773] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:04.157516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532abec8-6993-4ba7-8b4b-e7bb4fd57b49 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:04.235213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c130-d9fa-42a8-8b7d-b0e248ad036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:04.237076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c130-d9fa-42a8-8b7d-b0e248ad036d None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:04.237595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c130-d9fa-42a8-8b7d-b0e248ad036d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:04.238107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7c130-d9fa-42a8-8b7d-b0e248ad036d None admin] PATH_INFO: `/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/3b52e88df44d49b186d54a8d045595ed/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:04.242557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c130-d9fa-42a8-8b7d-b0e248ad036d None admin] RBAC: Authorizing `identity:create_grant(project_id=5f0f8db3986541468c474b78a9b3740a, user_id=3b52e88df44d49b186d54a8d045595ed, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:04.245134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7c130-d9fa-42a8-8b7d-b0e248ad036d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:04.329220 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 400/774] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:37:03 2022] PUT /identity/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/3b52e88df44d49b186d54a8d045595ed/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:37:04.330593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c130-d9fa-42a8-8b7d-b0e248ad036d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:04.337433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532abec8-6993-4ba7-8b4b-e7bb4fd57b49 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:04.426471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f048b-21cc-4679-9f9b-55151ef9851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:04.427118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f048b-21cc-4679-9f9b-55151ef9851e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:04.427406 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f048b-21cc-4679-9f9b-55151ef9851e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:04.427680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f048b-21cc-4679-9f9b-55151ef9851e None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:04.428430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f048b-21cc-4679-9f9b-55151ef9851e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:04.430294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f048b-21cc-4679-9f9b-55151ef9851e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:04.453639 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 375/775] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 20 17:37:04 2022] GET /identity/v3/services => generated 772 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:04.589444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7c130-d9fa-42a8-8b7d-b0e248ad036d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:04.595374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:04.667646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67fe97-6cec-429e-9327-a7022cadb77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:04.669771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67fe97-6cec-429e-9327-a7022cadb77b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:04.670290 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67fe97-6cec-429e-9327-a7022cadb77b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:04.670780 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67fe97-6cec-429e-9327-a7022cadb77b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:04.672084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67fe97-6cec-429e-9327-a7022cadb77b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:04.675964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67fe97-6cec-429e-9327-a7022cadb77b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-ed67fe97-6cec-429e-9327-a7022cadb77b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:04.690405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:04.692172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:04.693862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 401/776] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Jul 20 17:37:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:04.710170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f048b-21cc-4679-9f9b-55151ef9851e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:04.737411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:04.844519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f048b-21cc-4679-9f9b-55151ef9851e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:04.887873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26052ac3-a7e3-4e51-a5a4-85ebe8a4c577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:04.888705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26052ac3-a7e3-4e51-a5a4-85ebe8a4c577 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:04.888990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26052ac3-a7e3-4e51-a5a4-85ebe8a4c577 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:04.889265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26052ac3-a7e3-4e51-a5a4-85ebe8a4c577 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:04.889995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26052ac3-a7e3-4e51-a5a4-85ebe8a4c577 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:04.890297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26052ac3-a7e3-4e51-a5a4-85ebe8a4c577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:04.891758 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26052ac3-a7e3-4e51-a5a4-85ebe8a4c577 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:04.901670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 376/777] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jul 20 17:37:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:04.914249 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67fe97-6cec-429e-9327-a7022cadb77b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:05.034226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cfd65-0cdc-4f29-9d32-95bcfc351b50 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:05.034500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cfd65-0cdc-4f29-9d32-95bcfc351b50 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:05.034844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cfd65-0cdc-4f29-9d32-95bcfc351b50 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:05.036567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 377/778] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:05.046253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ddfc1-79f1-42e4-8492-b6980c78ea82 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:05.046583 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ddfc1-79f1-42e4-8492-b6980c78ea82 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:05.046797 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ddfc1-79f1-42e4-8492-b6980c78ea82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:05.085547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-294ddfc1-79f1-42e4-8492-b6980c78ea82 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:05.086514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-294ddfc1-79f1-42e4-8492-b6980c78ea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:05.099713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67fe97-6cec-429e-9327-a7022cadb77b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:05.164464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5dabf-51d5-4a69-ad12-3a9fc1e5cbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:05.171166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5dabf-51d5-4a69-ad12-3a9fc1e5cbe6 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:05.171754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5dabf-51d5-4a69-ad12-3a9fc1e5cbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:05.172269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5dabf-51d5-4a69-ad12-3a9fc1e5cbe6 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:05.173240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5dabf-51d5-4a69-ad12-3a9fc1e5cbe6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:05.173765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5dabf-51d5-4a69-ad12-3a9fc1e5cbe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:05.175361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5dabf-51d5-4a69-ad12-3a9fc1e5cbe6 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:05.185728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 402/779] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jul 20 17:37:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:05.193582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5dabf-51d5-4a69-ad12-3a9fc1e5cbe6 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:05.224339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 378/780] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:05.261399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:05.263923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ddfc1-79f1-42e4-8492-b6980c78ea82 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:05.276229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:05.393245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5dabf-51d5-4a69-ad12-3a9fc1e5cbe6 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:05.508094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ddfc1-79f1-42e4-8492-b6980c78ea82 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:05.509881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87058e07-6474-402b-ac2b-0cfa0bbc405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:05.511334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87058e07-6474-402b-ac2b-0cfa0bbc405c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:05.512131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87058e07-6474-402b-ac2b-0cfa0bbc405c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:05.514891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87058e07-6474-402b-ac2b-0cfa0bbc405c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:05.517048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87058e07-6474-402b-ac2b-0cfa0bbc405c None admin] RBAC: Adding query filter params (interface=public, service_id=11ae031832534e09b28750dc3bd9b767, region_id=RegionOne) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:05.519430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87058e07-6474-402b-ac2b-0cfa0bbc405c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:05.522176 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87058e07-6474-402b-ac2b-0cfa0bbc405c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:05.558172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 403/781] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 20 17:37:05 2022] GET /identity/v3/endpoints?service_id=11ae031832534e09b28750dc3bd9b767&interface=public®ion_id=RegionOne => generated 194 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:05.558878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301185f6-651a-484a-b360-3f5d1def8021 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:05.559766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301185f6-651a-484a-b360-3f5d1def8021 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:05.560051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301185f6-651a-484a-b360-3f5d1def8021 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:05.565551 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 404/782] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:37:05.566478 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301185f6-651a-484a-b360-3f5d1def8021 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:05.583015 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f54902-69ad-477f-b2c5-ce382af97b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:05.583836 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f54902-69ad-477f-b2c5-ce382af97b0f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:05.584127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f54902-69ad-477f-b2c5-ce382af97b0f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:05.584399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f54902-69ad-477f-b2c5-ce382af97b0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:05.596883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f54902-69ad-477f-b2c5-ce382af97b0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-45f54902-69ad-477f-b2c5-ce382af97b0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:05.604612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:05.606975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 379/783] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:05.608707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1799-cb69-4a84-8fbd-4d79451e1b40 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:05.610953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1799-cb69-4a84-8fbd-4d79451e1b40 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:05.610953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1799-cb69-4a84-8fbd-4d79451e1b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:05.628156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c59d1799-cb69-4a84-8fbd-4d79451e1b40 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:05.629575 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c59d1799-cb69-4a84-8fbd-4d79451e1b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:05.698433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:05.707378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:05.712653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301185f6-651a-484a-b360-3f5d1def8021 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:05.716973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 380/784] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:05.718162 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1799-cb69-4a84-8fbd-4d79451e1b40 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:05.776161 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d9778-a4b4-4d08-9f94-3a4fe19370ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:05.776627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d9778-a4b4-4d08-9f94-3a4fe19370ae None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:05.776911 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d9778-a4b4-4d08-9f94-3a4fe19370ae None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:05.777281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d9778-a4b4-4d08-9f94-3a4fe19370ae None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:05.778534 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d9778-a4b4-4d08-9f94-3a4fe19370ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:05.779937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d9778-a4b4-4d08-9f94-3a4fe19370ae None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:05.786440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 405/785] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 20 17:37:05 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:05.787326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d9778-a4b4-4d08-9f94-3a4fe19370ae None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:05.862141 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1799-cb69-4a84-8fbd-4d79451e1b40 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:05.899120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d9778-a4b4-4d08-9f94-3a4fe19370ae None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:05.905222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddf6c1-66e6-4b86-9845-1674f8a12a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:05.906332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddf6c1-66e6-4b86-9845-1674f8a12a3e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:05.906818 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddf6c1-66e6-4b86-9845-1674f8a12a3e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:05.907425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddf6c1-66e6-4b86-9845-1674f8a12a3e None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:05.908429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddf6c1-66e6-4b86-9845-1674f8a12a3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:05.908989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddf6c1-66e6-4b86-9845-1674f8a12a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:05.910953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddf6c1-66e6-4b86-9845-1674f8a12a3e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:05.921941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 381/786] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:05.928554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddf6c1-66e6-4b86-9845-1674f8a12a3e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:05.964337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31447b36-a458-4eb1-b57d-3bd379aa9028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:05.966217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31447b36-a458-4eb1-b57d-3bd379aa9028 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:05.966880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31447b36-a458-4eb1-b57d-3bd379aa9028 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:05.967371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31447b36-a458-4eb1-b57d-3bd379aa9028 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:05.990242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31447b36-a458-4eb1-b57d-3bd379aa9028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-31447b36-a458-4eb1-b57d-3bd379aa9028 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:05.998836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:06.000712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:06.002394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 406/787] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:37:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:06.016088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31447b36-a458-4eb1-b57d-3bd379aa9028 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:06.041874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:06.065917 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:06.101244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddf6c1-66e6-4b86-9845-1674f8a12a3e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:06.177581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2911f3-f736-48f7-9070-2dad32792991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:06.179352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2911f3-f736-48f7-9070-2dad32792991 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:06.181013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2911f3-f736-48f7-9070-2dad32792991 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:06.181819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2911f3-f736-48f7-9070-2dad32792991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:06.196117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31447b36-a458-4eb1-b57d-3bd379aa9028 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:06.211304 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2911f3-f736-48f7-9070-2dad32792991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:06.214479 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2911f3-f736-48f7-9070-2dad32792991 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-fa2911f3-f736-48f7-9070-2dad32792991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:06.256503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:06.258212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:06.259973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:06.259973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:06.259973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:06.259973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:06.259973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 382/788] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:06.268625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2911f3-f736-48f7-9070-2dad32792991 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:06.317766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160189c-7ccf-4d6b-9bac-bf5e10a47968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:06.318521 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160189c-7ccf-4d6b-9bac-bf5e10a47968 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:06.318809 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160189c-7ccf-4d6b-9bac-bf5e10a47968 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:06.319129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160189c-7ccf-4d6b-9bac-bf5e10a47968 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:06.319901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160189c-7ccf-4d6b-9bac-bf5e10a47968 None admin] RBAC: Adding query filter params (name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:06.320209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160189c-7ccf-4d6b-9bac-bf5e10a47968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:06.321626 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160189c-7ccf-4d6b-9bac-bf5e10a47968 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:06.339892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 407/789] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:37:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:06.351919 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160189c-7ccf-4d6b-9bac-bf5e10a47968 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:06.521924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:06.525189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2911f3-f736-48f7-9070-2dad32792991 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:06.560194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:06.567338 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160189c-7ccf-4d6b-9bac-bf5e10a47968 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:06.605442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0cc8f-f600-4b2a-9292-c59eba252b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:06.606778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0cc8f-f600-4b2a-9292-c59eba252b80 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:06.607215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0cc8f-f600-4b2a-9292-c59eba252b80 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:06.607510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0cc8f-f600-4b2a-9292-c59eba252b80 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:06.608447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0cc8f-f600-4b2a-9292-c59eba252b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:06.608785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0cc8f-f600-4b2a-9292-c59eba252b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:06.610196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0cc8f-f600-4b2a-9292-c59eba252b80 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:06.637019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 383/790] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:06.639089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dae44-63f0-4372-9a45-c77888e91a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:06.639910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dae44-63f0-4372-9a45-c77888e91a91 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:06.640193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dae44-63f0-4372-9a45-c77888e91a91 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:06.640470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dae44-63f0-4372-9a45-c77888e91a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:06.644243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0cc8f-f600-4b2a-9292-c59eba252b80 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:06.662665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0dae44-63f0-4372-9a45-c77888e91a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:06.664127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0dae44-63f0-4372-9a45-c77888e91a91 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-8a0dae44-63f0-4372-9a45-c77888e91a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:06.700576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:06.702939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:06.704668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:06.704668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:06.704668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:06.704668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:06.704668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 408/791] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:06.712510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dae44-63f0-4372-9a45-c77888e91a91 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:06.832649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dae44-63f0-4372-9a45-c77888e91a91 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:06.881827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f45874-8114-4ac1-869b-5f4e04e10ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:06.882321 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f45874-8114-4ac1-869b-5f4e04e10ebf None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:06.882598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f45874-8114-4ac1-869b-5f4e04e10ebf None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:06.886890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f45874-8114-4ac1-869b-5f4e04e10ebf None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:06.886890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f45874-8114-4ac1-869b-5f4e04e10ebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:06.886890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f45874-8114-4ac1-869b-5f4e04e10ebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:06.886890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f45874-8114-4ac1-869b-5f4e04e10ebf None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:06.888194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:06.907545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 409/792] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:06.911165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f45874-8114-4ac1-869b-5f4e04e10ebf None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:06.923218 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0cc8f-f600-4b2a-9292-c59eba252b80 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:07.026812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611d8c2-a6da-4dc6-8a63-e941e89966a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:07.027632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611d8c2-a6da-4dc6-8a63-e941e89966a0 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:07.027972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611d8c2-a6da-4dc6-8a63-e941e89966a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:07.028771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611d8c2-a6da-4dc6-8a63-e941e89966a0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:07.049379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611d8c2-a6da-4dc6-8a63-e941e89966a0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:07.050930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611d8c2-a6da-4dc6-8a63-e941e89966a0 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:07.058277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f45874-8114-4ac1-869b-5f4e04e10ebf None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-f611d8c2-a6da-4dc6-8a63-e941e89966a0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:07.081516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:07.083401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:07.085234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:07.085234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:07.085234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:07.085234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:07.085234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:07.085234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:07.085234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:07.085234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:07.085234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 17:37:07.085234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:07.088943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 384/793] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:37:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:07.101291 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611d8c2-a6da-4dc6-8a63-e941e89966a0 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:07.108521 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb3155-223a-4fe0-a3f4-48d3ac2f78ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:07.109354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb3155-223a-4fe0-a3f4-48d3ac2f78ea None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:07.109633 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb3155-223a-4fe0-a3f4-48d3ac2f78ea None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:07.109908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb3155-223a-4fe0-a3f4-48d3ac2f78ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:07.126053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb3155-223a-4fe0-a3f4-48d3ac2f78ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:07.127517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb3155-223a-4fe0-a3f4-48d3ac2f78ea None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-5beb3155-223a-4fe0-a3f4-48d3ac2f78ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:07.155369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:07.158861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:07.162737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:07.162737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:07.162737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:07.162737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:07.162737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:07.162737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:07.162737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:07.162737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:07.162737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 17:37:07.162737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:07.162737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 410/794] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 20 17:37:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:07.165503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb3155-223a-4fe0-a3f4-48d3ac2f78ea None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:07.192965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:07.293330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:07.327653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611d8c2-a6da-4dc6-8a63-e941e89966a0 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:07.373576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb3155-223a-4fe0-a3f4-48d3ac2f78ea None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:07.410597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d5638-f2a3-4188-84e3-ff54d452f7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:07.412634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d5638-f2a3-4188-84e3-ff54d452f7d5 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:07.413450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d5638-f2a3-4188-84e3-ff54d452f7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:07.414208 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d5638-f2a3-4188-84e3-ff54d452f7d5 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:07.414365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f85df-e4ed-4276-b558-ad03e4335b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:07.415001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f85df-e4ed-4276-b558-ad03e4335b26 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:07.415286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f85df-e4ed-4276-b558-ad03e4335b26 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:07.415562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f85df-e4ed-4276-b558-ad03e4335b26 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:07.416415 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f85df-e4ed-4276-b558-ad03e4335b26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:07.416750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f85df-e4ed-4276-b558-ad03e4335b26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:07.417902 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d5638-f2a3-4188-84e3-ff54d452f7d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:07.418456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f85df-e4ed-4276-b558-ad03e4335b26 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:07.419211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d5638-f2a3-4188-84e3-ff54d452f7d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:07.422637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d5638-f2a3-4188-84e3-ff54d452f7d5 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:07.442535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 411/795] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jul 20 17:37:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:07.444166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f583b45-8b4d-46f4-a77b-3b93b236161d None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:07.444446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f583b45-8b4d-46f4-a77b-3b93b236161d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:07.444754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f583b45-8b4d-46f4-a77b-3b93b236161d None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:07.446653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 412/796] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:07.447682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f583b45-8b4d-46f4-a77b-3b93b236161d None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:07.462093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 385/797] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jul 20 17:37:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:07.465057 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695154-d018-4ec1-a080-b47bf7e7b4ec None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:07.466520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695154-d018-4ec1-a080-b47bf7e7b4ec None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:07.467336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5695154-d018-4ec1-a080-b47bf7e7b4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:07.501436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-f5695154-d018-4ec1-a080-b47bf7e7b4ec None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:07.504178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f5695154-d018-4ec1-a080-b47bf7e7b4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:07.586355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f583b45-8b4d-46f4-a77b-3b93b236161d None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:07.600250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 386/798] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:07.601228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695154-d018-4ec1-a080-b47bf7e7b4ec None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:07.616028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:07.633246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:07.659718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525a054-e385-4c8c-81a5-47e48871b7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:07.660582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525a054-e385-4c8c-81a5-47e48871b7a8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:07.661269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525a054-e385-4c8c-81a5-47e48871b7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:07.661642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525a054-e385-4c8c-81a5-47e48871b7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:07.675370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525a054-e385-4c8c-81a5-47e48871b7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:07.678437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525a054-e385-4c8c-81a5-47e48871b7a8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-0525a054-e385-4c8c-81a5-47e48871b7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:07.711405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:07.713202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:07.714225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:07.714225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:07.714225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:07.714225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:07.714225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 413/799] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:07.716642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c1ce8-aecf-42e9-aca8-8f7bb8e0ad10 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:07.717213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c1ce8-aecf-42e9-aca8-8f7bb8e0ad10 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:07.717639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c1ce8-aecf-42e9-aca8-8f7bb8e0ad10 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:07.720638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 414/800] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:07.721864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c1ce8-aecf-42e9-aca8-8f7bb8e0ad10 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:07.728529 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5695154-d018-4ec1-a080-b47bf7e7b4ec None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:07.773395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d3a6b-1778-4a1c-a17e-741f1dcf7038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:07.774208 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d3a6b-1778-4a1c-a17e-741f1dcf7038 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:07.774491 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d3a6b-1778-4a1c-a17e-741f1dcf7038 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:07.774767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d3a6b-1778-4a1c-a17e-741f1dcf7038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:07.789415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d3a6b-1778-4a1c-a17e-741f1dcf7038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:07.790948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d3a6b-1778-4a1c-a17e-741f1dcf7038 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-bf8d3a6b-1778-4a1c-a17e-741f1dcf7038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:07.818634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:07.819807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:07.826528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:07.826528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:07.826528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:07.826528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:07.826528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 387/801] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:07.826528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d3a6b-1778-4a1c-a17e-741f1dcf7038 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:07.898319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c1ce8-aecf-42e9-aca8-8f7bb8e0ad10 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:07.919290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:07.957708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d3a6b-1778-4a1c-a17e-741f1dcf7038 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:07.962216 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a6fd4-3920-4646-b04a-396e91c063e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:07.963574 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a6fd4-3920-4646-b04a-396e91c063e5 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:07.964078 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a6fd4-3920-4646-b04a-396e91c063e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:07.964598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a6fd4-3920-4646-b04a-396e91c063e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:07.984700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a6fd4-3920-4646-b04a-396e91c063e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:07.997045 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9f901-dd18-4981-8602-d5eef1899d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:07.997686 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9f901-dd18-4981-8602-d5eef1899d06 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:07.998074 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9f901-dd18-4981-8602-d5eef1899d06 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:07.998355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9f901-dd18-4981-8602-d5eef1899d06 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:07.999090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9f901-dd18-4981-8602-d5eef1899d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:07.999408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9f901-dd18-4981-8602-d5eef1899d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-a53a6fd4-3920-4646-b04a-396e91c063e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:08.000004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:08.001901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:08.003542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:08.003542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:08.003542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:08.003542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:08.003542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:08.003542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:08.003542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:08.003542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:08.003542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:08.003542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:08.003542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:37:08.003542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:08.005874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9f901-dd18-4981-8602-d5eef1899d06 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:08.008692 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 415/802] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:37:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:08.010388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de8855-1816-438d-a4e2-7740f3468dc5 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:08.010692 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de8855-1816-438d-a4e2-7740f3468dc5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:08.010951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de8855-1816-438d-a4e2-7740f3468dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:08.019635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 388/803] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:08.020332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9f901-dd18-4981-8602-d5eef1899d06 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:08.033886 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-c6de8855-1816-438d-a4e2-7740f3468dc5 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:08.035430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c6de8855-1816-438d-a4e2-7740f3468dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:08.058682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:08.133397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 416/804] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:08.134408 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de8855-1816-438d-a4e2-7740f3468dc5 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:08.154797 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9f901-dd18-4981-8602-d5eef1899d06 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:08.190419 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:08.195950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4bca5-eb08-4edf-b64b-e2463369f1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:08.198929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4bca5-eb08-4edf-b64b-e2463369f1f5 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:08.198929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4bca5-eb08-4edf-b64b-e2463369f1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:08.198929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4bca5-eb08-4edf-b64b-e2463369f1f5 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:08.198929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4bca5-eb08-4edf-b64b-e2463369f1f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:08.198929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4bca5-eb08-4edf-b64b-e2463369f1f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:08.199704 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4bca5-eb08-4edf-b64b-e2463369f1f5 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:08.224818 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 389/805] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:08.225765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4bca5-eb08-4edf-b64b-e2463369f1f5 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:08.292045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de8855-1816-438d-a4e2-7740f3468dc5 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:08.341109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b48301-7279-463d-9443-5996ed53a858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:08.342165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b48301-7279-463d-9443-5996ed53a858 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:08.342457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b48301-7279-463d-9443-5996ed53a858 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:08.342739 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b48301-7279-463d-9443-5996ed53a858 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:08.344080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b48301-7279-463d-9443-5996ed53a858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:08.344392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b48301-7279-463d-9443-5996ed53a858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:08.345836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b48301-7279-463d-9443-5996ed53a858 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:08.361029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 417/806] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:37:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:08.361029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b48301-7279-463d-9443-5996ed53a858 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:08.364443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4bca5-eb08-4edf-b64b-e2463369f1f5 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:08.387363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:08.417681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438858d7-02cf-4483-b81c-2cb5ea340ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:08.418645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438858d7-02cf-4483-b81c-2cb5ea340ade None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:08.419592 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438858d7-02cf-4483-b81c-2cb5ea340ade None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:08.419877 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438858d7-02cf-4483-b81c-2cb5ea340ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:08.428591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438858d7-02cf-4483-b81c-2cb5ea340ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:08.430097 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438858d7-02cf-4483-b81c-2cb5ea340ade None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-438858d7-02cf-4483-b81c-2cb5ea340ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:08.448626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:08.450681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:08.452173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:08.452173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:08.452173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:08.452173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:08.452173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:08.452173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:08.452173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:08.452173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:08.456237 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 390/807] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:08.456237 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438858d7-02cf-4483-b81c-2cb5ea340ade None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:08.522735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b48301-7279-463d-9443-5996ed53a858 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:08.525135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:08.585706 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438858d7-02cf-4483-b81c-2cb5ea340ade None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:08.597372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffc3b1-5ac5-4d6a-9507-3be926fdc636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:08.598616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffc3b1-5ac5-4d6a-9507-3be926fdc636 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:08.599068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffc3b1-5ac5-4d6a-9507-3be926fdc636 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:08.599518 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffc3b1-5ac5-4d6a-9507-3be926fdc636 None admin] PATH_INFO: `/v3/services/network` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:08.600642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffc3b1-5ac5-4d6a-9507-3be926fdc636 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:08.602658 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffc3b1-5ac5-4d6a-9507-3be926fdc636 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-44ffc3b1-5ac5-4d6a-9507-3be926fdc636 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:08.624103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:08.625234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:08.631239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 418/808] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:08 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:08.632231 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffc3b1-5ac5-4d6a-9507-3be926fdc636 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:08.656220 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f96ab-af2f-4e71-a417-9a67ab5762c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:08.657303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f96ab-af2f-4e71-a417-9a67ab5762c3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:08.657744 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f96ab-af2f-4e71-a417-9a67ab5762c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:08.658204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f96ab-af2f-4e71-a417-9a67ab5762c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:08.672414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f96ab-af2f-4e71-a417-9a67ab5762c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:08.674669 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f96ab-af2f-4e71-a417-9a67ab5762c3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-ae2f96ab-af2f-4e71-a417-9a67ab5762c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:08.700369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:08.702340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:08.703475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:08.703475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:08.703475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:08.703475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:08.703475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:08.703475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:08.703475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:08.703475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:08.706886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 391/809] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:08.707638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f96ab-af2f-4e71-a417-9a67ab5762c3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:08.765315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:08.786486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffc3b1-5ac5-4d6a-9507-3be926fdc636 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:08.833445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cafd8-8adc-4ea8-a216-4cc373b0609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:08.834534 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cafd8-8adc-4ea8-a216-4cc373b0609a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:08.834930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cafd8-8adc-4ea8-a216-4cc373b0609a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:08.835311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cafd8-8adc-4ea8-a216-4cc373b0609a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:08.848118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cafd8-8adc-4ea8-a216-4cc373b0609a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:08.849386 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f96ab-af2f-4e71-a417-9a67ab5762c3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:08.849709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cafd8-8adc-4ea8-a216-4cc373b0609a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:08.865611 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-2e8cafd8-8adc-4ea8-a216-4cc373b0609a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:08.870075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:08.873638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:08.878688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:08.878688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:08.878688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:08.878688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:08.878688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 419/810] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:08.878688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cafd8-8adc-4ea8-a216-4cc373b0609a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:08.897165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef5373-3494-4ddc-bfd8-55f74d2bb46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:08.898030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef5373-3494-4ddc-bfd8-55f74d2bb46c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:08.898436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef5373-3494-4ddc-bfd8-55f74d2bb46c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:08.898798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef5373-3494-4ddc-bfd8-55f74d2bb46c None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:08.899784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef5373-3494-4ddc-bfd8-55f74d2bb46c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:08.900226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef5373-3494-4ddc-bfd8-55f74d2bb46c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:08.902063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef5373-3494-4ddc-bfd8-55f74d2bb46c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:08.916844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 392/811] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:08.917726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef5373-3494-4ddc-bfd8-55f74d2bb46c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:08.994081 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cafd8-8adc-4ea8-a216-4cc373b0609a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:09.029068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:09.036687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ab525-6d0a-434a-8a8f-3bc879b9a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:09.037616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab525-6d0a-434a-8a8f-3bc879b9a0e6 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:09.037952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab525-6d0a-434a-8a8f-3bc879b9a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:09.038427 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab525-6d0a-434a-8a8f-3bc879b9a0e6 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:09.044468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ab525-6d0a-434a-8a8f-3bc879b9a0e6 None admin] RBAC: Adding query filter params (name=network) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:09.044468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ab525-6d0a-434a-8a8f-3bc879b9a0e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:09.044468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ab525-6d0a-434a-8a8f-3bc879b9a0e6 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:09.044748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef5373-3494-4ddc-bfd8-55f74d2bb46c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:09.049310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 420/812] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:37:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:09.051028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54ba3a-941e-4a7a-925c-b8f5ed362ec0 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:09.051318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54ba3a-941e-4a7a-925c-b8f5ed362ec0 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:09.051593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54ba3a-941e-4a7a-925c-b8f5ed362ec0 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:09.053055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 421/813] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:09.054467 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54ba3a-941e-4a7a-925c-b8f5ed362ec0 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:09.110083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ab97-6639-43a5-83e8-022ef2643ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:09.111213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ab97-6639-43a5-83e8-022ef2643ebf None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:09.111722 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ab97-6639-43a5-83e8-022ef2643ebf None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:09.112241 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ab97-6639-43a5-83e8-022ef2643ebf None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:09.113723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9ab97-6639-43a5-83e8-022ef2643ebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:09.114288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9ab97-6639-43a5-83e8-022ef2643ebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:09.117018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9ab97-6639-43a5-83e8-022ef2643ebf None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:09.132338 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 393/814] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:09.132993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ab97-6639-43a5-83e8-022ef2643ebf None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:09.167988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54ba3a-941e-4a7a-925c-b8f5ed362ec0 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:09.173381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:09.213375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f458bc-ed0f-4d84-8023-81637618542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:09.214201 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f458bc-ed0f-4d84-8023-81637618542c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:09.214488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f458bc-ed0f-4d84-8023-81637618542c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:09.214832 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f458bc-ed0f-4d84-8023-81637618542c None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:09.216902 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f458bc-ed0f-4d84-8023-81637618542c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:09.217456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f458bc-ed0f-4d84-8023-81637618542c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:09.220081 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f458bc-ed0f-4d84-8023-81637618542c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:09.240946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 422/815] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:09.242237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f458bc-ed0f-4d84-8023-81637618542c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:09.256614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ab97-6639-43a5-83e8-022ef2643ebf None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:09.295790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dca2de-4c95-4bb8-9748-5586e11d6aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:09.296643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dca2de-4c95-4bb8-9748-5586e11d6aba None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:09.296933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dca2de-4c95-4bb8-9748-5586e11d6aba None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:09.297218 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dca2de-4c95-4bb8-9748-5586e11d6aba None admin] PATH_INFO: `/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/f518137b54ee4e668f41c0f660a54d90/roles/645163d4e8634094bb7d2a16f75bd1b0` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:09.316441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dca2de-4c95-4bb8-9748-5586e11d6aba None admin] RBAC: Authorizing `identity:create_grant(project_id=5f0f8db3986541468c474b78a9b3740a, user_id=f518137b54ee4e668f41c0f660a54d90, role_id=645163d4e8634094bb7d2a16f75bd1b0)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:09.318952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dca2de-4c95-4bb8-9748-5586e11d6aba None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:09.329136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:09.375854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f458bc-ed0f-4d84-8023-81637618542c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:09.407703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 394/816] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:37:09 2022] PUT /identity/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/f518137b54ee4e668f41c0f660a54d90/roles/645163d4e8634094bb7d2a16f75bd1b0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:37:09.411410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cb1d1-355d-4917-a4d5-251129701678 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:09.413061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cb1d1-355d-4917-a4d5-251129701678 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:09.413379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cb1d1-355d-4917-a4d5-251129701678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:09.417790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d23f-baac-48a0-b2ea-9fa5ed43f668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:09.419323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d23f-baac-48a0-b2ea-9fa5ed43f668 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:09.420087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d23f-baac-48a0-b2ea-9fa5ed43f668 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:09.420184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d23f-baac-48a0-b2ea-9fa5ed43f668 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:09.421327 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d23f-baac-48a0-b2ea-9fa5ed43f668 None admin] RBAC: Adding query filter params (type=network) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:09.421811 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d23f-baac-48a0-b2ea-9fa5ed43f668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:09.425744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d23f-baac-48a0-b2ea-9fa5ed43f668 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:09.440579 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 423/817] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:37:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:09.440579 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d23f-baac-48a0-b2ea-9fa5ed43f668 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:09.446166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-267cb1d1-355d-4917-a4d5-251129701678 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:09.448120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-267cb1d1-355d-4917-a4d5-251129701678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:09.542498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 395/818] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:09.543302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cb1d1-355d-4917-a4d5-251129701678 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:09.573266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:09.628283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d23f-baac-48a0-b2ea-9fa5ed43f668 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:09.655684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:09.677537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e7221-a8fb-47c8-8ca4-af8168cf899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:09.679190 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e7221-a8fb-47c8-8ca4-af8168cf899e None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:09.679698 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e7221-a8fb-47c8-8ca4-af8168cf899e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:09.680016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e7221-a8fb-47c8-8ca4-af8168cf899e None admin] PATH_INFO: `/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/9566befd16fc4b0c84d2bed34c4a5d28/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:09.683168 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e7221-a8fb-47c8-8ca4-af8168cf899e None admin] RBAC: Authorizing `identity:create_grant(project_id=5f0f8db3986541468c474b78a9b3740a, user_id=9566befd16fc4b0c84d2bed34c4a5d28, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:09.685476 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e7221-a8fb-47c8-8ca4-af8168cf899e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:09.706947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cb1d1-355d-4917-a4d5-251129701678 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:09.747302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f0c94-b2e6-425a-9fcb-c813e4e42116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:09.748153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f0c94-b2e6-425a-9fcb-c813e4e42116 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:09.748638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f0c94-b2e6-425a-9fcb-c813e4e42116 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:09.748916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f0c94-b2e6-425a-9fcb-c813e4e42116 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:09.763588 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f0c94-b2e6-425a-9fcb-c813e4e42116 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:09.766543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f0c94-b2e6-425a-9fcb-c813e4e42116 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:09.777108 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 424/819] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:37:09 2022] PUT /identity/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/9566befd16fc4b0c84d2bed34c4a5d28/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:37:09.779678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e7221-a8fb-47c8-8ca4-af8168cf899e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-9d6f0c94-b2e6-425a-9fcb-c813e4e42116 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:09.795411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:09.796546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:09.797494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:09.797494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:09.797494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:09.797494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:09.797494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:09.797494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:09.797494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:09.797494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:09.797494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:37:09.797494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:09.802510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 396/820] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 20 17:37:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:09.803701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f0c94-b2e6-425a-9fcb-c813e4e42116 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:09.919429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:09.962296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f0c94-b2e6-425a-9fcb-c813e4e42116 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:09.971328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e7221-a8fb-47c8-8ca4-af8168cf899e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:10.021979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38008dd3-9b1b-4acc-acd6-7462cc464988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:10.022969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38008dd3-9b1b-4acc-acd6-7462cc464988 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:10.023356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38008dd3-9b1b-4acc-acd6-7462cc464988 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:10.023734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38008dd3-9b1b-4acc-acd6-7462cc464988 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:10.024456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38008dd3-9b1b-4acc-acd6-7462cc464988 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:10.026067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38008dd3-9b1b-4acc-acd6-7462cc464988 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:10.035574 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddbd1f-ea7f-43ab-94d8-ceb9bcb2828f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:10.037291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddbd1f-ea7f-43ab-94d8-ceb9bcb2828f None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:10.037811 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddbd1f-ea7f-43ab-94d8-ceb9bcb2828f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:10.038477 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddbd1f-ea7f-43ab-94d8-ceb9bcb2828f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:10.039549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddbd1f-ea7f-43ab-94d8-ceb9bcb2828f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-38008dd3-9b1b-4acc-acd6-7462cc464988 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:10.041593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:10.042807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:10.043698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 397/821] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Jul 20 17:37:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:10.044602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38008dd3-9b1b-4acc-acd6-7462cc464988 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:10.045634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddbd1f-ea7f-43ab-94d8-ceb9bcb2828f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:10.181372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 425/822] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 20 17:37:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:37:10.183130 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddbd1f-ea7f-43ab-94d8-ceb9bcb2828f None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:10.184868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38008dd3-9b1b-4acc-acd6-7462cc464988 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:10.257745 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:10.266544 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:10.271571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69775c7-a1e3-4628-a1f2-041641c7182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:10.277512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69775c7-a1e3-4628-a1f2-041641c7182b None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:10.278140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69775c7-a1e3-4628-a1f2-041641c7182b None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:10.278658 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69775c7-a1e3-4628-a1f2-041641c7182b None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:10.280388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69775c7-a1e3-4628-a1f2-041641c7182b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:10.281000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69775c7-a1e3-4628-a1f2-041641c7182b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:10.283716 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69775c7-a1e3-4628-a1f2-041641c7182b None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:10.352156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 398/823] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 20 17:37:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:10.375359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69775c7-a1e3-4628-a1f2-041641c7182b None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:10.456921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddbd1f-ea7f-43ab-94d8-ceb9bcb2828f None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:10.517172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69775c7-a1e3-4628-a1f2-041641c7182b None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:10.523799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f32e2e-eb9b-4dad-a618-1d5c4c197452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:10.524839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f32e2e-eb9b-4dad-a618-1d5c4c197452 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:10.525354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f32e2e-eb9b-4dad-a618-1d5c4c197452 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:10.525871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f32e2e-eb9b-4dad-a618-1d5c4c197452 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:10.527277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f32e2e-eb9b-4dad-a618-1d5c4c197452 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:10.527737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f32e2e-eb9b-4dad-a618-1d5c4c197452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:10.532441 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f32e2e-eb9b-4dad-a618-1d5c4c197452 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:10.541821 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 426/824] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jul 20 17:37:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:10.557628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f32e2e-eb9b-4dad-a618-1d5c4c197452 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:10.565789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380c10b-2d76-4d00-acd2-64db3a3dcb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:10.566452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380c10b-2d76-4d00-acd2-64db3a3dcb21 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:10.566735 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380c10b-2d76-4d00-acd2-64db3a3dcb21 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:10.567010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380c10b-2d76-4d00-acd2-64db3a3dcb21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:10.648171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:10.660401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380c10b-2d76-4d00-acd2-64db3a3dcb21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:10.662160 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380c10b-2d76-4d00-acd2-64db3a3dcb21 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:10.728131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:10.737320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f32e2e-eb9b-4dad-a618-1d5c4c197452 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:10.775169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 399/825] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:37:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 17:37:10.781615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380c10b-2d76-4d00-acd2-64db3a3dcb21 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:10.783087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18efd3f-43c5-4631-8c6f-ab18c479a9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:10.784430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18efd3f-43c5-4631-8c6f-ab18c479a9ce None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:10.784996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18efd3f-43c5-4631-8c6f-ab18c479a9ce None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:10.785468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18efd3f-43c5-4631-8c6f-ab18c479a9ce None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:10.786645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18efd3f-43c5-4631-8c6f-ab18c479a9ce None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:10.787172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18efd3f-43c5-4631-8c6f-ab18c479a9ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:10.788788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18efd3f-43c5-4631-8c6f-ab18c479a9ce None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:10.800528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 427/826] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Jul 20 17:37:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:10.801745 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18efd3f-43c5-4631-8c6f-ab18c479a9ce None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:10.899423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:10.917037 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380c10b-2d76-4d00-acd2-64db3a3dcb21 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:10.925543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18efd3f-43c5-4631-8c6f-ab18c479a9ce None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:10.961571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddedd2-8850-4aba-bb16-2cbd046655f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:10.962504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddedd2-8850-4aba-bb16-2cbd046655f1 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:10.962707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddedd2-8850-4aba-bb16-2cbd046655f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:10.962954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddedd2-8850-4aba-bb16-2cbd046655f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:10.971492 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79810e6-834b-4f16-87e0-1fb5f392a5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:10.972662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79810e6-834b-4f16-87e0-1fb5f392a5bb None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:10.973175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79810e6-834b-4f16-87e0-1fb5f392a5bb None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:10.973813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79810e6-834b-4f16-87e0-1fb5f392a5bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:10.974859 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79810e6-834b-4f16-87e0-1fb5f392a5bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:10.976077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddedd2-8850-4aba-bb16-2cbd046655f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:10.976814 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79810e6-834b-4f16-87e0-1fb5f392a5bb None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:10.977769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddedd2-8850-4aba-bb16-2cbd046655f1 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-ebddedd2-8850-4aba-bb16-2cbd046655f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:10.998286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:11.003125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:11.004071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:11.004071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:11.004071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:11.004071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:11.004071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 400/827] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:11.005676 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddedd2-8850-4aba-bb16-2cbd046655f1 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:11.089689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 428/828] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 20 17:37:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:37:11.128900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddedd2-8850-4aba-bb16-2cbd046655f1 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:11.176555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e46385-6a87-4a78-bdf0-818b0331d7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:11.177270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e46385-6a87-4a78-bdf0-818b0331d7cc None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:11.177538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e46385-6a87-4a78-bdf0-818b0331d7cc None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:11.177812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e46385-6a87-4a78-bdf0-818b0331d7cc None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:11.178730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e46385-6a87-4a78-bdf0-818b0331d7cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:11.179043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e46385-6a87-4a78-bdf0-818b0331d7cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:11.180564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e46385-6a87-4a78-bdf0-818b0331d7cc None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:11.189082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:11.195703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 401/829] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:11.201980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79810e6-834b-4f16-87e0-1fb5f392a5bb None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:11.234290 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:11.359577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79810e6-834b-4f16-87e0-1fb5f392a5bb None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:11.425538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cab270-e814-4ef0-a099-701e5b042911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:11.427007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cab270-e814-4ef0-a099-701e5b042911 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:11.427482 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cab270-e814-4ef0-a099-701e5b042911 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:11.427924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cab270-e814-4ef0-a099-701e5b042911 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:11.436440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cab270-e814-4ef0-a099-701e5b042911 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:11.438118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cab270-e814-4ef0-a099-701e5b042911 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-67cab270-e814-4ef0-a099-701e5b042911 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:11.457446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:11.459428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:11.461472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:11.461472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:11.461472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:11.461472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:11.461472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:11.461472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:11.461472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:11.461472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:11.465044 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 429/830] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:11.473617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e46385-6a87-4a78-bdf0-818b0331d7cc None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:11.598074 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e46385-6a87-4a78-bdf0-818b0331d7cc None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:11.636075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d34d2-a8d1-457f-996b-3ffabf1a2a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:11.637118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d34d2-a8d1-457f-996b-3ffabf1a2a9d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:11.637627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d34d2-a8d1-457f-996b-3ffabf1a2a9d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:11.638084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d34d2-a8d1-457f-996b-3ffabf1a2a9d None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:11.639307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d34d2-a8d1-457f-996b-3ffabf1a2a9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:11.639822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d34d2-a8d1-457f-996b-3ffabf1a2a9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:11.641492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d34d2-a8d1-457f-996b-3ffabf1a2a9d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:11.655760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 402/831] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:11.662364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cab270-e814-4ef0-a099-701e5b042911 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:11.769622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:11.791760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cab270-e814-4ef0-a099-701e5b042911 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:11.830847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a4357-4c06-4edc-a825-3785f468a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:11.831516 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4357-4c06-4edc-a825-3785f468a68c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:11.831795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4357-4c06-4edc-a825-3785f468a68c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:11.832071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4357-4c06-4edc-a825-3785f468a68c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:11.832944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a4357-4c06-4edc-a825-3785f468a68c None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=3b52e88df44d49b186d54a8d045595ed) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:11.833255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a4357-4c06-4edc-a825-3785f468a68c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:11.834700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a4357-4c06-4edc-a825-3785f468a68c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:11.843132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 430/832] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:37:11 2022] GET /identity/v3/role_assignments?user.id=3b52e88df44d49b186d54a8d045595ed&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:12.294876 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c49407-aa97-4fb7-a9ab-4e8ca2fdf691 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:12.295756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c49407-aa97-4fb7-a9ab-4e8ca2fdf691 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:12.296192 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c49407-aa97-4fb7-a9ab-4e8ca2fdf691 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:12.298082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 403/833] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:12.303889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3c093-1030-460e-9103-fc8976e69ee8 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:12.304399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3c093-1030-460e-9103-fc8976e69ee8 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:12.304843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3c093-1030-460e-9103-fc8976e69ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:12.328677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-8be3c093-1030-460e-9103-fc8976e69ee8 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:12.329947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8be3c093-1030-460e-9103-fc8976e69ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:12.330788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608ada-613f-4301-8e28-e9552ef78f0a None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:12.331372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608ada-613f-4301-8e28-e9552ef78f0a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:12.331861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608ada-613f-4301-8e28-e9552ef78f0a None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:12.333715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 404/834] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:12.339346 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf64086-ac6d-4bcd-b369-b95a89e2344e None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:12.339919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf64086-ac6d-4bcd-b369-b95a89e2344e None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:12.340438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf64086-ac6d-4bcd-b369-b95a89e2344e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:12.359558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-edf64086-ac6d-4bcd-b369-b95a89e2344e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:12.361203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-edf64086-ac6d-4bcd-b369-b95a89e2344e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:12.413435 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 431/835] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:12.438934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3c093-1030-460e-9103-fc8976e69ee8 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:12.439162 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:12.459530 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 405/836] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:12.483374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf64086-ac6d-4bcd-b369-b95a89e2344e None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:12.560331 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:12.594930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf64086-ac6d-4bcd-b369-b95a89e2344e None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:12.610354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3c093-1030-460e-9103-fc8976e69ee8 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:12.634098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c61d9-ba61-4f4d-a52e-f151853f3443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:12.634914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c61d9-ba61-4f4d-a52e-f151853f3443 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:12.635279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c61d9-ba61-4f4d-a52e-f151853f3443 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:12.635553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c61d9-ba61-4f4d-a52e-f151853f3443 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:12.649148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c61d9-ba61-4f4d-a52e-f151853f3443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:12.649384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a53779-524a-4189-ae49-2832c76e3b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:12.649997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a53779-524a-4189-ae49-2832c76e3b7e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:12.650283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a53779-524a-4189-ae49-2832c76e3b7e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:12.650559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a53779-524a-4189-ae49-2832c76e3b7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-e26c61d9-ba61-4f4d-a52e-f151853f3443 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:12.657808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:12.658890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:12.659785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 406/837] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:37:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:12.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a53779-524a-4189-ae49-2832c76e3b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:12.667683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c61d9-ba61-4f4d-a52e-f151853f3443 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-82a53779-524a-4189-ae49-2832c76e3b7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:12.671955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:12.673184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:12.674040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:12.674040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:12.674040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:12.674040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:12.674040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:12.674040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:12.674040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:12.674040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:12.674040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:12.674040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:12.674040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:37:12.674040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:12.678454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 432/838] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:37:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:12.679494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a53779-524a-4189-ae49-2832c76e3b7e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:12.735734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:12.797770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a53779-524a-4189-ae49-2832c76e3b7e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:12.807771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c61d9-ba61-4f4d-a52e-f151853f3443 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:12.843932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509be33-8cca-4a85-a795-b6b1e59fa2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:12.845110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509be33-8cca-4a85-a795-b6b1e59fa2a1 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:12.845403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509be33-8cca-4a85-a795-b6b1e59fa2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:12.845843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509be33-8cca-4a85-a795-b6b1e59fa2a1 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:12.846788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509be33-8cca-4a85-a795-b6b1e59fa2a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:12.847300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509be33-8cca-4a85-a795-b6b1e59fa2a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:12.849673 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509be33-8cca-4a85-a795-b6b1e59fa2a1 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:12.851598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:12.854839 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3c911-972c-4309-94da-b9c110ee6fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:12.855833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3c911-972c-4309-94da-b9c110ee6fe0 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:12.857154 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3c911-972c-4309-94da-b9c110ee6fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:12.857657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3c911-972c-4309-94da-b9c110ee6fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:12.858945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3c911-972c-4309-94da-b9c110ee6fe0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:12.859460 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3c911-972c-4309-94da-b9c110ee6fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:12.861284 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3c911-972c-4309-94da-b9c110ee6fe0 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:12.864574 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 433/839] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:37:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:12.866777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509be33-8cca-4a85-a795-b6b1e59fa2a1 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:12.879224 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 407/840] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:37:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:12.884649 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3c911-972c-4309-94da-b9c110ee6fe0 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:13.029498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3c911-972c-4309-94da-b9c110ee6fe0 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:13.042640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509be33-8cca-4a85-a795-b6b1e59fa2a1 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:13.047344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:13.088835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63f3fb-8b1e-410b-9cdc-b4187a5e8d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:13.089659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63f3fb-8b1e-410b-9cdc-b4187a5e8d36 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:13.089943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63f3fb-8b1e-410b-9cdc-b4187a5e8d36 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:13.090222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63f3fb-8b1e-410b-9cdc-b4187a5e8d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:13.110654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63f3fb-8b1e-410b-9cdc-b4187a5e8d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:13.112850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63f3fb-8b1e-410b-9cdc-b4187a5e8d36 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:13.113023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d9a22-79a2-4530-ae84-ba3a950e5d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:13.113948 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d9a22-79a2-4530-ae84-ba3a950e5d76 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:13.114312 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d9a22-79a2-4530-ae84-ba3a950e5d76 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:13.114662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d9a22-79a2-4530-ae84-ba3a950e5d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:13.133348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d9a22-79a2-4530-ae84-ba3a950e5d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:13.135127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d9a22-79a2-4530-ae84-ba3a950e5d76 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-2a63f3fb-8b1e-410b-9cdc-b4187a5e8d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:13.139751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:13.140914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:13.142032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:13.142032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:13.142032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:13.142032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:13.147694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 408/841] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:13.148901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63f3fb-8b1e-410b-9cdc-b4187a5e8d36 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-f56d9a22-79a2-4530-ae84-ba3a950e5d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:13.160504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:13.161871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:13.162978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:13.162978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:13.162978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:13.162978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:13.165719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 434/842] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:13.175488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d9a22-79a2-4530-ae84-ba3a950e5d76 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:13.266666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63f3fb-8b1e-410b-9cdc-b4187a5e8d36 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:13.270993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:13.304800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb0a62-cc2e-460c-b4b6-1003f056b7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:13.305575 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0a62-cc2e-460c-b4b6-1003f056b7d8 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:13.305858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0a62-cc2e-460c-b4b6-1003f056b7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:13.306349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0a62-cc2e-460c-b4b6-1003f056b7d8 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:13.307157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb0a62-cc2e-460c-b4b6-1003f056b7d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:13.307543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb0a62-cc2e-460c-b4b6-1003f056b7d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:13.309046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb0a62-cc2e-460c-b4b6-1003f056b7d8 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:13.326729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 409/843] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:13.332830 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb0a62-cc2e-460c-b4b6-1003f056b7d8 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:13.358022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d9a22-79a2-4530-ae84-ba3a950e5d76 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:13.383951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:13.402018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53357c7-d47a-4bf1-9d97-04beccd9d2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:13.402810 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53357c7-d47a-4bf1-9d97-04beccd9d2fc None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:13.403570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53357c7-d47a-4bf1-9d97-04beccd9d2fc None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:13.403920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53357c7-d47a-4bf1-9d97-04beccd9d2fc None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:13.404820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53357c7-d47a-4bf1-9d97-04beccd9d2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:13.405194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53357c7-d47a-4bf1-9d97-04beccd9d2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:13.406833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53357c7-d47a-4bf1-9d97-04beccd9d2fc None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:13.427279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 435/844] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:13.432611 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53357c7-d47a-4bf1-9d97-04beccd9d2fc None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:13.507068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb0a62-cc2e-460c-b4b6-1003f056b7d8 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:13.549564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd10ee3-c611-43eb-87cd-3efdb3f50765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:13.550395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd10ee3-c611-43eb-87cd-3efdb3f50765 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:13.550700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd10ee3-c611-43eb-87cd-3efdb3f50765 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:13.550969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd10ee3-c611-43eb-87cd-3efdb3f50765 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:13.560663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd10ee3-c611-43eb-87cd-3efdb3f50765 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:13.562479 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd10ee3-c611-43eb-87cd-3efdb3f50765 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-6bd10ee3-c611-43eb-87cd-3efdb3f50765 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:13.581475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:13.583438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:13.585409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:13.585409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:13.585409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:13.585409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:13.585409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:13.585409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:13.585409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:13.585409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:13.585409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 17:37:13.585409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:13.587765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 410/845] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 20 17:37:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:13.588715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd10ee3-c611-43eb-87cd-3efdb3f50765 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:13.644809 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53357c7-d47a-4bf1-9d97-04beccd9d2fc None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:13.665258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:13.693484 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:13.714582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd10ee3-c611-43eb-87cd-3efdb3f50765 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:13.725564 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803c03d-7515-404b-8a2b-b6f2a61d36de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:13.727512 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803c03d-7515-404b-8a2b-b6f2a61d36de None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:13.728310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803c03d-7515-404b-8a2b-b6f2a61d36de None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:13.729137 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803c03d-7515-404b-8a2b-b6f2a61d36de None admin] PATH_INFO: `/v3/users/swift` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:13.747591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803c03d-7515-404b-8a2b-b6f2a61d36de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:13.751150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803c03d-7515-404b-8a2b-b6f2a61d36de None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:13.752776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e300de-5c93-424a-b2b7-45269adf2ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:13.753456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e300de-5c93-424a-b2b7-45269adf2ec6 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:13.753770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e300de-5c93-424a-b2b7-45269adf2ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:13.754034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e300de-5c93-424a-b2b7-45269adf2ec6 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:13.754856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e300de-5c93-424a-b2b7-45269adf2ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:13.755186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e300de-5c93-424a-b2b7-45269adf2ec6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:13.756587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e300de-5c93-424a-b2b7-45269adf2ec6 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:13.781623 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 411/846] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jul 20 17:37:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:13.782608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e300de-5c93-424a-b2b7-45269adf2ec6 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-b803c03d-7515-404b-8a2b-b6f2a61d36de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:13.786737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:13.788568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:13.790505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:13.790505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:13.790505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:13.790505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:13.790505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:13.790505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:13.790505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:13.790505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:13.790505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 17:37:13.790505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:13.804065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 436/847] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:37:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:13.807993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803c03d-7515-404b-8a2b-b6f2a61d36de None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:13.906309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e300de-5c93-424a-b2b7-45269adf2ec6 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:13.962042 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803c03d-7515-404b-8a2b-b6f2a61d36de None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:13.967228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d61856-13a5-4281-9ed5-a2dd6f458d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:13.968301 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d61856-13a5-4281-9ed5-a2dd6f458d2f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:13.968863 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d61856-13a5-4281-9ed5-a2dd6f458d2f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:13.969363 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d61856-13a5-4281-9ed5-a2dd6f458d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:13.989856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:14.006820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e8271-c644-4461-b9bc-17e5b8b90aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:14.007873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e8271-c644-4461-b9bc-17e5b8b90aea None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:14.008383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e8271-c644-4461-b9bc-17e5b8b90aea None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:14.008906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e8271-c644-4461-b9bc-17e5b8b90aea None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:14.010005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e8271-c644-4461-b9bc-17e5b8b90aea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:14.010561 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e8271-c644-4461-b9bc-17e5b8b90aea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:14.013460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e8271-c644-4461-b9bc-17e5b8b90aea None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:14.043147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 437/848] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Jul 20 17:37:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:14.044504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e8271-c644-4461-b9bc-17e5b8b90aea None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:14.077821 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:14.100747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d61856-13a5-4281-9ed5-a2dd6f458d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:14.103311 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d61856-13a5-4281-9ed5-a2dd6f458d2f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:14.178165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e8271-c644-4461-b9bc-17e5b8b90aea None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:14.218102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717d1b9-9ff7-4f75-9a06-9ac66dca97d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:14.218772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d1b9-9ff7-4f75-9a06-9ac66dca97d8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:14.219066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d1b9-9ff7-4f75-9a06-9ac66dca97d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:14.219385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d1b9-9ff7-4f75-9a06-9ac66dca97d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:14.245538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 412/849] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:37:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:37:14.247835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab14bb-e156-4aba-904d-6667fe3af428 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:14.248136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab14bb-e156-4aba-904d-6667fe3af428 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:14.248427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab14bb-e156-4aba-904d-6667fe3af428 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:14.250060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 413/850] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:14.251574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90d71-d9e0-4763-8432-be9215ae5b8d None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:14.251574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90d71-d9e0-4763-8432-be9215ae5b8d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:14.251890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90d71-d9e0-4763-8432-be9215ae5b8d None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:14.253465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 414/851] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:14.254235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a90d71-d9e0-4763-8432-be9215ae5b8d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:14.313304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717d1b9-9ff7-4f75-9a06-9ac66dca97d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:14.314780 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717d1b9-9ff7-4f75-9a06-9ac66dca97d8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:14.317143 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:14.346585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:14.395371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a90d71-d9e0-4763-8432-be9215ae5b8d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:14.441014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115db57c-bbf2-4f4c-9120-f5ef8527ba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:14.442169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115db57c-bbf2-4f4c-9120-f5ef8527ba13 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:14.442630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115db57c-bbf2-4f4c-9120-f5ef8527ba13 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:14.443084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115db57c-bbf2-4f4c-9120-f5ef8527ba13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:14.459644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115db57c-bbf2-4f4c-9120-f5ef8527ba13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:14.462498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115db57c-bbf2-4f4c-9120-f5ef8527ba13 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:14.466155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 438/852] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:37:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:37:14.467833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c992d4-f672-4020-b40c-9dac667b335c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:14.468270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c992d4-f672-4020-b40c-9dac667b335c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:14.468715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c992d4-f672-4020-b40c-9dac667b335c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-115db57c-bbf2-4f4c-9120-f5ef8527ba13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:14.485808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:14.487532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:14.489247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:14.489247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:14.489247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:14.489247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:14.489247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 415/853] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:14.489247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b668d0-a88a-4e67-9cae-c154bbafe5ad None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:14.489247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b668d0-a88a-4e67-9cae-c154bbafe5ad None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:14.489247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b668d0-a88a-4e67-9cae-c154bbafe5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:14.494410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-60c992d4-f672-4020-b40c-9dac667b335c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:14.495752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-60c992d4-f672-4020-b40c-9dac667b335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:14.507128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c0b668d0-a88a-4e67-9cae-c154bbafe5ad None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:14.508351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c0b668d0-a88a-4e67-9cae-c154bbafe5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:14.582893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 439/854] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:14.584034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c992d4-f672-4020-b40c-9dac667b335c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:14.595535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 416/855] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:14.595535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b668d0-a88a-4e67-9cae-c154bbafe5ad None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:14.620835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:14.658676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:14.703033 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b668d0-a88a-4e67-9cae-c154bbafe5ad None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:14.707052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c992d4-f672-4020-b40c-9dac667b335c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:14.748901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cf101-40ef-4b1c-b29d-597c771b78d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:14.750028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cf101-40ef-4b1c-b29d-597c771b78d0 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:14.750413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e8ab5-727b-4114-b7c0-3b7615babf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:14.750554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cf101-40ef-4b1c-b29d-597c771b78d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:14.751039 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cf101-40ef-4b1c-b29d-597c771b78d0 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:14.751227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e8ab5-727b-4114-b7c0-3b7615babf86 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:14.751510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e8ab5-727b-4114-b7c0-3b7615babf86 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:14.751781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e8ab5-727b-4114-b7c0-3b7615babf86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:14.752161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cf101-40ef-4b1c-b29d-597c771b78d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:14.752766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cf101-40ef-4b1c-b29d-597c771b78d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:14.755434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cf101-40ef-4b1c-b29d-597c771b78d0 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:14.764738 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e8ab5-727b-4114-b7c0-3b7615babf86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:14.766239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e8ab5-727b-4114-b7c0-3b7615babf86 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:14.772964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 417/856] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:14.773632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cf101-40ef-4b1c-b29d-597c771b78d0 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-dc7e8ab5-727b-4114-b7c0-3b7615babf86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:14.787417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:14.788458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:14.789399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:14.789399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:14.789399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:14.789399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:14.789399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 440/857] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:14.789673 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e8ab5-727b-4114-b7c0-3b7615babf86 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:14.881167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:14.905942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cf101-40ef-4b1c-b29d-597c771b78d0 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:14.913620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e8ab5-727b-4114-b7c0-3b7615babf86 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:14.925079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:14.948743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05894283-7acf-4aa8-8bfd-325cab6de986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:14.949566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05894283-7acf-4aa8-8bfd-325cab6de986 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:14.950717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05894283-7acf-4aa8-8bfd-325cab6de986 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:14.950717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05894283-7acf-4aa8-8bfd-325cab6de986 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:14.951334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05894283-7acf-4aa8-8bfd-325cab6de986 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:14.952857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05894283-7acf-4aa8-8bfd-325cab6de986 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:14.953014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeb231-9666-48d0-9c78-4c418a5ef272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:14.956291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeb231-9666-48d0-9c78-4c418a5ef272 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:14.956291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeb231-9666-48d0-9c78-4c418a5ef272 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:14.956291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeb231-9666-48d0-9c78-4c418a5ef272 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:14.956291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeb231-9666-48d0-9c78-4c418a5ef272 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:14.956291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeb231-9666-48d0-9c78-4c418a5ef272 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-05894283-7acf-4aa8-8bfd-325cab6de986 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:14.966464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:14.967808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 17:37:14.968975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-eedeb231-9666-48d0-9c78-4c418a5ef272 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:14.970115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:14.971631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 17:37:14.974315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:14.976185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 418/858] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Jul 20 17:37:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:14.976185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05894283-7acf-4aa8-8bfd-325cab6de986 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:14.976682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 441/859] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:37:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:14.976682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeb231-9666-48d0-9c78-4c418a5ef272 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:15.088558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05894283-7acf-4aa8-8bfd-325cab6de986 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:15.096922 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeb231-9666-48d0-9c78-4c418a5ef272 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:15.128596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad377523-6cbc-4b4a-a312-dc531af55ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:15.129411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad377523-6cbc-4b4a-a312-dc531af55ed8 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:15.129691 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad377523-6cbc-4b4a-a312-dc531af55ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:15.129964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad377523-6cbc-4b4a-a312-dc531af55ed8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:15.137996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad377523-6cbc-4b4a-a312-dc531af55ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:15.139503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad377523-6cbc-4b4a-a312-dc531af55ed8 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:15.144387 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048020c-9ef3-480b-8b10-447e8695a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:15.145085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048020c-9ef3-480b-8b10-447e8695a961 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:15.145364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048020c-9ef3-480b-8b10-447e8695a961 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:15.145632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048020c-9ef3-480b-8b10-447e8695a961 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:15.146356 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048020c-9ef3-480b-8b10-447e8695a961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:15.146654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048020c-9ef3-480b-8b10-447e8695a961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:15.148035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048020c-9ef3-480b-8b10-447e8695a961 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-ad377523-6cbc-4b4a-a312-dc531af55ed8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:15.155251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:15.156240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:15.157155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:15.157155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:15.157155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:15.157155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:15.157155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:15.157155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:15.157155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:15.157155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:15.157155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 419/860] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:15.157662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad377523-6cbc-4b4a-a312-dc531af55ed8 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:15.167392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 442/861] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:15.168512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:15.169510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048020c-9ef3-480b-8b10-447e8695a961 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:15.210317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:15.286559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad377523-6cbc-4b4a-a312-dc531af55ed8 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:15.305032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048020c-9ef3-480b-8b10-447e8695a961 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:15.325472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b21f1-e3fa-4303-bb66-5142d2b92880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:15.326151 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b21f1-e3fa-4303-bb66-5142d2b92880 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:15.326423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b21f1-e3fa-4303-bb66-5142d2b92880 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:15.326704 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b21f1-e3fa-4303-bb66-5142d2b92880 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:15.327424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b21f1-e3fa-4303-bb66-5142d2b92880 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:15.327738 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b21f1-e3fa-4303-bb66-5142d2b92880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:15.329153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b21f1-e3fa-4303-bb66-5142d2b92880 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:15.335039 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 420/862] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 20 17:37:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:15.335838 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b21f1-e3fa-4303-bb66-5142d2b92880 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:15.349071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faae2d0-a3c1-49de-85fb-59bc69455e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:15.349757 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae2d0-a3c1-49de-85fb-59bc69455e20 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:15.350041 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae2d0-a3c1-49de-85fb-59bc69455e20 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:15.350324 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae2d0-a3c1-49de-85fb-59bc69455e20 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:15.351046 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faae2d0-a3c1-49de-85fb-59bc69455e20 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:15.351356 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faae2d0-a3c1-49de-85fb-59bc69455e20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:15.353025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faae2d0-a3c1-49de-85fb-59bc69455e20 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:15.358399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 443/863] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:37:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:15.359247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faae2d0-a3c1-49de-85fb-59bc69455e20 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:15.420575 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:15.455915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b21f1-e3fa-4303-bb66-5142d2b92880 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:15.484002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:15.490473 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faae2d0-a3c1-49de-85fb-59bc69455e20 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:15.510390 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24f4ce-f070-4e3c-a80b-21580b05de4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:15.511511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24f4ce-f070-4e3c-a80b-21580b05de4c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:15.511937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24f4ce-f070-4e3c-a80b-21580b05de4c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:15.512929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24f4ce-f070-4e3c-a80b-21580b05de4c None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:15.513838 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24f4ce-f070-4e3c-a80b-21580b05de4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:15.514154 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24f4ce-f070-4e3c-a80b-21580b05de4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:15.515719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24f4ce-f070-4e3c-a80b-21580b05de4c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:15.527397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbe391-8742-4877-b097-8147ff4ae883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:15.528909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbe391-8742-4877-b097-8147ff4ae883 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:15.529397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbe391-8742-4877-b097-8147ff4ae883 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:15.529864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbe391-8742-4877-b097-8147ff4ae883 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:15.530063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 421/864] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:15.530738 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24f4ce-f070-4e3c-a80b-21580b05de4c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:15.537902 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbe391-8742-4877-b097-8147ff4ae883 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:15.539359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbe391-8742-4877-b097-8147ff4ae883 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-90dbe391-8742-4877-b097-8147ff4ae883 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:15.554865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:15.555983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:15.556976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:15.556976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:15.556976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:15.556976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:15.556976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:15.556976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:15.556976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:15.556976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:15.556976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 444/865] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:15.556976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbe391-8742-4877-b097-8147ff4ae883 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:15.666244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24f4ce-f070-4e3c-a80b-21580b05de4c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:15.671413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbe391-8742-4877-b097-8147ff4ae883 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:15.697423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:15.704104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a38d21-52c6-4910-ac48-716063ed3ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:15.704806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a38d21-52c6-4910-ac48-716063ed3ebd None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:15.705089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a38d21-52c6-4910-ac48-716063ed3ebd None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:15.705364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a38d21-52c6-4910-ac48-716063ed3ebd None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:15.706224 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a38d21-52c6-4910-ac48-716063ed3ebd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:15.706529 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a38d21-52c6-4910-ac48-716063ed3ebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:15.707904 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a38d21-52c6-4910-ac48-716063ed3ebd None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:15.709743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048d6af-2c13-4bd9-a182-9abe2dffedf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:15.713407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048d6af-2c13-4bd9-a182-9abe2dffedf8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:15.713407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048d6af-2c13-4bd9-a182-9abe2dffedf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:15.713407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048d6af-2c13-4bd9-a182-9abe2dffedf8 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:15.713407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048d6af-2c13-4bd9-a182-9abe2dffedf8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:15.713407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048d6af-2c13-4bd9-a182-9abe2dffedf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:15.713957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 422/866] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 20 17:37:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:15.714042 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048d6af-2c13-4bd9-a182-9abe2dffedf8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:15.714364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a38d21-52c6-4910-ac48-716063ed3ebd None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:15.720884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 445/867] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:37:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:15.721842 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048d6af-2c13-4bd9-a182-9abe2dffedf8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:15.762576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:15.862103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048d6af-2c13-4bd9-a182-9abe2dffedf8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:15.905167 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf3337-054c-4fe5-88d0-04921c4ce50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:15.905905 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf3337-054c-4fe5-88d0-04921c4ce50b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:15.906190 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf3337-054c-4fe5-88d0-04921c4ce50b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:15.906457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf3337-054c-4fe5-88d0-04921c4ce50b None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:15.907263 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf3337-054c-4fe5-88d0-04921c4ce50b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:15.907568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf3337-054c-4fe5-88d0-04921c4ce50b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:15.909063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf3337-054c-4fe5-88d0-04921c4ce50b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:15.923965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 446/868] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:15.930282 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf3337-054c-4fe5-88d0-04921c4ce50b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:15.946110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a38d21-52c6-4910-ac48-716063ed3ebd None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:16.005704 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935a929-770b-491d-b733-947f8e59c257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:16.007057 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935a929-770b-491d-b733-947f8e59c257 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:16.008115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935a929-770b-491d-b733-947f8e59c257 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:16.008922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935a929-770b-491d-b733-947f8e59c257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:16.010692 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935a929-770b-491d-b733-947f8e59c257 None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=f518137b54ee4e668f41c0f660a54d90) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:16.011681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935a929-770b-491d-b733-947f8e59c257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:16.015182 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935a929-770b-491d-b733-947f8e59c257 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:16.032093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 423/869] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:37:15 2022] GET /identity/v3/role_assignments?user.id=f518137b54ee4e668f41c0f660a54d90&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:16.068958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:16.105900 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf3337-054c-4fe5-88d0-04921c4ce50b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:16.171132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d629e8-0a7d-4005-939f-3e6ca910e2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:16.172151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d629e8-0a7d-4005-939f-3e6ca910e2cf None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:16.172633 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d629e8-0a7d-4005-939f-3e6ca910e2cf None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:16.173060 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d629e8-0a7d-4005-939f-3e6ca910e2cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:16.174537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d629e8-0a7d-4005-939f-3e6ca910e2cf None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=9566befd16fc4b0c84d2bed34c4a5d28) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:16.175032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d629e8-0a7d-4005-939f-3e6ca910e2cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:16.177653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d629e8-0a7d-4005-939f-3e6ca910e2cf None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:16.189838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 447/870] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:37:15 2022] GET /identity/v3/role_assignments?user.id=9566befd16fc4b0c84d2bed34c4a5d28&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:17.976212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1099b11-a1ea-42f4-b5fd-ec728ba78279 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:17.977281 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1099b11-a1ea-42f4-b5fd-ec728ba78279 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:17.977784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1099b11-a1ea-42f4-b5fd-ec728ba78279 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:17.979438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 424/871] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:37:17.985379 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d0d5d-c9ad-4282-a8ae-42baeacc9b4e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:17.986328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d0d5d-c9ad-4282-a8ae-42baeacc9b4e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:17.986838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d0d5d-c9ad-4282-a8ae-42baeacc9b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:18.008110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-280d0d5d-c9ad-4282-a8ae-42baeacc9b4e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:18.010240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-280d0d5d-c9ad-4282-a8ae-42baeacc9b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:18.016852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eaf41-e304-49cc-8350-d4c1d48fa075 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:18.017145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eaf41-e304-49cc-8350-d4c1d48fa075 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:18.017456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eaf41-e304-49cc-8350-d4c1d48fa075 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:18.019210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 425/872] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:18.025715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a9d30-6e98-4053-a7e8-f0f0328ad383 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:18.026001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a9d30-6e98-4053-a7e8-f0f0328ad383 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:18.026282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a9d30-6e98-4053-a7e8-f0f0328ad383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:18.045401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-293a9d30-6e98-4053-a7e8-f0f0328ad383 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:18.046613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-293a9d30-6e98-4053-a7e8-f0f0328ad383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:18.110531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:18.132723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 426/873] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:18.144310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 448/874] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:18.151667 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a9d30-6e98-4053-a7e8-f0f0328ad383 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:18.167938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d0d5d-c9ad-4282-a8ae-42baeacc9b4e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:18.251883 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:18.267258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a9d30-6e98-4053-a7e8-f0f0328ad383 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:18.280356 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d0d5d-c9ad-4282-a8ae-42baeacc9b4e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:18.305718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958fcd1-1e7f-44b4-885f-eddaa06d2b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:18.306397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958fcd1-1e7f-44b4-885f-eddaa06d2b17 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:18.306678 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958fcd1-1e7f-44b4-885f-eddaa06d2b17 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:18.306954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958fcd1-1e7f-44b4-885f-eddaa06d2b17 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:18.307705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958fcd1-1e7f-44b4-885f-eddaa06d2b17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:18.309349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958fcd1-1e7f-44b4-885f-eddaa06d2b17 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:18.331183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176004f-4888-4e5c-8ab0-e4ea8fc957d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:18.331998 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176004f-4888-4e5c-8ab0-e4ea8fc957d0 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:18.332357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176004f-4888-4e5c-8ab0-e4ea8fc957d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:18.332733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176004f-4888-4e5c-8ab0-e4ea8fc957d0 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:18.333549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176004f-4888-4e5c-8ab0-e4ea8fc957d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:18.335079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176004f-4888-4e5c-8ab0-e4ea8fc957d0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:18.412849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 427/875] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:37:18 2022] POST /identity/v3/services => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:37:18.448451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 449/876] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:37:18 2022] POST /identity/v3/services => generated 269 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:37:18.795474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609644d-39c4-499d-bc74-30b42c5f0514 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:18.795870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609644d-39c4-499d-bc74-30b42c5f0514 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:18.796159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609644d-39c4-499d-bc74-30b42c5f0514 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:18.798548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 428/877] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:18.805316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81716a73-04c2-4aa2-b622-2a4e718899b5 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:18.805628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81716a73-04c2-4aa2-b622-2a4e718899b5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:18.805877 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81716a73-04c2-4aa2-b622-2a4e718899b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:18.826791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-81716a73-04c2-4aa2-b622-2a4e718899b5 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:18.828192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-81716a73-04c2-4aa2-b622-2a4e718899b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:18.938486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 450/878] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:18.972882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609644d-39c4-499d-bc74-30b42c5f0514 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:19.053734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:19.156168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609644d-39c4-499d-bc74-30b42c5f0514 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:19.227164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90e65b-f427-485c-a7a0-f6303396b6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:19.228739 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e65b-f427-485c-a7a0-f6303396b6a4 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:19.229300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e65b-f427-485c-a7a0-f6303396b6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:19.229790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e65b-f427-485c-a7a0-f6303396b6a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:19.252103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90e65b-f427-485c-a7a0-f6303396b6a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-ba90e65b-f427-485c-a7a0-f6303396b6a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:19.269637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:19.270710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:19.271561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:19.271561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:19.271561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:19.271561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:19.271561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:19.271561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:19.271561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:19.271561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:19.271561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:19.271561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:19.271561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 17:37:19.271561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:19.272807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 429/879] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jul 20 17:37:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:19.281996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81716a73-04c2-4aa2-b622-2a4e718899b5 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:19.380090 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:19.448406 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81716a73-04c2-4aa2-b622-2a4e718899b5 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:19.491247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35efaf0-1884-4da4-876d-a5fac325cf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:19.491483 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b08c5-1248-464e-ae92-f8830be5d40f None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:19.491810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b08c5-1248-464e-ae92-f8830be5d40f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:19.491914 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35efaf0-1884-4da4-876d-a5fac325cf73 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:19.492176 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35efaf0-1884-4da4-876d-a5fac325cf73 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:19.492339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b08c5-1248-464e-ae92-f8830be5d40f None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:19.492433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35efaf0-1884-4da4-876d-a5fac325cf73 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:19.493233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35efaf0-1884-4da4-876d-a5fac325cf73 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:19.493546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35efaf0-1884-4da4-876d-a5fac325cf73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:19.494963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 430/880] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:19.495134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35efaf0-1884-4da4-876d-a5fac325cf73 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:19.505228 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 451/881] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 20 17:37:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:19.507106 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cf673-5756-47ac-981f-1806b557b9ea None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:19.507691 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cf673-5756-47ac-981f-1806b557b9ea None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:19.508195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cf673-5756-47ac-981f-1806b557b9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:19.510760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35efaf0-1884-4da4-876d-a5fac325cf73 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:19.538336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-ed7cf673-5756-47ac-981f-1806b557b9ea None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:19.540410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ed7cf673-5756-47ac-981f-1806b557b9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:19.642077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35efaf0-1884-4da4-876d-a5fac325cf73 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:19.676772 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 431/882] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:19.693040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:19.703964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cf673-5756-47ac-981f-1806b557b9ea None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:19.704502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44048d-d3ea-427f-ab03-80d77124e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:19.705751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44048d-d3ea-427f-ab03-80d77124e757 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:19.706144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44048d-d3ea-427f-ab03-80d77124e757 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:19.706633 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44048d-d3ea-427f-ab03-80d77124e757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:19.727610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44048d-d3ea-427f-ab03-80d77124e757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:19.730322 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44048d-d3ea-427f-ab03-80d77124e757 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:19.761185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-af44048d-d3ea-427f-ab03-80d77124e757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:19.769030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:19.780382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:19.781314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:19.781314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:19.781314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:19.781314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:19.781314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 452/883] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:19.782123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44048d-d3ea-427f-ab03-80d77124e757 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:19.854443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cf673-5756-47ac-981f-1806b557b9ea None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:19.910572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29402bc-c679-4e97-944b-77fee6fd8985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:19.911052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44048d-d3ea-427f-ab03-80d77124e757 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:19.911692 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29402bc-c679-4e97-944b-77fee6fd8985 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:19.912041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29402bc-c679-4e97-944b-77fee6fd8985 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:19.912375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29402bc-c679-4e97-944b-77fee6fd8985 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:19.913139 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29402bc-c679-4e97-944b-77fee6fd8985 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:19.914707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29402bc-c679-4e97-944b-77fee6fd8985 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-b29402bc-c679-4e97-944b-77fee6fd8985 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:19.929107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:19.931059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:19.933290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 432/884] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 20 17:37:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:19.940768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29402bc-c679-4e97-944b-77fee6fd8985 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:19.985787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4528d2e-3d15-4fe6-b50e-79f32a1be267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:19.986878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4528d2e-3d15-4fe6-b50e-79f32a1be267 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:19.987414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4528d2e-3d15-4fe6-b50e-79f32a1be267 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:19.987989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4528d2e-3d15-4fe6-b50e-79f32a1be267 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:19.988982 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4528d2e-3d15-4fe6-b50e-79f32a1be267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:19.989898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4528d2e-3d15-4fe6-b50e-79f32a1be267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:19.993218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4528d2e-3d15-4fe6-b50e-79f32a1be267 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:20.019059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 453/885] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:20.027578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4528d2e-3d15-4fe6-b50e-79f32a1be267 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:20.063073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:20.134077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29402bc-c679-4e97-944b-77fee6fd8985 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:20.137652 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:20.141765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4528d2e-3d15-4fe6-b50e-79f32a1be267 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:20.181640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d933-19d2-4f09-9565-a35ef3abac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:20.182789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d933-19d2-4f09-9565-a35ef3abac92 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:20.183252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d933-19d2-4f09-9565-a35ef3abac92 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:20.183722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d933-19d2-4f09-9565-a35ef3abac92 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:20.192409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a854ad-c1c3-46f7-a482-08c376dcd688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:20.193461 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a854ad-c1c3-46f7-a482-08c376dcd688 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:20.193781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95d933-19d2-4f09-9565-a35ef3abac92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:20.194163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a854ad-c1c3-46f7-a482-08c376dcd688 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:20.194872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a854ad-c1c3-46f7-a482-08c376dcd688 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:20.195613 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95d933-19d2-4f09-9565-a35ef3abac92 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:20.196651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a854ad-c1c3-46f7-a482-08c376dcd688 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:20.197123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a854ad-c1c3-46f7-a482-08c376dcd688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:20.204108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a854ad-c1c3-46f7-a482-08c376dcd688 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:20.212190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 433/886] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 20 17:37:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-3c95d933-19d2-4f09-9565-a35ef3abac92 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:20.213612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:20.214707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:20.216504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:20.216504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:20.216504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:20.216504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:20.216504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:20.216504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:20.216504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:20.216504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:20.216504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 17:37:20.216504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:20.217575 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a854ad-c1c3-46f7-a482-08c376dcd688 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:20.221434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 454/887] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 20 17:37:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:20.223044 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d933-19d2-4f09-9565-a35ef3abac92 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:20.342438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:20.351925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d933-19d2-4f09-9565-a35ef3abac92 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:20.356821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a854ad-c1c3-46f7-a482-08c376dcd688 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:20.399508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336f4e0-ee6a-4dc6-8993-dad14fe7bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:20.400711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336f4e0-ee6a-4dc6-8993-dad14fe7bd91 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:20.401225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336f4e0-ee6a-4dc6-8993-dad14fe7bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:20.401705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336f4e0-ee6a-4dc6-8993-dad14fe7bd91 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:20.402895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336f4e0-ee6a-4dc6-8993-dad14fe7bd91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:20.403488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336f4e0-ee6a-4dc6-8993-dad14fe7bd91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:20.405510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336f4e0-ee6a-4dc6-8993-dad14fe7bd91 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:20.427086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06006a0f-4bf3-4f4e-9807-7a8d80d80ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:20.428662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06006a0f-4bf3-4f4e-9807-7a8d80d80ec4 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:20.429374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06006a0f-4bf3-4f4e-9807-7a8d80d80ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:20.430139 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06006a0f-4bf3-4f4e-9807-7a8d80d80ec4 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:20.431390 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06006a0f-4bf3-4f4e-9807-7a8d80d80ec4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:20.431560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 455/888] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jul 20 17:37:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:20.432305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06006a0f-4bf3-4f4e-9807-7a8d80d80ec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:20.432892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336f4e0-ee6a-4dc6-8993-dad14fe7bd91 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:20.435351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06006a0f-4bf3-4f4e-9807-7a8d80d80ec4 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:20.443173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 434/889] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 20 17:37:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:20.607610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336f4e0-ee6a-4dc6-8993-dad14fe7bd91 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:20.611674 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a08ca-bcb0-4915-a5c1-30d909e5ce42 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:20.612322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a08ca-bcb0-4915-a5c1-30d909e5ce42 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:20.612860 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a08ca-bcb0-4915-a5c1-30d909e5ce42 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:20.614816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 435/890] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:37:20.621130 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65da4d-bdfe-4d0b-a46c-bee862d6bc4d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:20.621820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65da4d-bdfe-4d0b-a46c-bee862d6bc4d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:20.622815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65da4d-bdfe-4d0b-a46c-bee862d6bc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:20.642589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-3b65da4d-bdfe-4d0b-a46c-bee862d6bc4d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:20.643804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3b65da4d-bdfe-4d0b-a46c-bee862d6bc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:20.649991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af2b2c-eae9-4962-a7f9-32589ad7f7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:20.650647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af2b2c-eae9-4962-a7f9-32589ad7f7a1 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:20.650932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af2b2c-eae9-4962-a7f9-32589ad7f7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:20.651211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af2b2c-eae9-4962-a7f9-32589ad7f7a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:20.680577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:20.688275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:20.753093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af2b2c-eae9-4962-a7f9-32589ad7f7a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:20.753441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 436/891] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:20.757485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af2b2c-eae9-4962-a7f9-32589ad7f7a1 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:20.777236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65da4d-bdfe-4d0b-a46c-bee862d6bc4d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:20.900417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 456/892] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:37:20 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:37:20.908582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af2b2c-eae9-4962-a7f9-32589ad7f7a1 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:20.916334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65da4d-bdfe-4d0b-a46c-bee862d6bc4d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:20.957160 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca44c2-48e2-4d42-9885-f7b169b47838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:20.957886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca44c2-48e2-4d42-9885-f7b169b47838 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:20.958188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca44c2-48e2-4d42-9885-f7b169b47838 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:20.958433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca44c2-48e2-4d42-9885-f7b169b47838 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:20.959096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca44c2-48e2-4d42-9885-f7b169b47838 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:20.960500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca44c2-48e2-4d42-9885-f7b169b47838 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-6aca44c2-48e2-4d42-9885-f7b169b47838 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:20.978108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:20.979125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 17:37:20.979964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:20.987815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 437/893] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Jul 20 17:37:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:20.991551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca44c2-48e2-4d42-9885-f7b169b47838 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:21.001059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:21.024635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:21.063938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af2b2c-eae9-4962-a7f9-32589ad7f7a1 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:21.109325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b154e-1ac9-45a4-bc56-b217e0aca6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:21.110398 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b154e-1ac9-45a4-bc56-b217e0aca6ad None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:21.110883 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b154e-1ac9-45a4-bc56-b217e0aca6ad None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:21.111176 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b154e-1ac9-45a4-bc56-b217e0aca6ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:21.127359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b154e-1ac9-45a4-bc56-b217e0aca6ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:21.128991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b154e-1ac9-45a4-bc56-b217e0aca6ad None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:21.134343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca44c2-48e2-4d42-9885-f7b169b47838 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-644b154e-1ac9-45a4-bc56-b217e0aca6ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:21.151909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:21.154465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:21.155538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:21.155538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:21.155538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:21.155538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:21.155538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 457/894] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:21.155538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d45302-8f56-4ec1-9c52-d38a90613fb8 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:21.155538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d45302-8f56-4ec1-9c52-d38a90613fb8 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:21.155538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d45302-8f56-4ec1-9c52-d38a90613fb8 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:21.156729 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 458/895] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:21.159391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d45302-8f56-4ec1-9c52-d38a90613fb8 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:21.181602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a37022-9f8d-4889-95d1-2aaf15b2d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:21.182287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a37022-9f8d-4889-95d1-2aaf15b2d23c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:21.182560 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a37022-9f8d-4889-95d1-2aaf15b2d23c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:21.182841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a37022-9f8d-4889-95d1-2aaf15b2d23c None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:21.183557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a37022-9f8d-4889-95d1-2aaf15b2d23c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:21.183894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a37022-9f8d-4889-95d1-2aaf15b2d23c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:21.186122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a37022-9f8d-4889-95d1-2aaf15b2d23c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:21.191551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 438/896] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 20 17:37:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:21.192873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917aeff6-0f2d-45c6-8219-d26cf2c3ac57 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:21.193159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917aeff6-0f2d-45c6-8219-d26cf2c3ac57 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:21.193437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917aeff6-0f2d-45c6-8219-d26cf2c3ac57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:21.212101 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-917aeff6-0f2d-45c6-8219-d26cf2c3ac57 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:21.213279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-917aeff6-0f2d-45c6-8219-d26cf2c3ac57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:21.288212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d45302-8f56-4ec1-9c52-d38a90613fb8 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:21.292237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:21.304513 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 439/897] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:21.304513 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917aeff6-0f2d-45c6-8219-d26cf2c3ac57 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:21.318530 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:21.341851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f643d-84af-4072-80f3-e7dfb07d2de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:21.342599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f643d-84af-4072-80f3-e7dfb07d2de1 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:21.343132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f643d-84af-4072-80f3-e7dfb07d2de1 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:21.343132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f643d-84af-4072-80f3-e7dfb07d2de1 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:21.343861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f643d-84af-4072-80f3-e7dfb07d2de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:21.344167 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f643d-84af-4072-80f3-e7dfb07d2de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:21.345589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f643d-84af-4072-80f3-e7dfb07d2de1 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:21.358832 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 459/898] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:21.364106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f643d-84af-4072-80f3-e7dfb07d2de1 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:21.438542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917aeff6-0f2d-45c6-8219-d26cf2c3ac57 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:21.479699 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e12e9-6609-4fca-ae88-a64a934644a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:21.480288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e12e9-6609-4fca-ae88-a64a934644a5 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:21.480602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e12e9-6609-4fca-ae88-a64a934644a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:21.480881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e12e9-6609-4fca-ae88-a64a934644a5 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:21.481743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e12e9-6609-4fca-ae88-a64a934644a5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:21.482185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e12e9-6609-4fca-ae88-a64a934644a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:21.483606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e12e9-6609-4fca-ae88-a64a934644a5 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:21.496398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 440/899] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 20 17:37:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:21.496398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e12e9-6609-4fca-ae88-a64a934644a5 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:21.511149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f643d-84af-4072-80f3-e7dfb07d2de1 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:21.558893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7d41c-776d-4547-addd-840879816a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:21.560268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d41c-776d-4547-addd-840879816a22 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:21.560574 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d41c-776d-4547-addd-840879816a22 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:21.560855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d41c-776d-4547-addd-840879816a22 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:21.561856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7d41c-776d-4547-addd-840879816a22 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:21.563217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7d41c-776d-4547-addd-840879816a22 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-46b7d41c-776d-4547-addd-840879816a22 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:21.577012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:21.578291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:21.579471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 460/900] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:37:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:21.580434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7d41c-776d-4547-addd-840879816a22 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:21.612100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:21.615772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:21.641851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e12e9-6609-4fca-ae88-a64a934644a5 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:21.685458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753a7db-eeb9-4f9c-9899-c1b19a3b52c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:21.686306 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a7db-eeb9-4f9c-9899-c1b19a3b52c6 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:21.686589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a7db-eeb9-4f9c-9899-c1b19a3b52c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:21.686868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a7db-eeb9-4f9c-9899-c1b19a3b52c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:21.695477 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753a7db-eeb9-4f9c-9899-c1b19a3b52c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:21.696989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753a7db-eeb9-4f9c-9899-c1b19a3b52c6 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:21.710924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7d41c-776d-4547-addd-840879816a22 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-2753a7db-eeb9-4f9c-9899-c1b19a3b52c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:21.714522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:21.715440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:21.717603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:21.717603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:21.717603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:21.717603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:21.717603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:21.717603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:21.717603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:21.717603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:21.717603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 441/901] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:21.718377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753a7db-eeb9-4f9c-9899-c1b19a3b52c6 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:21.756074 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54c8f8-789d-41dd-bcdd-79a9d6d83ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:21.756775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54c8f8-789d-41dd-bcdd-79a9d6d83ce0 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:21.757063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54c8f8-789d-41dd-bcdd-79a9d6d83ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:21.757343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54c8f8-789d-41dd-bcdd-79a9d6d83ce0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:21.758160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54c8f8-789d-41dd-bcdd-79a9d6d83ce0 None admin] RBAC: Adding query filter params (interface=public, service_id=f28cb303f0da4938a5de055712c788ba, region_id=RegionOne) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:21.758481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54c8f8-789d-41dd-bcdd-79a9d6d83ce0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:21.759865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54c8f8-789d-41dd-bcdd-79a9d6d83ce0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:21.765863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 461/902] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 20 17:37:21 2022] GET /identity/v3/endpoints?service_id=f28cb303f0da4938a5de055712c788ba&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:21.766512 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54c8f8-789d-41dd-bcdd-79a9d6d83ce0 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:21.837802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753a7db-eeb9-4f9c-9899-c1b19a3b52c6 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:21.876947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:21.882884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c1e4c-f692-428e-a4f9-3a73b501e7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:21.887668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c1e4c-f692-428e-a4f9-3a73b501e7fc None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:21.887668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c1e4c-f692-428e-a4f9-3a73b501e7fc None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:21.887668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c1e4c-f692-428e-a4f9-3a73b501e7fc None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:21.887668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c1e4c-f692-428e-a4f9-3a73b501e7fc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:21.887668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c1e4c-f692-428e-a4f9-3a73b501e7fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:21.887668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c1e4c-f692-428e-a4f9-3a73b501e7fc None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:21.892359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 442/903] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:37:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:21.893425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c1e4c-f692-428e-a4f9-3a73b501e7fc None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:21.893603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54c8f8-789d-41dd-bcdd-79a9d6d83ce0 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:21.909903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:21.938977 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdae87-7fe8-4c68-938e-5604799ddc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:21.939680 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdae87-7fe8-4c68-938e-5604799ddc98 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:21.939964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdae87-7fe8-4c68-938e-5604799ddc98 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:21.940244 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdae87-7fe8-4c68-938e-5604799ddc98 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:21.941074 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdae87-7fe8-4c68-938e-5604799ddc98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:21.941503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdae87-7fe8-4c68-938e-5604799ddc98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:21.942819 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdae87-7fe8-4c68-938e-5604799ddc98 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:21.965390 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 462/904] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:21.965390 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdae87-7fe8-4c68-938e-5604799ddc98 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:22.030229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c1e4c-f692-428e-a4f9-3a73b501e7fc None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:22.077480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28760e81-fef1-416b-ac88-6c9c7e09c275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:22.079060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28760e81-fef1-416b-ac88-6c9c7e09c275 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:22.079760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28760e81-fef1-416b-ac88-6c9c7e09c275 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:22.080464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28760e81-fef1-416b-ac88-6c9c7e09c275 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:22.081929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28760e81-fef1-416b-ac88-6c9c7e09c275 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:22.084179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28760e81-fef1-416b-ac88-6c9c7e09c275 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:22.095676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdae87-7fe8-4c68-938e-5604799ddc98 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:22.104986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 443/905] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 20 17:37:21 2022] GET /identity/v3/services => generated 1268 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:37:22.105763 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28760e81-fef1-416b-ac88-6c9c7e09c275 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:22.183271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901585e-a1e5-4f67-b98a-9f572d4f8a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:22.185465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901585e-a1e5-4f67-b98a-9f572d4f8a9c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:22.186899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901585e-a1e5-4f67-b98a-9f572d4f8a9c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:22.188017 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901585e-a1e5-4f67-b98a-9f572d4f8a9c None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:22.190787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901585e-a1e5-4f67-b98a-9f572d4f8a9c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:22.191982 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901585e-a1e5-4f67-b98a-9f572d4f8a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:22.196568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901585e-a1e5-4f67-b98a-9f572d4f8a9c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:22.200798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:22.215883 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 463/906] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:37:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:22.220010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901585e-a1e5-4f67-b98a-9f572d4f8a9c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:22.253177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28760e81-fef1-416b-ac88-6c9c7e09c275 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:22.265069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:22.305345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01035db0-eb9f-4c3f-b953-e97595a9b05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:22.305936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01035db0-eb9f-4c3f-b953-e97595a9b05f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:22.306217 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01035db0-eb9f-4c3f-b953-e97595a9b05f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:22.306493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01035db0-eb9f-4c3f-b953-e97595a9b05f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:22.307331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01035db0-eb9f-4c3f-b953-e97595a9b05f None admin] RBAC: Adding query filter params (role.id=8066522d348444c39a987e22e5767068, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=f518137b54ee4e668f41c0f660a54d90) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:22.307643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01035db0-eb9f-4c3f-b953-e97595a9b05f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:22.309136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01035db0-eb9f-4c3f-b953-e97595a9b05f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:22.316675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 444/907] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:37:22 2022] GET /identity/v3/role_assignments?user.id=f518137b54ee4e668f41c0f660a54d90&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=8066522d348444c39a987e22e5767068 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:22.396288 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901585e-a1e5-4f67-b98a-9f572d4f8a9c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:22.445651 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbda51e-6d5e-4094-9c40-bc9e3aabc0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:22.446690 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbda51e-6d5e-4094-9c40-bc9e3aabc0cd None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:22.447171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbda51e-6d5e-4094-9c40-bc9e3aabc0cd None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:22.447671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbda51e-6d5e-4094-9c40-bc9e3aabc0cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:22.449189 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbda51e-6d5e-4094-9c40-bc9e3aabc0cd None admin] RBAC: Adding query filter params (interface=public, service_id=32be77bfebc845bbb6c9c530353d6eef, region_id=RegionOne) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:22.449765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbda51e-6d5e-4094-9c40-bc9e3aabc0cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:22.452671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbda51e-6d5e-4094-9c40-bc9e3aabc0cd None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:22.463439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 464/908] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 20 17:37:22 2022] GET /identity/v3/endpoints?service_id=32be77bfebc845bbb6c9c530353d6eef&interface=public®ion_id=RegionOne => generated 194 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:22.470517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01035db0-eb9f-4c3f-b953-e97595a9b05f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:22.590422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01035db0-eb9f-4c3f-b953-e97595a9b05f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:22.630646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d34722-ef35-4508-8673-0a5ffa54efdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:22.631806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d34722-ef35-4508-8673-0a5ffa54efdd None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:22.632292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d34722-ef35-4508-8673-0a5ffa54efdd None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:22.632782 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d34722-ef35-4508-8673-0a5ffa54efdd None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:22.633952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d34722-ef35-4508-8673-0a5ffa54efdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:22.636465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d34722-ef35-4508-8673-0a5ffa54efdd None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:22.638847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:22.649874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 445/909] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 20 17:37:22 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:37:22.697402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e801fe-fd78-46df-a2bd-91712d646208 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:22.697750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e801fe-fd78-46df-a2bd-91712d646208 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:22.697968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e801fe-fd78-46df-a2bd-91712d646208 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:22.699730 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 465/910] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:22.705929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8bf2f-697b-4767-b5c9-8869ab5960b3 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:22.706242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8bf2f-697b-4767-b5c9-8869ab5960b3 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:22.706500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8bf2f-697b-4767-b5c9-8869ab5960b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:22.728426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-b8d8bf2f-697b-4767-b5c9-8869ab5960b3 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:22.729708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b8d8bf2f-697b-4767-b5c9-8869ab5960b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:22.830140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 446/911] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:22.853260 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e801fe-fd78-46df-a2bd-91712d646208 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:22.966609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:22.992601 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e801fe-fd78-46df-a2bd-91712d646208 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:23.034519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f73c51-ef91-4c4c-990b-3306b7f0417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:23.035303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73c51-ef91-4c4c-990b-3306b7f0417d None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:23.036591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73c51-ef91-4c4c-990b-3306b7f0417d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:23.036877 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73c51-ef91-4c4c-990b-3306b7f0417d None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:23.037670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f73c51-ef91-4c4c-990b-3306b7f0417d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:23.039258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f73c51-ef91-4c4c-990b-3306b7f0417d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:23.123389 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 466/912] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:37:22 2022] POST /identity/v3/services => generated 241 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:37:24.572401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e4e81-8548-4062-8c58-7bd659be0e34 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:24.572957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e4e81-8548-4062-8c58-7bd659be0e34 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:24.572957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e4e81-8548-4062-8c58-7bd659be0e34 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:24.574709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 447/913] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:24.581552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0f86f-64a5-43fb-88de-5d1bdefcbe56 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:24.582451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0f86f-64a5-43fb-88de-5d1bdefcbe56 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:24.582928 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0f86f-64a5-43fb-88de-5d1bdefcbe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:24.601813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-6ff0f86f-64a5-43fb-88de-5d1bdefcbe56 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:24.603327 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6ff0f86f-64a5-43fb-88de-5d1bdefcbe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:24.648029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6797c-81c4-4071-bfc3-ac2ed485264a None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:24.648715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6797c-81c4-4071-bfc3-ac2ed485264a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:24.649256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6797c-81c4-4071-bfc3-ac2ed485264a None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:24.651083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 448/914] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:37:24.656820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753c64f-9bb7-4616-a7f4-711c601a9fc2 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:24.657366 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753c64f-9bb7-4616-a7f4-711c601a9fc2 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:24.657867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753c64f-9bb7-4616-a7f4-711c601a9fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:24.677232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-0753c64f-9bb7-4616-a7f4-711c601a9fc2 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:24.679281 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0753c64f-9bb7-4616-a7f4-711c601a9fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:24.682868 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 467/915] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:24.707480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0f86f-64a5-43fb-88de-5d1bdefcbe56 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:24.759992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 449/916] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:24.784431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753c64f-9bb7-4616-a7f4-711c601a9fc2 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:24.788081 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:24.828402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0f86f-64a5-43fb-88de-5d1bdefcbe56 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:24.862476 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:24.871241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a4a16-5b7a-4c4c-bf44-6b9052fd95b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:24.874020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a4a16-5b7a-4c4c-bf44-6b9052fd95b0 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:24.874542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a4a16-5b7a-4c4c-bf44-6b9052fd95b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:24.875061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a4a16-5b7a-4c4c-bf44-6b9052fd95b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:24.890987 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a4a16-5b7a-4c4c-bf44-6b9052fd95b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-e88a4a16-5b7a-4c4c-bf44-6b9052fd95b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:24.901311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:24.902452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:24.903316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 468/917] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jul 20 17:37:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:24.904129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ef792-d0d4-451c-81c6-7b71557a9c79 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:24.904129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ef792-d0d4-451c-81c6-7b71557a9c79 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:24.905360 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ef792-d0d4-451c-81c6-7b71557a9c79 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:24.905881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 469/918] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:24.910571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ef792-d0d4-451c-81c6-7b71557a9c79 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:24.924510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753c64f-9bb7-4616-a7f4-711c601a9fc2 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:24.966974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58399596-c7a3-40bc-97fd-b2a2c9a56653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:24.968325 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58399596-c7a3-40bc-97fd-b2a2c9a56653 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:24.968913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58399596-c7a3-40bc-97fd-b2a2c9a56653 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:24.969191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58399596-c7a3-40bc-97fd-b2a2c9a56653 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:24.970101 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58399596-c7a3-40bc-97fd-b2a2c9a56653 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:24.972163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58399596-c7a3-40bc-97fd-b2a2c9a56653 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-58399596-c7a3-40bc-97fd-b2a2c9a56653 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:24.986158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:24.987155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:24.988728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 450/919] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Jul 20 17:37:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:24.989586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a7de-eba6-4690-92ed-e6cfb7f5b9c3 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:24.989586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a7de-eba6-4690-92ed-e6cfb7f5b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:24.989586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a7de-eba6-4690-92ed-e6cfb7f5b9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.008171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c226a7de-eba6-4690-92ed-e6cfb7f5b9c3 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:25.009389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c226a7de-eba6-4690-92ed-e6cfb7f5b9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:25.018491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ef792-d0d4-451c-81c6-7b71557a9c79 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:25.046203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:25.055453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eac4e-865d-4a02-b20a-9c2a17a13a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:25.056147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eac4e-865d-4a02-b20a-9c2a17a13a48 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:25.065785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eac4e-865d-4a02-b20a-9c2a17a13a48 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:25.065785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eac4e-865d-4a02-b20a-9c2a17a13a48 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.065785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eac4e-865d-4a02-b20a-9c2a17a13a48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:25.065785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eac4e-865d-4a02-b20a-9c2a17a13a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:25.065785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eac4e-865d-4a02-b20a-9c2a17a13a48 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:25.069738 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 470/920] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 20 17:37:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:25.070821 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eac4e-865d-4a02-b20a-9c2a17a13a48 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:25.090071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 451/921] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:25.091677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226a7de-eba6-4690-92ed-e6cfb7f5b9c3 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:25.155945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:25.183098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eac4e-865d-4a02-b20a-9c2a17a13a48 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:25.209969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226a7de-eba6-4690-92ed-e6cfb7f5b9c3 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:25.219210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dc59b-501f-4ede-8d65-1d32190e6b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:25.219884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dc59b-501f-4ede-8d65-1d32190e6b7b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:25.220168 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dc59b-501f-4ede-8d65-1d32190e6b7b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:25.220444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dc59b-501f-4ede-8d65-1d32190e6b7b None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.221189 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dc59b-501f-4ede-8d65-1d32190e6b7b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:25.221499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dc59b-501f-4ede-8d65-1d32190e6b7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:25.222883 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dc59b-501f-4ede-8d65-1d32190e6b7b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:25.247983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7c089-fc06-4773-9c15-fe5ba67aba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:25.248422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7c089-fc06-4773-9c15-fe5ba67aba47 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:25.248724 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7c089-fc06-4773-9c15-fe5ba67aba47 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:25.248973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7c089-fc06-4773-9c15-fe5ba67aba47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.259786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7c089-fc06-4773-9c15-fe5ba67aba47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:25.261275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7c089-fc06-4773-9c15-fe5ba67aba47 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-71f7c089-fc06-4773-9c15-fe5ba67aba47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:25.280117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:25.281340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:25.287455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:25.287455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:25.287455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:25.287455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:25.287455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 452/922] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:25.287455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7c089-fc06-4773-9c15-fe5ba67aba47 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:25.293515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 471/923] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 20 17:37:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:25.293515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dc59b-501f-4ede-8d65-1d32190e6b7b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:25.351505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:25.410389 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dc59b-501f-4ede-8d65-1d32190e6b7b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:25.417142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7c089-fc06-4773-9c15-fe5ba67aba47 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:25.420326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:25.453026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22db73-f476-41df-bc6b-aaca3bf3ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:25.453734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22db73-f476-41df-bc6b-aaca3bf3ad1c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:25.454021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22db73-f476-41df-bc6b-aaca3bf3ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:25.454299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22db73-f476-41df-bc6b-aaca3bf3ad1c None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.455032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22db73-f476-41df-bc6b-aaca3bf3ad1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:25.455348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22db73-f476-41df-bc6b-aaca3bf3ad1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:25.456788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22db73-f476-41df-bc6b-aaca3bf3ad1c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:25.461716 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05681cad-c4f7-43d2-8814-f90cbb12808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:25.462515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05681cad-c4f7-43d2-8814-f90cbb12808a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:25.462795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05681cad-c4f7-43d2-8814-f90cbb12808a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:25.463067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05681cad-c4f7-43d2-8814-f90cbb12808a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.464244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05681cad-c4f7-43d2-8814-f90cbb12808a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:25.466155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05681cad-c4f7-43d2-8814-f90cbb12808a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:25.469794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 472/924] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:25.470647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22db73-f476-41df-bc6b-aaca3bf3ad1c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-05681cad-c4f7-43d2-8814-f90cbb12808a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:25.478942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:25.479943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:25.482110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 453/925] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:37:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:25.482962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39cfb5-468e-45c6-b86b-a0fa7d100ca7 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:25.482962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39cfb5-468e-45c6-b86b-a0fa7d100ca7 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:25.482962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39cfb5-468e-45c6-b86b-a0fa7d100ca7 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.484042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 454/926] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:25.484778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39cfb5-468e-45c6-b86b-a0fa7d100ca7 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:25.573246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22db73-f476-41df-bc6b-aaca3bf3ad1c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:25.587426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:25.609230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a0043-7c26-4a24-a05e-a93eb03c49ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:25.609947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a0043-7c26-4a24-a05e-a93eb03c49ed None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:25.610261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a0043-7c26-4a24-a05e-a93eb03c49ed None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:25.610535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a0043-7c26-4a24-a05e-a93eb03c49ed None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.611237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a0043-7c26-4a24-a05e-a93eb03c49ed None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:25.611544 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a0043-7c26-4a24-a05e-a93eb03c49ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:25.612931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a0043-7c26-4a24-a05e-a93eb03c49ed None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:25.617827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 473/927] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 20 17:37:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:25.619052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8fa6-cbe9-4cb2-a8c4-b516bbf26932 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:25.619340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8fa6-cbe9-4cb2-a8c4-b516bbf26932 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:25.619615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8fa6-cbe9-4cb2-a8c4-b516bbf26932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.637515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39cfb5-468e-45c6-b86b-a0fa7d100ca7 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:25.638514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-58ae8fa6-cbe9-4cb2-a8c4-b516bbf26932 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:25.639689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-58ae8fa6-cbe9-4cb2-a8c4-b516bbf26932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:25.675958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16c7e1-65ff-48d6-946f-4edc642a8bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:25.676723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16c7e1-65ff-48d6-946f-4edc642a8bca None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:25.677004 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16c7e1-65ff-48d6-946f-4edc642a8bca None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:25.677393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16c7e1-65ff-48d6-946f-4edc642a8bca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.686720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16c7e1-65ff-48d6-946f-4edc642a8bca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:25.688175 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16c7e1-65ff-48d6-946f-4edc642a8bca None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-7f16c7e1-65ff-48d6-946f-4edc642a8bca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:25.703733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:25.704796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:25.705740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:25.705740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:25.705740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:25.705740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:25.705740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:25.705740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:25.705740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:25.705740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:25.705740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 17:37:25.705740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:25.705740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 455/928] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 20 17:37:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:25.705740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16c7e1-65ff-48d6-946f-4edc642a8bca None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:25.719282 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 474/929] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:25.720125 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8fa6-cbe9-4cb2-a8c4-b516bbf26932 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:25.737022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:25.811786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16c7e1-65ff-48d6-946f-4edc642a8bca None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:25.824661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8fa6-cbe9-4cb2-a8c4-b516bbf26932 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:25.832913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:25.847432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b33af0-eac7-41ce-9efa-16c8eec07a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:25.848186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b33af0-eac7-41ce-9efa-16c8eec07a5e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:25.848568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b33af0-eac7-41ce-9efa-16c8eec07a5e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:25.848845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b33af0-eac7-41ce-9efa-16c8eec07a5e None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.849548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b33af0-eac7-41ce-9efa-16c8eec07a5e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:25.849852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b33af0-eac7-41ce-9efa-16c8eec07a5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:25.851220 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b33af0-eac7-41ce-9efa-16c8eec07a5e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:25.856614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 456/930] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:37:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:25.857799 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b33af0-eac7-41ce-9efa-16c8eec07a5e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:25.865973 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90617d4f-9fb9-4fac-a5b9-f2cf42630701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:25.866643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90617d4f-9fb9-4fac-a5b9-f2cf42630701 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:25.866927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90617d4f-9fb9-4fac-a5b9-f2cf42630701 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:25.867196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90617d4f-9fb9-4fac-a5b9-f2cf42630701 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.867939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90617d4f-9fb9-4fac-a5b9-f2cf42630701 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:25.869333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90617d4f-9fb9-4fac-a5b9-f2cf42630701 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:25.948071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:25.956621 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b33af0-eac7-41ce-9efa-16c8eec07a5e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:25.990231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da237a-ab13-4b41-8906-bbdc0d77f4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:25.990896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da237a-ab13-4b41-8906-bbdc0d77f4d3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:25.991172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da237a-ab13-4b41-8906-bbdc0d77f4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:25.991446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da237a-ab13-4b41-8906-bbdc0d77f4d3 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:25.992280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da237a-ab13-4b41-8906-bbdc0d77f4d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:25.992616 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da237a-ab13-4b41-8906-bbdc0d77f4d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:25.994085 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da237a-ab13-4b41-8906-bbdc0d77f4d3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:25.995380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 475/931] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 20 17:37:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:37:25.996230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90617d4f-9fb9-4fac-a5b9-f2cf42630701 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:26.019663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 457/932] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jul 20 17:37:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:26.019663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da237a-ab13-4b41-8906-bbdc0d77f4d3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:26.142550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90617d4f-9fb9-4fac-a5b9-f2cf42630701 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:26.145736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da237a-ab13-4b41-8906-bbdc0d77f4d3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:26.188010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552fe44-d15d-48db-a3e4-02c8bc78fa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:26.188864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fe44-d15d-48db-a3e4-02c8bc78fa8a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:26.189145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fe44-d15d-48db-a3e4-02c8bc78fa8a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:26.189423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fe44-d15d-48db-a3e4-02c8bc78fa8a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:26.190117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552fe44-d15d-48db-a3e4-02c8bc78fa8a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:26.190268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b7c69-f515-4d7c-9226-59c1422d146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:26.190791 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b7c69-f515-4d7c-9226-59c1422d146d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:26.191075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b7c69-f515-4d7c-9226-59c1422d146d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:26.191354 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b7c69-f515-4d7c-9226-59c1422d146d None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:26.191499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552fe44-d15d-48db-a3e4-02c8bc78fa8a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:26.192073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b7c69-f515-4d7c-9226-59c1422d146d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:26.192380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b7c69-f515-4d7c-9226-59c1422d146d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:26.193783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b7c69-f515-4d7c-9226-59c1422d146d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:26.208774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 458/933] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Jul 20 17:37:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:26.208774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b7c69-f515-4d7c-9226-59c1422d146d None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-2552fe44-d15d-48db-a3e4-02c8bc78fa8a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:26.209084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:26.210003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:26.210848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 476/934] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 20 17:37:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:26.211656 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552fe44-d15d-48db-a3e4-02c8bc78fa8a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:26.220192 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:26.243480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:26.313361 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b7c69-f515-4d7c-9226-59c1422d146d None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:26.336227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552fe44-d15d-48db-a3e4-02c8bc78fa8a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:26.349374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692443cf-a231-4225-acff-3026b3ce6827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:26.350209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692443cf-a231-4225-acff-3026b3ce6827 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:26.350542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692443cf-a231-4225-acff-3026b3ce6827 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:26.350828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692443cf-a231-4225-acff-3026b3ce6827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:26.363576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692443cf-a231-4225-acff-3026b3ce6827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:26.365231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692443cf-a231-4225-acff-3026b3ce6827 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:26.376304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca6d9e-ee87-467e-a37c-f1643bcb93ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:26.377252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca6d9e-ee87-467e-a37c-f1643bcb93ad None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:26.377637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca6d9e-ee87-467e-a37c-f1643bcb93ad None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:26.378012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca6d9e-ee87-467e-a37c-f1643bcb93ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:26.378867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca6d9e-ee87-467e-a37c-f1643bcb93ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:26.380342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca6d9e-ee87-467e-a37c-f1643bcb93ad None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-692443cf-a231-4225-acff-3026b3ce6827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:26.383387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:26.389651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:26.390774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:26.390774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:26.390774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:26.390774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:26.390774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 459/935] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:26.390774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692443cf-a231-4225-acff-3026b3ce6827 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:26.459900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:26.484510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 477/936] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 20 17:37:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:37:26.484510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca6d9e-ee87-467e-a37c-f1643bcb93ad None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:26.515401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692443cf-a231-4225-acff-3026b3ce6827 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:26.568980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708fd6e-89c8-4d98-a6ce-2726c7983f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:26.569684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708fd6e-89c8-4d98-a6ce-2726c7983f37 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:26.569964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708fd6e-89c8-4d98-a6ce-2726c7983f37 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:26.570473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708fd6e-89c8-4d98-a6ce-2726c7983f37 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:26.571748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708fd6e-89c8-4d98-a6ce-2726c7983f37 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:26.572070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708fd6e-89c8-4d98-a6ce-2726c7983f37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:26.576084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708fd6e-89c8-4d98-a6ce-2726c7983f37 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:26.583610 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 460/937] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 20 17:37:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:26.589743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708fd6e-89c8-4d98-a6ce-2726c7983f37 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:26.602471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:26.629028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca6d9e-ee87-467e-a37c-f1643bcb93ad None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:26.674912 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd8b43-70b2-4e69-9f03-e868f3c780b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:26.676018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd8b43-70b2-4e69-9f03-e868f3c780b8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:26.676610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd8b43-70b2-4e69-9f03-e868f3c780b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:26.677178 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd8b43-70b2-4e69-9f03-e868f3c780b8 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:26.678243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd8b43-70b2-4e69-9f03-e868f3c780b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:26.678827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd8b43-70b2-4e69-9f03-e868f3c780b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:26.681159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd8b43-70b2-4e69-9f03-e868f3c780b8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:26.696804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 478/938] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:26.703370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd8b43-70b2-4e69-9f03-e868f3c780b8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:26.735793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708fd6e-89c8-4d98-a6ce-2726c7983f37 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:26.778577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:26.796314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcc142-cf12-4b13-a063-84ba8a5c84a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:26.798005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcc142-cf12-4b13-a063-84ba8a5c84a3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:26.798437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcc142-cf12-4b13-a063-84ba8a5c84a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:26.798956 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcc142-cf12-4b13-a063-84ba8a5c84a3 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:26.800139 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcc142-cf12-4b13-a063-84ba8a5c84a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:26.800672 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcc142-cf12-4b13-a063-84ba8a5c84a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:26.803572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcc142-cf12-4b13-a063-84ba8a5c84a3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:26.811713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 461/939] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 20 17:37:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:26.818339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcc142-cf12-4b13-a063-84ba8a5c84a3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:26.842581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd8b43-70b2-4e69-9f03-e868f3c780b8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:26.882448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b5030-2afe-455a-a8d8-acaf7375c837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:26.883635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b5030-2afe-455a-a8d8-acaf7375c837 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:26.884160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b5030-2afe-455a-a8d8-acaf7375c837 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:26.884647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b5030-2afe-455a-a8d8-acaf7375c837 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:26.892395 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b5030-2afe-455a-a8d8-acaf7375c837 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:26.894135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b5030-2afe-455a-a8d8-acaf7375c837 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:26.896184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-294b5030-2afe-455a-a8d8-acaf7375c837 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:26.912122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:26.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:26.914170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:26.914170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:26.914170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:26.914170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:26.914170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:26.914170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:26.914170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:26.914170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:26.916735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 479/940] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:26.923947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b5030-2afe-455a-a8d8-acaf7375c837 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:26.934532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcc142-cf12-4b13-a063-84ba8a5c84a3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:26.982594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c793e-d485-4e4d-a462-b0c95860283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:26.983445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c793e-d485-4e4d-a462-b0c95860283a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:26.984242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c793e-d485-4e4d-a462-b0c95860283a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:26.984682 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c793e-d485-4e4d-a462-b0c95860283a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:26.985945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c793e-d485-4e4d-a462-b0c95860283a None admin] RBAC: Adding query filter params (interface=public, service_id=32f2e1bdfce042b29d46bfd1b1991dfd, region_id=RegionOne) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:26.986305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c793e-d485-4e4d-a462-b0c95860283a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:26.988105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c793e-d485-4e4d-a462-b0c95860283a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:26.996553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 462/941] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 20 17:37:26 2022] GET /identity/v3/endpoints?service_id=32f2e1bdfce042b29d46bfd1b1991dfd&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:27.001766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c793e-d485-4e4d-a462-b0c95860283a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:27.060365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b5030-2afe-455a-a8d8-acaf7375c837 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:27.075840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:27.103472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05f0e8-3887-4154-aba1-bbcc1ffcebec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:27.104827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05f0e8-3887-4154-aba1-bbcc1ffcebec None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:27.105505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05f0e8-3887-4154-aba1-bbcc1ffcebec None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:27.105930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05f0e8-3887-4154-aba1-bbcc1ffcebec None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:27.107647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05f0e8-3887-4154-aba1-bbcc1ffcebec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:27.108127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05f0e8-3887-4154-aba1-bbcc1ffcebec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:27.110397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05f0e8-3887-4154-aba1-bbcc1ffcebec None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:27.128062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 480/942] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:27.130207 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c793e-d485-4e4d-a462-b0c95860283a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:27.133845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05f0e8-3887-4154-aba1-bbcc1ffcebec None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:27.178825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71fa37-64a1-4de0-a89a-e20659c83828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:27.179819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71fa37-64a1-4de0-a89a-e20659c83828 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:27.180261 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71fa37-64a1-4de0-a89a-e20659c83828 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:27.180805 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71fa37-64a1-4de0-a89a-e20659c83828 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:27.181676 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71fa37-64a1-4de0-a89a-e20659c83828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:27.184043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71fa37-64a1-4de0-a89a-e20659c83828 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:27.193939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 463/943] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 20 17:37:27 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:37:27.205114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:27.254486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05f0e8-3887-4154-aba1-bbcc1ffcebec None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:27.296675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7cedb-f36d-4720-b7fe-76cee347bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:27.297596 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7cedb-f36d-4720-b7fe-76cee347bd2f None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:27.297872 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7cedb-f36d-4720-b7fe-76cee347bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:27.298148 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7cedb-f36d-4720-b7fe-76cee347bd2f None admin] PATH_INFO: `/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/f518137b54ee4e668f41c0f660a54d90/roles/8066522d348444c39a987e22e5767068` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:27.300436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7cedb-f36d-4720-b7fe-76cee347bd2f None admin] RBAC: Authorizing `identity:create_grant(project_id=5f0f8db3986541468c474b78a9b3740a, user_id=f518137b54ee4e668f41c0f660a54d90, role_id=8066522d348444c39a987e22e5767068)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:27.301936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7cedb-f36d-4720-b7fe-76cee347bd2f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:27.416977 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 481/944] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:37:27 2022] PUT /identity/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/f518137b54ee4e668f41c0f660a54d90/roles/8066522d348444c39a987e22e5767068 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:37:28.123502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29304fe1-3a1e-467b-bcb0-335fa5483099 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:28.124019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29304fe1-3a1e-467b-bcb0-335fa5483099 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:28.124096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29304fe1-3a1e-467b-bcb0-335fa5483099 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:28.125735 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 464/945] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:28.130950 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488179bc-5355-43c8-a15f-f7a59b70c6d7 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:28.131352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488179bc-5355-43c8-a15f-f7a59b70c6d7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:28.131536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488179bc-5355-43c8-a15f-f7a59b70c6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:28.149553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-488179bc-5355-43c8-a15f-f7a59b70c6d7 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:28.150742 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-488179bc-5355-43c8-a15f-f7a59b70c6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:28.225341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 482/946] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:28.247775 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29304fe1-3a1e-467b-bcb0-335fa5483099 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:28.364123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29304fe1-3a1e-467b-bcb0-335fa5483099 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:28.386380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:28.407333 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4a0d5-b6da-482c-9308-1841f9a0333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:28.408454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4a0d5-b6da-482c-9308-1841f9a0333a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:28.408974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4a0d5-b6da-482c-9308-1841f9a0333a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:28.409485 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4a0d5-b6da-482c-9308-1841f9a0333a None admin] PATH_INFO: `/v3/services/compute` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:28.410346 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4a0d5-b6da-482c-9308-1841f9a0333a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:28.412182 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4a0d5-b6da-482c-9308-1841f9a0333a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-43b4a0d5-b6da-482c-9308-1841f9a0333a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:28.426243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:28.427249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 17:37:28.428083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:28.430472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 465/947] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:28.437253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488179bc-5355-43c8-a15f-f7a59b70c6d7 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:28.488197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:28.540969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488179bc-5355-43c8-a15f-f7a59b70c6d7 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:28.583314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209303e7-92f1-429b-b79c-77331aaff7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:28.584511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209303e7-92f1-429b-b79c-77331aaff7ed None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:28.585107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209303e7-92f1-429b-b79c-77331aaff7ed None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:28.585682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209303e7-92f1-429b-b79c-77331aaff7ed None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:28.586846 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209303e7-92f1-429b-b79c-77331aaff7ed None admin] RBAC: Adding query filter params (name=compute) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:28.587352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209303e7-92f1-429b-b79c-77331aaff7ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:28.589470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209303e7-92f1-429b-b79c-77331aaff7ed None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:28.596705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 483/948] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:37:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:28.605597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4a0d5-b6da-482c-9308-1841f9a0333a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:28.717812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4a0d5-b6da-482c-9308-1841f9a0333a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:28.735298 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f25e1e-868a-4780-a1bc-c69d91a96982 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:28.735605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f25e1e-868a-4780-a1bc-c69d91a96982 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:28.735893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f25e1e-868a-4780-a1bc-c69d91a96982 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:28.737560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 484/949] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:37:28.742737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9204adf-feb1-4548-b961-d032564b3c81 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:28.743028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9204adf-feb1-4548-b961-d032564b3c81 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:28.743306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9204adf-feb1-4548-b961-d032564b3c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:28.754607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7d3d-07e8-4b22-aad8-948151dc8f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:28.755283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7d3d-07e8-4b22-aad8-948151dc8f1c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:28.755569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7d3d-07e8-4b22-aad8-948151dc8f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:28.755848 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7d3d-07e8-4b22-aad8-948151dc8f1c None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:28.756737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c7d3d-07e8-4b22-aad8-948151dc8f1c None admin] RBAC: Adding query filter params (type=compute) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:28.756917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c7d3d-07e8-4b22-aad8-948151dc8f1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:28.758282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c7d3d-07e8-4b22-aad8-948151dc8f1c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:28.763993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 466/950] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:37:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:28.764344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b9204adf-feb1-4548-b961-d032564b3c81 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:28.765763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b9204adf-feb1-4548-b961-d032564b3c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:28.848615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 485/951] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:28.873895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7d3d-07e8-4b22-aad8-948151dc8f1c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:28.928103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:28.992691 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7d3d-07e8-4b22-aad8-948151dc8f1c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:29.048352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf72af-4024-42b3-bee9-058440c2f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:29.049541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf72af-4024-42b3-bee9-058440c2f047 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:29.050042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf72af-4024-42b3-bee9-058440c2f047 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:29.050543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf72af-4024-42b3-bee9-058440c2f047 None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:29.051831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf72af-4024-42b3-bee9-058440c2f047 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:29.054358 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf72af-4024-42b3-bee9-058440c2f047 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:29.056820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: WARNING keystone.server.flask.common [None req-d8cf72af-4024-42b3-bee9-058440c2f047 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 17:37:29.124703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.sql.core [None req-d8cf72af-4024-42b3-bee9-058440c2f047 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 17:37:29.124703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 17:37:29.124703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [parameters: {'id': '0b8b6218a6c8412680210090f04cd01e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 17:37:29.124703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87026) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-d8cf72af-4024-42b3-bee9-058440c2f047 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0b8b6218a6c8412680210090f04cd01e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0b8b6218a6c8412680210090f04cd01e. Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application conn.query(q) Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 17:37:29.132642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result.read() Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 20 17:37:29.133475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application next(self.gen) Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application yield resource Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application next(self.gen) Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise self.value Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application session.commit() Jul 20 17:37:29.134430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.session.flush() Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application compat.raise_( Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 17:37:29.135326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 17:37:29.136228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application conn.query(q) Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result.read() Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 17:37:29.143056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [parameters: {'id': '0b8b6218a6c8412680210090f04cd01e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:29.146347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:29.148289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:29.150512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:29.150512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 20 17:37:29.150512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 20 17:37:29.150512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:29.150512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:29.150512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 20 17:37:29.150512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 20 17:37:29.150512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0b8b6218a6c8412680210090f04cd01e. Jul 20 17:37:29.150512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:29.150512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 467/952] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Jul 20 17:37:28 2022] POST /identity/v3/projects => generated 262 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:29.151880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9204adf-feb1-4548-b961-d032564b3c81 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:29.196430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:29.294986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9204adf-feb1-4548-b961-d032564b3c81 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:29.343883 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942042de-88fd-40f6-8460-90610e255e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:29.345036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942042de-88fd-40f6-8460-90610e255e5e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:29.345541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942042de-88fd-40f6-8460-90610e255e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:29.345997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942042de-88fd-40f6-8460-90610e255e5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:29.353711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942042de-88fd-40f6-8460-90610e255e5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:29.355460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942042de-88fd-40f6-8460-90610e255e5e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-942042de-88fd-40f6-8460-90610e255e5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:29.370475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:29.371459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:29.372986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:29.372986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:29.372986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:29.372986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:29.372986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:29.372986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:29.372986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:29.372986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:29.375158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 486/953] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:29.383951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf72af-4024-42b3-bee9-058440c2f047 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:29.443738 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b2a13-0e92-4aa9-aad4-dd17286a862e None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:29.444062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b2a13-0e92-4aa9-aad4-dd17286a862e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:29.444292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b2a13-0e92-4aa9-aad4-dd17286a862e None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:29.449641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 487/954] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:37:29.452742 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfd09b-0091-4491-aa32-40a436e6e019 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:29.453030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfd09b-0091-4491-aa32-40a436e6e019 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:29.453307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfd09b-0091-4491-aa32-40a436e6e019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:29.471233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-fdbfd09b-0091-4491-aa32-40a436e6e019 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:29.472449 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-fdbfd09b-0091-4491-aa32-40a436e6e019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:29.508820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf72af-4024-42b3-bee9-058440c2f047 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:29.510577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:29.547779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9686c-0154-433f-8a14-32430368ed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:29.548027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 488/955] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:29.548364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9686c-0154-433f-8a14-32430368ed24 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:29.548683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9686c-0154-433f-8a14-32430368ed24 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:29.548960 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9686c-0154-433f-8a14-32430368ed24 None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:29.549781 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9686c-0154-433f-8a14-32430368ed24 None admin] RBAC: Adding query filter params (name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:29.550096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9686c-0154-433f-8a14-32430368ed24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:29.551740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9686c-0154-433f-8a14-32430368ed24 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:29.571555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfd09b-0091-4491-aa32-40a436e6e019 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:29.574054 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 468/956] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:37:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:29.611935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:29.697610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfd09b-0091-4491-aa32-40a436e6e019 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:29.727552 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa20169-5d09-4c3e-b6fc-f6bf387a3409 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:29.727899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa20169-5d09-4c3e-b6fc-f6bf387a3409 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:29.728127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa20169-5d09-4c3e-b6fc-f6bf387a3409 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:29.729975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 469/957] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:29.737353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53363069-5d19-4654-b40b-5576ca467629 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:29.738363 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53363069-5d19-4654-b40b-5576ca467629 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:29.738902 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53363069-5d19-4654-b40b-5576ca467629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:29.743635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca015f-76e3-4cdb-88fe-118ee162ab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:29.743935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca015f-76e3-4cdb-88fe-118ee162ab8a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:29.744220 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca015f-76e3-4cdb-88fe-118ee162ab8a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:29.744526 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca015f-76e3-4cdb-88fe-118ee162ab8a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:29.745871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca015f-76e3-4cdb-88fe-118ee162ab8a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:29.746633 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca015f-76e3-4cdb-88fe-118ee162ab8a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:29.764880 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-53363069-5d19-4654-b40b-5576ca467629 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-6aca015f-76e3-4cdb-88fe-118ee162ab8a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:29.765157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:29.766958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:29.768008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:29.769219 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-53363069-5d19-4654-b40b-5576ca467629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:29.769308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 489/958] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 20 17:37:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:29.777301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca015f-76e3-4cdb-88fe-118ee162ab8a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:29.861475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 470/959] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:29.885672 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53363069-5d19-4654-b40b-5576ca467629 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:29.925126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:29.933122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca015f-76e3-4cdb-88fe-118ee162ab8a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:29.979297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f41f-a166-449e-ab96-b840ffe2913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:29.979986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f41f-a166-449e-ab96-b840ffe2913d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:29.980274 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f41f-a166-449e-ab96-b840ffe2913d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:29.980597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f41f-a166-449e-ab96-b840ffe2913d None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:29.981931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f41f-a166-449e-ab96-b840ffe2913d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:29.982245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f41f-a166-449e-ab96-b840ffe2913d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:29.983723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f41f-a166-449e-ab96-b840ffe2913d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:29.995205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 490/960] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 20 17:37:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:29.996293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f41f-a166-449e-ab96-b840ffe2913d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:30.009605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:30.021263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53363069-5d19-4654-b40b-5576ca467629 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:30.069924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58f2ab-f0a8-47eb-af68-ca4ee7969a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:30.071110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58f2ab-f0a8-47eb-af68-ca4ee7969a90 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:30.071624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58f2ab-f0a8-47eb-af68-ca4ee7969a90 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:30.072613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58f2ab-f0a8-47eb-af68-ca4ee7969a90 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:30.087878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58f2ab-f0a8-47eb-af68-ca4ee7969a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-bf58f2ab-f0a8-47eb-af68-ca4ee7969a90 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:30.099335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:30.100339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:30.101213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:30.101213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:30.101213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:30.101213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:30.101213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:30.101213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:30.101213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:30.101213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:30.101213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:30.101213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:30.101213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 17:37:30.101213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:30.104249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 471/961] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jul 20 17:37:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:30.109983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58f2ab-f0a8-47eb-af68-ca4ee7969a90 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:30.129630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f41f-a166-449e-ab96-b840ffe2913d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:30.165685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830291a-3487-4a6c-9ee4-e4744d20f105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:30.166446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830291a-3487-4a6c-9ee4-e4744d20f105 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:30.166649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830291a-3487-4a6c-9ee4-e4744d20f105 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:30.166897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830291a-3487-4a6c-9ee4-e4744d20f105 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:30.167661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830291a-3487-4a6c-9ee4-e4744d20f105 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:30.168039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830291a-3487-4a6c-9ee4-e4744d20f105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:30.169980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830291a-3487-4a6c-9ee4-e4744d20f105 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:30.180030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 491/962] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 20 17:37:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:30.181129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830291a-3487-4a6c-9ee4-e4744d20f105 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:30.207178 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:30.233422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58f2ab-f0a8-47eb-af68-ca4ee7969a90 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:30.271850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1aed0-5894-4048-a89e-292711ae60fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:30.272922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1aed0-5894-4048-a89e-292711ae60fe None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:30.273404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1aed0-5894-4048-a89e-292711ae60fe None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:30.273950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1aed0-5894-4048-a89e-292711ae60fe None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:30.274879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1aed0-5894-4048-a89e-292711ae60fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:30.275355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1aed0-5894-4048-a89e-292711ae60fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:30.277263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1aed0-5894-4048-a89e-292711ae60fe None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:30.287291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830291a-3487-4a6c-9ee4-e4744d20f105 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:30.292660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 472/963] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 20 17:37:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:30.294289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1aed0-5894-4048-a89e-292711ae60fe None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:30.322363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37f982-c4e5-47f0-bac8-bb7b91d04ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:30.323243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37f982-c4e5-47f0-bac8-bb7b91d04ad0 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:30.323384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37f982-c4e5-47f0-bac8-bb7b91d04ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:30.323561 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37f982-c4e5-47f0-bac8-bb7b91d04ad0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:30.324291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37f982-c4e5-47f0-bac8-bb7b91d04ad0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:30.325860 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:30.326460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37f982-c4e5-47f0-bac8-bb7b91d04ad0 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:30.413130 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1aed0-5894-4048-a89e-292711ae60fe None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:30.436984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 492/964] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 20 17:37:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:37:30.467293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92560c4-1edb-4d75-bbaa-10df6f4faced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:30.468620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92560c4-1edb-4d75-bbaa-10df6f4faced None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:30.469142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92560c4-1edb-4d75-bbaa-10df6f4faced None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:30.469653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92560c4-1edb-4d75-bbaa-10df6f4faced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:30.483872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92560c4-1edb-4d75-bbaa-10df6f4faced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:30.485838 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92560c4-1edb-4d75-bbaa-10df6f4faced None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-b92560c4-1edb-4d75-bbaa-10df6f4faced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:30.508279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:30.509310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:30.510209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:30.510209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:30.510209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:30.510209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:30.512764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 473/965] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:30.518361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37f982-c4e5-47f0-bac8-bb7b91d04ad0 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:30.619028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:30.641678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37f982-c4e5-47f0-bac8-bb7b91d04ad0 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:30.678719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8efe-f6d7-459b-a4f2-1097afdb31a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:30.679310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8efe-f6d7-459b-a4f2-1097afdb31a4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:30.679591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8efe-f6d7-459b-a4f2-1097afdb31a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:30.679879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8efe-f6d7-459b-a4f2-1097afdb31a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:30.680621 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec8efe-f6d7-459b-a4f2-1097afdb31a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:30.680932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec8efe-f6d7-459b-a4f2-1097afdb31a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:30.682370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec8efe-f6d7-459b-a4f2-1097afdb31a4 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:30.694620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 493/966] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:30.700555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92560c4-1edb-4d75-bbaa-10df6f4faced None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:30.767105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:30.810004 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92560c4-1edb-4d75-bbaa-10df6f4faced None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:30.847317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4d2ff-57ff-460c-889b-d766f4f62d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:30.848133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4d2ff-57ff-460c-889b-d766f4f62d74 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:30.848414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4d2ff-57ff-460c-889b-d766f4f62d74 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:30.848720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4d2ff-57ff-460c-889b-d766f4f62d74 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:30.857544 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4d2ff-57ff-460c-889b-d766f4f62d74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:30.859230 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4d2ff-57ff-460c-889b-d766f4f62d74 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-a2f4d2ff-57ff-460c-889b-d766f4f62d74 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:30.875102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:30.876131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:30.877381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:30.877381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:30.877381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:30.877381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:30.877381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:30.877381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:30.877381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:30.877381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:30.877381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 17:37:30.877381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:30.877381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 474/967] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 20 17:37:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:30.885257 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8efe-f6d7-459b-a4f2-1097afdb31a4 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:30.996644 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8efe-f6d7-459b-a4f2-1097afdb31a4 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:31.030353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b44fb-88d3-41b8-97b7-eceae3d71665 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:31.030741 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b44fb-88d3-41b8-97b7-eceae3d71665 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:31.030942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b44fb-88d3-41b8-97b7-eceae3d71665 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:31.032590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 475/968] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:31.034459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8495bcb-7e5d-44f4-afb6-bafc8760175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:31.035387 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8495bcb-7e5d-44f4-afb6-bafc8760175d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:31.035883 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8495bcb-7e5d-44f4-afb6-bafc8760175d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:31.036440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8495bcb-7e5d-44f4-afb6-bafc8760175d None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:31.037828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8495bcb-7e5d-44f4-afb6-bafc8760175d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:31.038092 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691500eb-a31e-42ba-8ad8-ae11b1aba93b None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:31.038380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691500eb-a31e-42ba-8ad8-ae11b1aba93b None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:31.038655 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691500eb-a31e-42ba-8ad8-ae11b1aba93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:31.038974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8495bcb-7e5d-44f4-afb6-bafc8760175d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:31.040854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8495bcb-7e5d-44f4-afb6-bafc8760175d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:31.051653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:31.061381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 494/969] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Jul 20 17:37:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:31.066515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-691500eb-a31e-42ba-8ad8-ae11b1aba93b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:31.066703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8495bcb-7e5d-44f4-afb6-bafc8760175d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:31.068241 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-691500eb-a31e-42ba-8ad8-ae11b1aba93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:31.176677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 476/970] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:31.184052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8495bcb-7e5d-44f4-afb6-bafc8760175d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:31.196899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691500eb-a31e-42ba-8ad8-ae11b1aba93b None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:31.234141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf634a-7778-437f-8699-e089c24f4523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:31.235106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf634a-7778-437f-8699-e089c24f4523 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:31.235385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf634a-7778-437f-8699-e089c24f4523 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:31.235652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf634a-7778-437f-8699-e089c24f4523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:31.266189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:31.327732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:31.329483 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691500eb-a31e-42ba-8ad8-ae11b1aba93b None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:31.333098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf634a-7778-437f-8699-e089c24f4523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:31.334573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf634a-7778-437f-8699-e089c24f4523 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:31.375605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee84a44-3260-4f03-bc5a-d128d3cc394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:31.377319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee84a44-3260-4f03-bc5a-d128d3cc394a None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:31.377817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee84a44-3260-4f03-bc5a-d128d3cc394a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:31.378328 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee84a44-3260-4f03-bc5a-d128d3cc394a None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:31.379297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee84a44-3260-4f03-bc5a-d128d3cc394a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:31.381849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee84a44-3260-4f03-bc5a-d128d3cc394a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:31.446928 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 477/971] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:37:31 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:37:31.467025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 495/972] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:37:31 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 17:37:31.472980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee84a44-3260-4f03-bc5a-d128d3cc394a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:31.607690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee84a44-3260-4f03-bc5a-d128d3cc394a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:31.618336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:31.645553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3062f0-073e-494d-a3cd-a6a4753e11c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:31.646349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3062f0-073e-494d-a3cd-a6a4753e11c2 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:31.646623 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3062f0-073e-494d-a3cd-a6a4753e11c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:31.646895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3062f0-073e-494d-a3cd-a6a4753e11c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:31.659611 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3062f0-073e-494d-a3cd-a6a4753e11c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:31.661204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3062f0-073e-494d-a3cd-a6a4753e11c2 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-4d3062f0-073e-494d-a3cd-a6a4753e11c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:31.683405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:31.685507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:31.686604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:31.686604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:31.686604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:31.686604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:31.686604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 478/973] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:31.692878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf634a-7778-437f-8699-e089c24f4523 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:31.805560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:31.810699 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf634a-7778-437f-8699-e089c24f4523 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:31.848630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8748c09-b04f-4420-a83d-9db258c96a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:31.849308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8748c09-b04f-4420-a83d-9db258c96a7a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:31.849593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8748c09-b04f-4420-a83d-9db258c96a7a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:31.849874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8748c09-b04f-4420-a83d-9db258c96a7a None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:31.850603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8748c09-b04f-4420-a83d-9db258c96a7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:31.850914 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8748c09-b04f-4420-a83d-9db258c96a7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:31.852737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8748c09-b04f-4420-a83d-9db258c96a7a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:31.853266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258b444-851f-4b1d-b57e-39f02df657d3 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:31.853559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258b444-851f-4b1d-b57e-39f02df657d3 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:31.853839 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258b444-851f-4b1d-b57e-39f02df657d3 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:31.855496 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 479/974] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:31.860777 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312823a8-7678-4927-a8cd-529ffd0b7e45 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:31.861003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312823a8-7678-4927-a8cd-529ffd0b7e45 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:31.861273 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312823a8-7678-4927-a8cd-529ffd0b7e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:31.867302 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 496/975] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:31.874878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8748c09-b04f-4420-a83d-9db258c96a7a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:31.878967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-312823a8-7678-4927-a8cd-529ffd0b7e45 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:31.880342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-312823a8-7678-4927-a8cd-529ffd0b7e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:31.964573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 480/976] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:31.986743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312823a8-7678-4927-a8cd-529ffd0b7e45 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:31.998643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8748c09-b04f-4420-a83d-9db258c96a7a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:32.036969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378f506-c321-4927-b3e2-a4cad24f5372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:32.037785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f506-c321-4927-b3e2-a4cad24f5372 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:32.038069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f506-c321-4927-b3e2-a4cad24f5372 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:32.038347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f506-c321-4927-b3e2-a4cad24f5372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:32.047007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378f506-c321-4927-b3e2-a4cad24f5372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:32.048701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378f506-c321-4927-b3e2-a4cad24f5372 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-5378f506-c321-4927-b3e2-a4cad24f5372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:32.068525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:32.069510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:32.070412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:32.070412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:32.070412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:32.070412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:32.070412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:32.070412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:32.070412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:32.070412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:32.070412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 497/977] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:32.079335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378f506-c321-4927-b3e2-a4cad24f5372 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:32.092470 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:32.104864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:32.110457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312823a8-7678-4927-a8cd-529ffd0b7e45 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:32.152804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ccc9-c28e-47ee-a377-0573324cf8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:32.154157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ccc9-c28e-47ee-a377-0573324cf8e7 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:32.154514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ccc9-c28e-47ee-a377-0573324cf8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:32.154866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8ccc9-c28e-47ee-a377-0573324cf8e7 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:32.156212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8ccc9-c28e-47ee-a377-0573324cf8e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:32.158109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8ccc9-c28e-47ee-a377-0573324cf8e7 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:32.198074 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378f506-c321-4927-b3e2-a4cad24f5372 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:32.206337 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.sql.core [None req-4ab8ccc9-c28e-47ee-a377-0573324cf8e7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 17:37:32.206337 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 17:37:32.206337 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [parameters: {'user_id': '5b1c5770972c4db49fe65143cf60d9fc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 17:37:32.206337 dv-cinder-849846-3-smb devstack@keystone.service[87026]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87026) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-4ab8ccc9-c28e-47ee-a377-0573324cf8e7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application conn.query(q) Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result.read() Jul 20 17:37:32.218890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 17:37:32.219856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application next(self.gen) Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application yield resource Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application next(self.gen) Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise self.value Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application session.commit() Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 17:37:32.220894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.session.flush() Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application compat.raise_( Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 17:37:32.221894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 17:37:32.224040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application conn.query(q) Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application result.read() Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 17:37:32.226586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [parameters: {'user_id': '5b1c5770972c4db49fe65143cf60d9fc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:32.228786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 20 17:37:32.231801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 20 17:37:32.234488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 20 17:37:32.234488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 20 17:37:32.234488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 17:37:32.234488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 17:37:32.234488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 17:37:32.234488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:32.234488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 481/978] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Jul 20 17:37:31 2022] POST /identity/v3/users => generated 160 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:32.234488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ccc9-c28e-47ee-a377-0573324cf8e7 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:32.248172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e1760-5e5e-4305-8562-9539ed463801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:32.248889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e1760-5e5e-4305-8562-9539ed463801 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:32.249166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e1760-5e5e-4305-8562-9539ed463801 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:32.252047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e1760-5e5e-4305-8562-9539ed463801 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:32.252047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e1760-5e5e-4305-8562-9539ed463801 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:32.252047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e1760-5e5e-4305-8562-9539ed463801 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:32.253345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e1760-5e5e-4305-8562-9539ed463801 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:32.272625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 498/979] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:32.276108 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e1760-5e5e-4305-8562-9539ed463801 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:32.382859 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:32.392731 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8ccc9-c28e-47ee-a377-0573324cf8e7 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:32.418087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e1760-5e5e-4305-8562-9539ed463801 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:32.438417 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba370cd-8160-468a-996d-3a53418c6abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:32.439228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba370cd-8160-468a-996d-3a53418c6abc None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:32.439504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba370cd-8160-468a-996d-3a53418c6abc None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:32.439773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba370cd-8160-468a-996d-3a53418c6abc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:32.448326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba370cd-8160-468a-996d-3a53418c6abc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:32.450630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba370cd-8160-468a-996d-3a53418c6abc None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:32.457768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af3041-978c-468f-9780-c74f93baeb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:32.458675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af3041-978c-468f-9780-c74f93baeb74 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:32.459105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af3041-978c-468f-9780-c74f93baeb74 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:32.459536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af3041-978c-468f-9780-c74f93baeb74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:32.460593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af3041-978c-468f-9780-c74f93baeb74 None admin] RBAC: Adding query filter params (role.id=8066522d348444c39a987e22e5767068, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=f518137b54ee4e668f41c0f660a54d90) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:32.461071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af3041-978c-468f-9780-c74f93baeb74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:32.462640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af3041-978c-468f-9780-c74f93baeb74 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-6ba370cd-8160-468a-996d-3a53418c6abc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:32.468708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:32.469899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:32.471345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:32.471345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:32.471345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:32.471345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:32.471345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:32.471345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:32.471345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:32.471345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:32.471345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 17:37:32.471345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:32.471345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 482/980] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:37:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:32.479615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 499/981] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:37:32 2022] GET /identity/v3/role_assignments?user.id=f518137b54ee4e668f41c0f660a54d90&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=8066522d348444c39a987e22e5767068 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:32.480995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba370cd-8160-468a-996d-3a53418c6abc None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:32.501075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:32.628280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba370cd-8160-468a-996d-3a53418c6abc None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:32.642515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b571fd-16c6-4a24-ae29-08b0a23dadd1 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:32.642845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b571fd-16c6-4a24-ae29-08b0a23dadd1 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:32.643087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b571fd-16c6-4a24-ae29-08b0a23dadd1 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:32.648603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 500/982] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:37:32.649886 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00ea4d-60f9-420c-a605-92a827298668 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:32.650174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00ea4d-60f9-420c-a605-92a827298668 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:32.650455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00ea4d-60f9-420c-a605-92a827298668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:32.670694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf403cc-09c2-4ee4-9bb9-db82f60ec4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:32.671321 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf403cc-09c2-4ee4-9bb9-db82f60ec4ee None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:32.671576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf403cc-09c2-4ee4-9bb9-db82f60ec4ee None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:32.671905 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf403cc-09c2-4ee4-9bb9-db82f60ec4ee None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:32.672784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf403cc-09c2-4ee4-9bb9-db82f60ec4ee None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:32.673081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf403cc-09c2-4ee4-9bb9-db82f60ec4ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:32.673833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-8f00ea4d-60f9-420c-a605-92a827298668 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:32.674533 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf403cc-09c2-4ee4-9bb9-db82f60ec4ee None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:32.675054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8f00ea4d-60f9-420c-a605-92a827298668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:32.723637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 483/983] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Jul 20 17:37:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:32.771091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 501/984] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:32.795978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf403cc-09c2-4ee4-9bb9-db82f60ec4ee None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:32.875125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:32.917835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf403cc-09c2-4ee4-9bb9-db82f60ec4ee None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:32.958305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d26ae-bb85-44be-8530-2e3f807dbde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:32.959032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d26ae-bb85-44be-8530-2e3f807dbde3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:32.959305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d26ae-bb85-44be-8530-2e3f807dbde3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:32.959580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d26ae-bb85-44be-8530-2e3f807dbde3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:32.960246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d26ae-bb85-44be-8530-2e3f807dbde3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:32.961655 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d26ae-bb85-44be-8530-2e3f807dbde3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-d88d26ae-bb85-44be-8530-2e3f807dbde3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:32.974608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:32.976666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:32.978336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 484/985] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 20 17:37:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:32.982267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00ea4d-60f9-420c-a605-92a827298668 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:33.085366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:33.137068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00ea4d-60f9-420c-a605-92a827298668 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:33.183611 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d60bcb-9cab-4657-844b-7c4a84f3b71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:33.184848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d60bcb-9cab-4657-844b-7c4a84f3b71a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:33.185132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d60bcb-9cab-4657-844b-7c4a84f3b71a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:33.185405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d60bcb-9cab-4657-844b-7c4a84f3b71a None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:33.186114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d60bcb-9cab-4657-844b-7c4a84f3b71a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:33.186417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d60bcb-9cab-4657-844b-7c4a84f3b71a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:33.187981 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d60bcb-9cab-4657-844b-7c4a84f3b71a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:33.197804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 502/986] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 20 17:37:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:33.199417 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d26ae-bb85-44be-8530-2e3f807dbde3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:33.308197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d26ae-bb85-44be-8530-2e3f807dbde3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:33.361120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2013f-3736-477d-bbe1-33b27373a5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:33.361831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2013f-3736-477d-bbe1-33b27373a5e1 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:33.362198 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2013f-3736-477d-bbe1-33b27373a5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:33.362483 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2013f-3736-477d-bbe1-33b27373a5e1 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:33.363376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2013f-3736-477d-bbe1-33b27373a5e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:33.363699 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2013f-3736-477d-bbe1-33b27373a5e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:33.365169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2013f-3736-477d-bbe1-33b27373a5e1 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:33.366842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:33.372360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 485/987] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 20 17:37:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:33.378833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d60bcb-9cab-4657-844b-7c4a84f3b71a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:33.498027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d60bcb-9cab-4657-844b-7c4a84f3b71a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:33.533761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badd05d-89f8-4601-aece-41f16cc31b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:33.534423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badd05d-89f8-4601-aece-41f16cc31b06 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:33.534705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badd05d-89f8-4601-aece-41f16cc31b06 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:33.534980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badd05d-89f8-4601-aece-41f16cc31b06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:33.535783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badd05d-89f8-4601-aece-41f16cc31b06 None admin] RBAC: Adding query filter params (interface=admin, service_id=32f2e1bdfce042b29d46bfd1b1991dfd, region_id=RegionOne) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:33.536098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badd05d-89f8-4601-aece-41f16cc31b06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:33.537747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badd05d-89f8-4601-aece-41f16cc31b06 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:33.540310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:33.545011 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 503/988] 10.222.0.27 () {56 vars in 1249 bytes} [Wed Jul 20 17:37:33 2022] GET /identity/v3/endpoints?service_id=32f2e1bdfce042b29d46bfd1b1991dfd&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:33.550663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2013f-3736-477d-bbe1-33b27373a5e1 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:33.655674 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2013f-3736-477d-bbe1-33b27373a5e1 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:33.691364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bb960-f8a7-4c9b-b97b-d2d51ae0ffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:33.692043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bb960-f8a7-4c9b-b97b-d2d51ae0ffa2 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:33.692321 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bb960-f8a7-4c9b-b97b-d2d51ae0ffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:33.692628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bb960-f8a7-4c9b-b97b-d2d51ae0ffa2 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:33.693321 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bb960-f8a7-4c9b-b97b-d2d51ae0ffa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:33.694697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bb960-f8a7-4c9b-b97b-d2d51ae0ffa2 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:33.701747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 486/989] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 20 17:37:33 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:37:33.714553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838139c2-7bb9-49e5-910c-a0a640053866 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:33.714923 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838139c2-7bb9-49e5-910c-a0a640053866 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:33.715123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838139c2-7bb9-49e5-910c-a0a640053866 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:33.717556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 504/990] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:33.723433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c0739-b86a-4f24-b52c-1f1335a5e54c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:33.723739 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c0739-b86a-4f24-b52c-1f1335a5e54c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:33.723998 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c0739-b86a-4f24-b52c-1f1335a5e54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:33.742226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-897c0739-b86a-4f24-b52c-1f1335a5e54c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:33.743795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-897c0739-b86a-4f24-b52c-1f1335a5e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:33.807525 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:33.819498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 487/991] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:33.845004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838139c2-7bb9-49e5-910c-a0a640053866 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:33.952387 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838139c2-7bb9-49e5-910c-a0a640053866 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:33.985682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694f382-b060-4736-84f8-6d48a300bef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:33.986474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f382-b060-4736-84f8-6d48a300bef3 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:33.986760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f382-b060-4736-84f8-6d48a300bef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:33.987035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f382-b060-4736-84f8-6d48a300bef3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:33.987722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694f382-b060-4736-84f8-6d48a300bef3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:33.989127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694f382-b060-4736-84f8-6d48a300bef3 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-4694f382-b060-4736-84f8-6d48a300bef3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:34.001502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:34.002494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:34.003371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 505/992] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:34.009873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c0739-b86a-4f24-b52c-1f1335a5e54c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:34.116833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c0739-b86a-4f24-b52c-1f1335a5e54c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:34.153695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f8044-f679-4ff3-9c27-532f828cb22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:34.155056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8044-f679-4ff3-9c27-532f828cb22f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:34.155334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8044-f679-4ff3-9c27-532f828cb22f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:34.155607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8044-f679-4ff3-9c27-532f828cb22f None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:34.156313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f8044-f679-4ff3-9c27-532f828cb22f None admin] RBAC: Adding query filter params (name=compute) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:34.156704 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f8044-f679-4ff3-9c27-532f828cb22f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:34.158117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f8044-f679-4ff3-9c27-532f828cb22f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:34.163815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 488/993] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:37:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:34.170038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694f382-b060-4736-84f8-6d48a300bef3 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:34.237621 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:34.277866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694f382-b060-4736-84f8-6d48a300bef3 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:34.313461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c99980-b668-4966-a0fa-4c141aebdb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:34.314139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c99980-b668-4966-a0fa-4c141aebdb8f None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:34.314405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c99980-b668-4966-a0fa-4c141aebdb8f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:34.314679 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c99980-b668-4966-a0fa-4c141aebdb8f None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:34.315374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c99980-b668-4966-a0fa-4c141aebdb8f None admin] RBAC: Adding query filter params (type=compute) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:34.315677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c99980-b668-4966-a0fa-4c141aebdb8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:34.317056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c99980-b668-4966-a0fa-4c141aebdb8f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:34.327548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 506/994] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:37:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:34.328700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f8044-f679-4ff3-9c27-532f828cb22f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:34.397399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:34.446877 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f8044-f679-4ff3-9c27-532f828cb22f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:34.483434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dbd4d-f520-4ae8-a3d1-642816bf0ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:34.484104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dbd4d-f520-4ae8-a3d1-642816bf0ca1 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:34.484386 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dbd4d-f520-4ae8-a3d1-642816bf0ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:34.484688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dbd4d-f520-4ae8-a3d1-642816bf0ca1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:34.485492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dbd4d-f520-4ae8-a3d1-642816bf0ca1 None admin] RBAC: Adding query filter params (interface=public, service_id=ca7d763ebde64c778dcded85fc7b1932, region_id=RegionOne) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:34.485806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dbd4d-f520-4ae8-a3d1-642816bf0ca1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:34.487202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dbd4d-f520-4ae8-a3d1-642816bf0ca1 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:34.493483 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 489/995] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 20 17:37:34 2022] GET /identity/v3/endpoints?service_id=ca7d763ebde64c778dcded85fc7b1932&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:34.500092 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c99980-b668-4966-a0fa-4c141aebdb8f None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:34.605750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c99980-b668-4966-a0fa-4c141aebdb8f None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:34.632867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:34.641583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea8c6-f820-4a06-b7fc-14fd6d7a6401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:34.642246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea8c6-f820-4a06-b7fc-14fd6d7a6401 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:34.642522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea8c6-f820-4a06-b7fc-14fd6d7a6401 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:34.642793 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea8c6-f820-4a06-b7fc-14fd6d7a6401 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:34.643462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ea8c6-f820-4a06-b7fc-14fd6d7a6401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:34.644841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ea8c6-f820-4a06-b7fc-14fd6d7a6401 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:34.651021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 507/996] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 20 17:37:34 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:37:34.659643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480908-1aac-4cfb-aefb-708792b17edd None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:34.660188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480908-1aac-4cfb-aefb-708792b17edd None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:34.660188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480908-1aac-4cfb-aefb-708792b17edd None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:34.662170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 490/997] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:34.668146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb42925-a19d-45c3-b348-6000e9c4dda9 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:34.668462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb42925-a19d-45c3-b348-6000e9c4dda9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:34.668891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb42925-a19d-45c3-b348-6000e9c4dda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:34.687094 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-8eb42925-a19d-45c3-b348-6000e9c4dda9 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:34.688328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8eb42925-a19d-45c3-b348-6000e9c4dda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:34.764446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 508/998] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:34.787597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480908-1aac-4cfb-aefb-708792b17edd None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:34.902695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480908-1aac-4cfb-aefb-708792b17edd None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:34.924318 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:34.939748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fda95c-f808-4d26-be7b-60a2d6745b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:34.942025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda95c-f808-4d26-be7b-60a2d6745b58 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:34.942025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda95c-f808-4d26-be7b-60a2d6745b58 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:34.942025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fda95c-f808-4d26-be7b-60a2d6745b58 None admin] PATH_INFO: `/v3/services/image` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:34.942025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fda95c-f808-4d26-be7b-60a2d6745b58 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:34.943334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fda95c-f808-4d26-be7b-60a2d6745b58 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-14fda95c-f808-4d26-be7b-60a2d6745b58 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:34.955266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:34.956282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 17:37:34.957195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:34.960562 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 491/999] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Jul 20 17:37:34 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:34.962750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb42925-a19d-45c3-b348-6000e9c4dda9 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:35.064592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb42925-a19d-45c3-b348-6000e9c4dda9 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:35.087657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:35.100266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4bf04-1002-4dff-bc36-88fccab6c29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:35.100977 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4bf04-1002-4dff-bc36-88fccab6c29e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:35.101261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4bf04-1002-4dff-bc36-88fccab6c29e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:35.101537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4bf04-1002-4dff-bc36-88fccab6c29e None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:35.102241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4bf04-1002-4dff-bc36-88fccab6c29e None admin] RBAC: Adding query filter params (name=image) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:35.102612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4bf04-1002-4dff-bc36-88fccab6c29e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:35.103899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4bf04-1002-4dff-bc36-88fccab6c29e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:35.113718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 509/1000] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:35.115641 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fda95c-f808-4d26-be7b-60a2d6745b58 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:35.223201 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fda95c-f808-4d26-be7b-60a2d6745b58 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:35.258947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab44e8-3c5f-4a96-ae73-76476375003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:35.259652 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab44e8-3c5f-4a96-ae73-76476375003d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:35.259934 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab44e8-3c5f-4a96-ae73-76476375003d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:35.260211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab44e8-3c5f-4a96-ae73-76476375003d None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:35.260942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab44e8-3c5f-4a96-ae73-76476375003d None admin] RBAC: Adding query filter params (type=image) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:35.261249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab44e8-3c5f-4a96-ae73-76476375003d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:35.263212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab44e8-3c5f-4a96-ae73-76476375003d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:35.272783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 492/1001] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:35.802443 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26db36-1593-42b6-b41d-e42f38dd66e7 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:35.802970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26db36-1593-42b6-b41d-e42f38dd66e7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:35.802970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26db36-1593-42b6-b41d-e42f38dd66e7 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:35.804378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 510/1002] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:35.810549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545599a-b86b-43a1-b360-f3b3a9225863 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:35.811077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545599a-b86b-43a1-b360-f3b3a9225863 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:35.811077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545599a-b86b-43a1-b360-f3b3a9225863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:35.828174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-9545599a-b86b-43a1-b360-f3b3a9225863 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:35.829556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9545599a-b86b-43a1-b360-f3b3a9225863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:35.876250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:35.899711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 493/1003] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:35.923796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26db36-1593-42b6-b41d-e42f38dd66e7 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:36.029116 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26db36-1593-42b6-b41d-e42f38dd66e7 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:36.064893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149dfc5-d09b-437a-ad93-2836e7c97133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:36.065620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149dfc5-d09b-437a-ad93-2836e7c97133 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:36.065899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149dfc5-d09b-437a-ad93-2836e7c97133 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:36.066171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149dfc5-d09b-437a-ad93-2836e7c97133 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:36.066823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149dfc5-d09b-437a-ad93-2836e7c97133 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:36.068174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149dfc5-d09b-437a-ad93-2836e7c97133 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-e149dfc5-d09b-437a-ad93-2836e7c97133 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:36.081147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:36.082191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 17:37:36.083165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:36.084783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 511/1004] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Jul 20 17:37:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:36.088275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545599a-b86b-43a1-b360-f3b3a9225863 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:36.193619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545599a-b86b-43a1-b360-f3b3a9225863 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:36.229789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e4742-a459-4285-8176-b8ff4ba0b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:36.230791 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e4742-a459-4285-8176-b8ff4ba0b41f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:36.231294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e4742-a459-4285-8176-b8ff4ba0b41f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:36.232024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e4742-a459-4285-8176-b8ff4ba0b41f None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:36.233032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e4742-a459-4285-8176-b8ff4ba0b41f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:36.233519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e4742-a459-4285-8176-b8ff4ba0b41f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:36.235059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e4742-a459-4285-8176-b8ff4ba0b41f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:36.245169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 494/1005] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 20 17:37:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:36.246361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149dfc5-d09b-437a-ad93-2836e7c97133 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:36.300804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:36.352154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149dfc5-d09b-437a-ad93-2836e7c97133 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:36.395674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f625eb5-bfab-4677-9025-d11661f1f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:36.396702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f625eb5-bfab-4677-9025-d11661f1f42b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:36.397252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f625eb5-bfab-4677-9025-d11661f1f42b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:36.397511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f625eb5-bfab-4677-9025-d11661f1f42b None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:36.398251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f625eb5-bfab-4677-9025-d11661f1f42b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:36.398563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f625eb5-bfab-4677-9025-d11661f1f42b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:36.399985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f625eb5-bfab-4677-9025-d11661f1f42b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:36.406848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 512/1006] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Jul 20 17:37:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:36.413148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e4742-a459-4285-8176-b8ff4ba0b41f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:36.460991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:36.518881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e4742-a459-4285-8176-b8ff4ba0b41f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:36.556360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98d04-716c-4c4e-baf1-0b644ec13751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:36.557077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98d04-716c-4c4e-baf1-0b644ec13751 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:36.557359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98d04-716c-4c4e-baf1-0b644ec13751 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:36.557753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98d04-716c-4c4e-baf1-0b644ec13751 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:36.558416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98d04-716c-4c4e-baf1-0b644ec13751 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:36.559869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98d04-716c-4c4e-baf1-0b644ec13751 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:36.681558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 495/1007] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 20 17:37:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:37:36.737623 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe77075-92e0-47cb-8ab2-4d3991de2d41 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:36.737951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe77075-92e0-47cb-8ab2-4d3991de2d41 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:36.738188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe77075-92e0-47cb-8ab2-4d3991de2d41 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:36.739833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 513/1008] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:36.745615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a45a16-f753-4b58-9d7e-0b8dd8fbfa4e None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:36.745943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a45a16-f753-4b58-9d7e-0b8dd8fbfa4e None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:36.746181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a45a16-f753-4b58-9d7e-0b8dd8fbfa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:36.764346 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d7a45a16-f753-4b58-9d7e-0b8dd8fbfa4e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:36.765648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d7a45a16-f753-4b58-9d7e-0b8dd8fbfa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:36.850502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 496/1009] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:36.874418 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe77075-92e0-47cb-8ab2-4d3991de2d41 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:36.979772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe77075-92e0-47cb-8ab2-4d3991de2d41 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:36.994841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:37.015734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54785c-c0ec-4d40-bafe-658f77509584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:37.016558 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54785c-c0ec-4d40-bafe-658f77509584 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:37.016844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54785c-c0ec-4d40-bafe-658f77509584 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:37.017118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54785c-c0ec-4d40-bafe-658f77509584 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:37.017767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54785c-c0ec-4d40-bafe-658f77509584 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:37.019132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54785c-c0ec-4d40-bafe-658f77509584 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-ca54785c-c0ec-4d40-bafe-658f77509584 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:37.031713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:37.033047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 17:37:37.034684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:37.037216 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 514/1010] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:37.039632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a45a16-f753-4b58-9d7e-0b8dd8fbfa4e None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:37.069407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:37.142655 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a45a16-f753-4b58-9d7e-0b8dd8fbfa4e None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:37.192522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c13e7-1a14-428b-8812-6b22c855acf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:37.192522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c13e7-1a14-428b-8812-6b22c855acf4 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:37.192522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c13e7-1a14-428b-8812-6b22c855acf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:37.192522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c13e7-1a14-428b-8812-6b22c855acf4 None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:37.193289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c13e7-1a14-428b-8812-6b22c855acf4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:37.193471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c13e7-1a14-428b-8812-6b22c855acf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:37.194904 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c13e7-1a14-428b-8812-6b22c855acf4 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:37.204516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 497/1011] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:37:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:37.207492 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54785c-c0ec-4d40-bafe-658f77509584 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:37.313293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54785c-c0ec-4d40-bafe-658f77509584 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:37.347355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aaf68-3e1d-4c1c-a31e-771fc6179f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:37.348023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aaf68-3e1d-4c1c-a31e-771fc6179f2a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:37.348300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aaf68-3e1d-4c1c-a31e-771fc6179f2a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:37.348597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aaf68-3e1d-4c1c-a31e-771fc6179f2a None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:37.349307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aaf68-3e1d-4c1c-a31e-771fc6179f2a None admin] RBAC: Adding query filter params (type=compute) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:37.349612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aaf68-3e1d-4c1c-a31e-771fc6179f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:37.350962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aaf68-3e1d-4c1c-a31e-771fc6179f2a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:37.361403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 515/1012] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Jul 20 17:37:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:37.364598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c13e7-1a14-428b-8812-6b22c855acf4 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:37.374896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313a9e1-9700-443f-a133-7eab341bbca4 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:37.375181 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313a9e1-9700-443f-a133-7eab341bbca4 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:37.375470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313a9e1-9700-443f-a133-7eab341bbca4 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:37.376899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 516/1013] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:37.382708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a58274-b0ad-433b-bea5-322bab1946e6 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:37.383448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a58274-b0ad-433b-bea5-322bab1946e6 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:37.383714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a58274-b0ad-433b-bea5-322bab1946e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:37.402109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-00a58274-b0ad-433b-bea5-322bab1946e6 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:37.403963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-00a58274-b0ad-433b-bea5-322bab1946e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:37.444712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:37.471594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:37.480531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 517/1014] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:37 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:37.483256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c13e7-1a14-428b-8812-6b22c855acf4 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:37.502219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a58274-b0ad-433b-bea5-322bab1946e6 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:37.519092 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb9a73-a28d-4ff9-a250-7983df3e2d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:37.519754 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb9a73-a28d-4ff9-a250-7983df3e2d46 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:37.520082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb9a73-a28d-4ff9-a250-7983df3e2d46 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:37.520359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb9a73-a28d-4ff9-a250-7983df3e2d46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:37.521133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb9a73-a28d-4ff9-a250-7983df3e2d46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:37.522558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb9a73-a28d-4ff9-a250-7983df3e2d46 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:37.606455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 498/1015] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 20 17:37:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:37:37.607414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a58274-b0ad-433b-bea5-322bab1946e6 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:37.663121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e6db0-3535-4791-91a5-95cdda967a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:37.663808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e6db0-3535-4791-91a5-95cdda967a57 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:37.664089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e6db0-3535-4791-91a5-95cdda967a57 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:37.664364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e6db0-3535-4791-91a5-95cdda967a57 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:37.665139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e6db0-3535-4791-91a5-95cdda967a57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:37.666557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e6db0-3535-4791-91a5-95cdda967a57 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:37.790428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 518/1016] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:37:37 2022] POST /identity/v3/services => generated 242 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:37:38.798565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc093fd4-0d06-4942-9ecb-d120fa0b382a None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:38.799120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc093fd4-0d06-4942-9ecb-d120fa0b382a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:38.799120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc093fd4-0d06-4942-9ecb-d120fa0b382a None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:38.800697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 499/1017] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:38.805916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee089945-f9fb-4660-b85d-53f3fbddbb64 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:38.806355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee089945-f9fb-4660-b85d-53f3fbddbb64 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:38.806524 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee089945-f9fb-4660-b85d-53f3fbddbb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:38.823767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ee089945-f9fb-4660-b85d-53f3fbddbb64 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:38.825570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ee089945-f9fb-4660-b85d-53f3fbddbb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:38.852117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:38.904407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 519/1018] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:38.931200 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc093fd4-0d06-4942-9ecb-d120fa0b382a None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:39.041194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc093fd4-0d06-4942-9ecb-d120fa0b382a None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:39.082994 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf7321-8e9c-411f-bbc9-a0857a640eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:39.083715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf7321-8e9c-411f-bbc9-a0857a640eca None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:39.083995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf7321-8e9c-411f-bbc9-a0857a640eca None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:39.084268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf7321-8e9c-411f-bbc9-a0857a640eca None admin] PATH_INFO: `/v3/domains/default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:39.085482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf7321-8e9c-411f-bbc9-a0857a640eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:39.086918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf7321-8e9c-411f-bbc9-a0857a640eca None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:39.088574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 500/1019] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:39.094934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee089945-f9fb-4660-b85d-53f3fbddbb64 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:39.199704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee089945-f9fb-4660-b85d-53f3fbddbb64 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:39.236411 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b8087-8dcd-4a04-8ffb-8a88636da274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:39.237101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b8087-8dcd-4a04-8ffb-8a88636da274 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:39.237383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b8087-8dcd-4a04-8ffb-8a88636da274 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:39.237659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b8087-8dcd-4a04-8ffb-8a88636da274 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:39.238384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b8087-8dcd-4a04-8ffb-8a88636da274 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:39.239878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b8087-8dcd-4a04-8ffb-8a88636da274 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:39.368618 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 520/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:37:39 2022] POST /identity/v3/projects => generated 311 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:37:39.870355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6cfbe-3e1d-45bd-825b-960d88fa44ed None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:39.871105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6cfbe-3e1d-45bd-825b-960d88fa44ed None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:39.871105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6cfbe-3e1d-45bd-825b-960d88fa44ed None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:39.872367 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 501/1021] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:39.880435 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff42e2-ff9b-43b4-abe9-05eabe5b8a7f None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:39.880435 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff42e2-ff9b-43b4-abe9-05eabe5b8a7f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:39.881132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff42e2-ff9b-43b4-abe9-05eabe5b8a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:39.897990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:39.911391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923dd26-e289-4a05-a61d-a8523c4be24c None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:39.911598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-c3ff42e2-ff9b-43b4-abe9-05eabe5b8a7f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:39.914719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923dd26-e289-4a05-a61d-a8523c4be24c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:39.914719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923dd26-e289-4a05-a61d-a8523c4be24c None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:39.915043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c3ff42e2-ff9b-43b4-abe9-05eabe5b8a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:39.915133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 502/1022] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:37:39.920773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a37b9c-a9d4-4f1e-aad4-ed68df93b665 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:39.921068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a37b9c-a9d4-4f1e-aad4-ed68df93b665 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:39.921348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a37b9c-a9d4-4f1e-aad4-ed68df93b665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:39.947314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-56a37b9c-a9d4-4f1e-aad4-ed68df93b665 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:39.951015 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-56a37b9c-a9d4-4f1e-aad4-ed68df93b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:39.974146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:40.005582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 521/1023] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:40.030378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff42e2-ff9b-43b4-abe9-05eabe5b8a7f None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:40.056660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 503/1024] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:40.080511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a37b9c-a9d4-4f1e-aad4-ed68df93b665 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:40.164317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff42e2-ff9b-43b4-abe9-05eabe5b8a7f None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:40.193873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a37b9c-a9d4-4f1e-aad4-ed68df93b665 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:40.204519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f448d3-8d66-4649-a980-c343382c990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:40.205399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f448d3-8d66-4649-a980-c343382c990e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:40.205679 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f448d3-8d66-4649-a980-c343382c990e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:40.205954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f448d3-8d66-4649-a980-c343382c990e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:40.209212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:40.219780 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f448d3-8d66-4649-a980-c343382c990e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-b3f448d3-8d66-4649-a980-c343382c990e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:40.228303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:40.229438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:40.230280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 522/1025] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jul 20 17:37:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:40.236630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f448d3-8d66-4649-a980-c343382c990e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:40.239541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc2fc7-f434-4236-92aa-6e633b85a599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:40.240824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2fc7-f434-4236-92aa-6e633b85a599 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:40.240824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2fc7-f434-4236-92aa-6e633b85a599 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:40.241022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2fc7-f434-4236-92aa-6e633b85a599 None admin] PATH_INFO: `/v3/services/image` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:40.241564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc2fc7-f434-4236-92aa-6e633b85a599 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:40.242942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc2fc7-f434-4236-92aa-6e633b85a599 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-cbcc2fc7-f434-4236-92aa-6e633b85a599 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:40.259349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:40.260441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:40.262919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 504/1026] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Jul 20 17:37:40 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:40.268586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc2fc7-f434-4236-92aa-6e633b85a599 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:40.282718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:40.356952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f448d3-8d66-4649-a980-c343382c990e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:40.391828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc2fc7-f434-4236-92aa-6e633b85a599 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:40.404158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e02526-40b8-4215-b4e5-101885c6c6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:40.405410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e02526-40b8-4215-b4e5-101885c6c6e6 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:40.405815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e02526-40b8-4215-b4e5-101885c6c6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:40.406104 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e02526-40b8-4215-b4e5-101885c6c6e6 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:40.406870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e02526-40b8-4215-b4e5-101885c6c6e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:40.407183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e02526-40b8-4215-b4e5-101885c6c6e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:40.408807 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e02526-40b8-4215-b4e5-101885c6c6e6 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:40.423866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 523/1027] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 20 17:37:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:40.424799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e02526-40b8-4215-b4e5-101885c6c6e6 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:40.426246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed45466-9942-43a5-b113-f36b9a38272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:40.426944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45466-9942-43a5-b113-f36b9a38272f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:40.427231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45466-9942-43a5-b113-f36b9a38272f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:40.427510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45466-9942-43a5-b113-f36b9a38272f None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:40.428263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed45466-9942-43a5-b113-f36b9a38272f None admin] RBAC: Adding query filter params (name=image) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:40.428602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed45466-9942-43a5-b113-f36b9a38272f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:40.429974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed45466-9942-43a5-b113-f36b9a38272f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:40.435810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 505/1028] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:40.441445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed45466-9942-43a5-b113-f36b9a38272f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:40.491333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:40.521459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:40.535685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e02526-40b8-4215-b4e5-101885c6c6e6 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:40.547405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed45466-9942-43a5-b113-f36b9a38272f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:40.572769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51a6f6-1443-46e5-ae0f-21060928d587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:40.573924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51a6f6-1443-46e5-ae0f-21060928d587 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:40.574210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51a6f6-1443-46e5-ae0f-21060928d587 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:40.574488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51a6f6-1443-46e5-ae0f-21060928d587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:40.586554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a8b94-91d6-4216-bc0e-8deb73ed5f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:40.587270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a8b94-91d6-4216-bc0e-8deb73ed5f3e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:40.587555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a8b94-91d6-4216-bc0e-8deb73ed5f3e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:40.587946 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a8b94-91d6-4216-bc0e-8deb73ed5f3e None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:40.588663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a8b94-91d6-4216-bc0e-8deb73ed5f3e None admin] RBAC: Adding query filter params (type=image) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:40.588976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a8b94-91d6-4216-bc0e-8deb73ed5f3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:40.589089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51a6f6-1443-46e5-ae0f-21060928d587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:40.590377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a8b94-91d6-4216-bc0e-8deb73ed5f3e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:40.590526 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51a6f6-1443-46e5-ae0f-21060928d587 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:40.601783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 506/1029] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:40.602497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a8b94-91d6-4216-bc0e-8deb73ed5f3e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-cf51a6f6-1443-46e5-ae0f-21060928d587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:40.614552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:40.615627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:40.616755 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:40.616755 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:40.616755 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:40.616755 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:40.620529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 524/1030] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:40.621410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51a6f6-1443-46e5-ae0f-21060928d587 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:40.713120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a8b94-91d6-4216-bc0e-8deb73ed5f3e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:40.726854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51a6f6-1443-46e5-ae0f-21060928d587 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:40.737899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:40.751156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f64a8-53b7-424b-a89f-a98ee7c9003f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:40.751813 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f64a8-53b7-424b-a89f-a98ee7c9003f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:40.752101 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f64a8-53b7-424b-a89f-a98ee7c9003f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:40.752379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f64a8-53b7-424b-a89f-a98ee7c9003f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:40.753370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f64a8-53b7-424b-a89f-a98ee7c9003f None admin] RBAC: Adding query filter params (interface=public, service_id=b78df2d2ce8e48c7a0a5d284ac3010ac, region_id=RegionOne) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:40.753689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f64a8-53b7-424b-a89f-a98ee7c9003f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:40.755052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f64a8-53b7-424b-a89f-a98ee7c9003f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:40.761958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4cee4-1c7c-47b5-b534-52bba3ea7428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:40.763888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4cee4-1c7c-47b5-b534-52bba3ea7428 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:40.764283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4cee4-1c7c-47b5-b534-52bba3ea7428 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:40.764790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4cee4-1c7c-47b5-b534-52bba3ea7428 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:40.765566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4cee4-1c7c-47b5-b534-52bba3ea7428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:40.765972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 507/1031] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 20 17:37:40 2022] GET /identity/v3/endpoints?service_id=b78df2d2ce8e48c7a0a5d284ac3010ac&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:40.766566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4cee4-1c7c-47b5-b534-52bba3ea7428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:40.766730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f64a8-53b7-424b-a89f-a98ee7c9003f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:40.768468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4cee4-1c7c-47b5-b534-52bba3ea7428 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:40.769476 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:40.783326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 525/1032] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:40.789378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4cee4-1c7c-47b5-b534-52bba3ea7428 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:40.876086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f64a8-53b7-424b-a89f-a98ee7c9003f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:40.894550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4cee4-1c7c-47b5-b534-52bba3ea7428 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:40.914898 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1dd0c-257d-4bea-abf5-150540d8a72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:40.915566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1dd0c-257d-4bea-abf5-150540d8a72a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:40.915846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1dd0c-257d-4bea-abf5-150540d8a72a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:40.916116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1dd0c-257d-4bea-abf5-150540d8a72a None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:40.917426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1dd0c-257d-4bea-abf5-150540d8a72a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:40.919110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1dd0c-257d-4bea-abf5-150540d8a72a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:40.936514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 508/1033] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 20 17:37:40 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:37:40.941384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5fab0-9326-40af-b3ea-588b1c7f7c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:40.942307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5fab0-9326-40af-b3ea-588b1c7f7c22 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:40.942687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5fab0-9326-40af-b3ea-588b1c7f7c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:40.943037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5fab0-9326-40af-b3ea-588b1c7f7c22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:40.952635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5fab0-9326-40af-b3ea-588b1c7f7c22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:40.954259 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5fab0-9326-40af-b3ea-588b1c7f7c22 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-97d5fab0-9326-40af-b3ea-588b1c7f7c22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:40.972386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:40.973452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:40.974430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:40.974430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:40.974430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:40.974430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:40.974430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:40.974430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:40.974430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:40.974430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:40.974430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:37:40.974430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:40.976869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 526/1034] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 20 17:37:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:40.979601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1dd0c-257d-4bea-abf5-150540d8a72a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:41.054595 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:41.097564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1dd0c-257d-4bea-abf5-150540d8a72a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:41.135005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffd6af-db17-4e7a-bf2d-18b00d6af8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:41.135681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffd6af-db17-4e7a-bf2d-18b00d6af8b3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:41.135957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffd6af-db17-4e7a-bf2d-18b00d6af8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:41.136232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffd6af-db17-4e7a-bf2d-18b00d6af8b3 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:41.137096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffd6af-db17-4e7a-bf2d-18b00d6af8b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:41.138033 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffd6af-db17-4e7a-bf2d-18b00d6af8b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:41.139910 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffd6af-db17-4e7a-bf2d-18b00d6af8b3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:41.158538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 509/1035] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 20 17:37:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:41.164852 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5fab0-9326-40af-b3ea-588b1c7f7c22 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:41.199149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:41.275008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5fab0-9326-40af-b3ea-588b1c7f7c22 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:41.310772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2c294-dd59-41dc-8553-f31d45dfb269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:41.311420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2c294-dd59-41dc-8553-f31d45dfb269 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:41.311703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2c294-dd59-41dc-8553-f31d45dfb269 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:41.311977 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2c294-dd59-41dc-8553-f31d45dfb269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:41.381865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2c294-dd59-41dc-8553-f31d45dfb269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:41.383313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2c294-dd59-41dc-8553-f31d45dfb269 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:41.419060 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:41.493481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 527/1036] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:37:41 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:37:41.495025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffd6af-db17-4e7a-bf2d-18b00d6af8b3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:41.550984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45e79e-de5a-4156-9608-5bafb75187d9 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:41.551180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45e79e-de5a-4156-9608-5bafb75187d9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:41.551455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45e79e-de5a-4156-9608-5bafb75187d9 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:41.553012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 528/1037] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:37:41.558052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24291f44-0df1-4885-acc0-955e03c7b8b1 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:41.558343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24291f44-0df1-4885-acc0-955e03c7b8b1 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:41.558621 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24291f44-0df1-4885-acc0-955e03c7b8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:41.576101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-24291f44-0df1-4885-acc0-955e03c7b8b1 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:41.577351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-24291f44-0df1-4885-acc0-955e03c7b8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:41.601869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffd6af-db17-4e7a-bf2d-18b00d6af8b3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:41.628858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:41.641146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46874198-c2f0-472d-8976-c74fe5ea4bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:41.641954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46874198-c2f0-472d-8976-c74fe5ea4bde None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:41.642236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46874198-c2f0-472d-8976-c74fe5ea4bde None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:41.642522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46874198-c2f0-472d-8976-c74fe5ea4bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:41.647999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 529/1038] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:41.657674 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46874198-c2f0-472d-8976-c74fe5ea4bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:41.659148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46874198-c2f0-472d-8976-c74fe5ea4bde None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:41.674198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24291f44-0df1-4885-acc0-955e03c7b8b1 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-46874198-c2f0-472d-8976-c74fe5ea4bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:41.677740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:41.678835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:41.679810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:41.679810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:41.679810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:41.679810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:41.680743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 510/1039] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:41.685157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46874198-c2f0-472d-8976-c74fe5ea4bde None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:41.741606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:41.785486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24291f44-0df1-4885-acc0-955e03c7b8b1 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:41.795001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46874198-c2f0-472d-8976-c74fe5ea4bde None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:41.821315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a934e-1acd-4559-b714-e1afa000fc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:41.822026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a934e-1acd-4559-b714-e1afa000fc5b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:41.822305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a934e-1acd-4559-b714-e1afa000fc5b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:41.822589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a934e-1acd-4559-b714-e1afa000fc5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:41.823779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a934e-1acd-4559-b714-e1afa000fc5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:41.825341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a934e-1acd-4559-b714-e1afa000fc5b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:41.827125 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 530/1040] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:41.832547 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a934e-1acd-4559-b714-e1afa000fc5b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:41.835769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66541b4-90ba-4315-bf98-f26b3ea062b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:41.836439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66541b4-90ba-4315-bf98-f26b3ea062b0 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:41.836750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66541b4-90ba-4315-bf98-f26b3ea062b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:41.837028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66541b4-90ba-4315-bf98-f26b3ea062b0 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:41.837756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66541b4-90ba-4315-bf98-f26b3ea062b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:41.838076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66541b4-90ba-4315-bf98-f26b3ea062b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:41.839444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66541b4-90ba-4315-bf98-f26b3ea062b0 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:41.858984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 511/1041] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:41.860376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66541b4-90ba-4315-bf98-f26b3ea062b0 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:41.897853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:41.941120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a934e-1acd-4559-b714-e1afa000fc5b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:41.968838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:41.970518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66541b4-90ba-4315-bf98-f26b3ea062b0 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:41.976460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730c4f4-597f-42a1-a92f-b8ef2747c6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:41.977164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730c4f4-597f-42a1-a92f-b8ef2747c6bd None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:41.982498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730c4f4-597f-42a1-a92f-b8ef2747c6bd None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:41.982498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730c4f4-597f-42a1-a92f-b8ef2747c6bd None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:41.982498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730c4f4-597f-42a1-a92f-b8ef2747c6bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:41.982498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730c4f4-597f-42a1-a92f-b8ef2747c6bd None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:42.006569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73614daa-bf76-4b69-ab5e-fc92de89847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:42.007373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73614daa-bf76-4b69-ab5e-fc92de89847e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:42.007644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73614daa-bf76-4b69-ab5e-fc92de89847e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:42.007949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73614daa-bf76-4b69-ab5e-fc92de89847e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:42.015028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73614daa-bf76-4b69-ab5e-fc92de89847e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:42.016580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73614daa-bf76-4b69-ab5e-fc92de89847e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-73614daa-bf76-4b69-ab5e-fc92de89847e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:42.031547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:42.032720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:42.033766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:42.033766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:42.033766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:42.033766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:42.033766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:42.033766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:42.033766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:42.033766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:42.033766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 512/1042] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:42.038885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73614daa-bf76-4b69-ab5e-fc92de89847e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:42.129668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 531/1043] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:37:41 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:37:42.145023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:42.151777 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73614daa-bf76-4b69-ab5e-fc92de89847e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:42.192893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb04b5-22fd-461f-875c-f5a2c96aeb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:42.193577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb04b5-22fd-461f-875c-f5a2c96aeb15 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:42.193863 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb04b5-22fd-461f-875c-f5a2c96aeb15 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:42.194137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb04b5-22fd-461f-875c-f5a2c96aeb15 None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:42.195097 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb04b5-22fd-461f-875c-f5a2c96aeb15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:42.195413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb04b5-22fd-461f-875c-f5a2c96aeb15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:42.196916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb04b5-22fd-461f-875c-f5a2c96aeb15 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:42.210566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 513/1044] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:42.217065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730c4f4-597f-42a1-a92f-b8ef2747c6bd None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:42.336991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730c4f4-597f-42a1-a92f-b8ef2747c6bd None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:42.374152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdae764-1828-47b2-95be-0e1d351fe0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:42.374817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdae764-1828-47b2-95be-0e1d351fe0a4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:42.375098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdae764-1828-47b2-95be-0e1d351fe0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:42.375371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdae764-1828-47b2-95be-0e1d351fe0a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:42.376213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdae764-1828-47b2-95be-0e1d351fe0a4 None admin] RBAC: Adding query filter params (role.id=8066522d348444c39a987e22e5767068, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=3b52e88df44d49b186d54a8d045595ed) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:42.376555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdae764-1828-47b2-95be-0e1d351fe0a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:42.378016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdae764-1828-47b2-95be-0e1d351fe0a4 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:42.384629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 532/1045] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:37:42 2022] GET /identity/v3/role_assignments?user.id=3b52e88df44d49b186d54a8d045595ed&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=8066522d348444c39a987e22e5767068 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:43.011903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23d95-2d0d-4055-96e4-a18cb513983d None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:43.013015 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23d95-2d0d-4055-96e4-a18cb513983d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:43.013015 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23d95-2d0d-4055-96e4-a18cb513983d None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:43.014378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 514/1046] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:43.019740 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857070d-447e-467f-bd90-88985476fce7 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:43.020186 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857070d-447e-467f-bd90-88985476fce7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:43.020288 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857070d-447e-467f-bd90-88985476fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:43.038302 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-c857070d-447e-467f-bd90-88985476fce7 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:43.039507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c857070d-447e-467f-bd90-88985476fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:43.090203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:43.116752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 533/1047] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:43.140938 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca23d95-2d0d-4055-96e4-a18cb513983d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:43.256241 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca23d95-2d0d-4055-96e4-a18cb513983d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:43.295178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df6e8d-64fb-4176-b6db-647bbe3623e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:43.295893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df6e8d-64fb-4176-b6db-647bbe3623e0 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:43.296174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df6e8d-64fb-4176-b6db-647bbe3623e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:43.296453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df6e8d-64fb-4176-b6db-647bbe3623e0 None admin] PATH_INFO: `/v3/services/image` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:43.297131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df6e8d-64fb-4176-b6db-647bbe3623e0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:43.298507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df6e8d-64fb-4176-b6db-647bbe3623e0 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-c0df6e8d-64fb-4176-b6db-647bbe3623e0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:43.310531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:43.311648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:43.313102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 515/1048] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Jul 20 17:37:43 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:43.317855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857070d-447e-467f-bd90-88985476fce7 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:43.431823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857070d-447e-467f-bd90-88985476fce7 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:43.468772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6699baf-9dbb-4ac1-a0df-7e85e3f08a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:43.469503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6699baf-9dbb-4ac1-a0df-7e85e3f08a5a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:43.469790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6699baf-9dbb-4ac1-a0df-7e85e3f08a5a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:43.470062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6699baf-9dbb-4ac1-a0df-7e85e3f08a5a None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:43.470768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6699baf-9dbb-4ac1-a0df-7e85e3f08a5a None admin] RBAC: Adding query filter params (name=image) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:43.471072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6699baf-9dbb-4ac1-a0df-7e85e3f08a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:43.472434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6699baf-9dbb-4ac1-a0df-7e85e3f08a5a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:43.482490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 534/1049] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:43.483443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df6e8d-64fb-4176-b6db-647bbe3623e0 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:43.509455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:43.591124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df6e8d-64fb-4176-b6db-647bbe3623e0 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:43.634657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed3385-f71f-4687-ae9f-e3e3177dadfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:43.635325 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed3385-f71f-4687-ae9f-e3e3177dadfb None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:43.635611 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed3385-f71f-4687-ae9f-e3e3177dadfb None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:43.635888 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed3385-f71f-4687-ae9f-e3e3177dadfb None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:43.636628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed3385-f71f-4687-ae9f-e3e3177dadfb None admin] RBAC: Adding query filter params (type=image) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:43.636942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed3385-f71f-4687-ae9f-e3e3177dadfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:43.638492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed3385-f71f-4687-ae9f-e3e3177dadfb None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:43.643762 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 516/1050] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:43.649403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6699baf-9dbb-4ac1-a0df-7e85e3f08a5a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:43.704308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:43.763306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6699baf-9dbb-4ac1-a0df-7e85e3f08a5a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:43.800030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4fa68-cade-49e2-9e47-69a855de68c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:43.800030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4fa68-cade-49e2-9e47-69a855de68c2 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:43.800030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4fa68-cade-49e2-9e47-69a855de68c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:43.800030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4fa68-cade-49e2-9e47-69a855de68c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:43.800804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4fa68-cade-49e2-9e47-69a855de68c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:43.802180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4fa68-cade-49e2-9e47-69a855de68c2 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:43.908618 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 535/1051] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 20 17:37:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:37:44.440269 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ebc5-f7ca-4a4c-876f-98747802b13d None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:44.440819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ebc5-f7ca-4a4c-876f-98747802b13d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:44.440922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ebc5-f7ca-4a4c-876f-98747802b13d None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:44.442237 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 517/1052] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:44.448085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf6a14-ba99-48ed-a497-ca104b9c490d None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:44.448607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf6a14-ba99-48ed-a497-ca104b9c490d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:44.448695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf6a14-ba99-48ed-a497-ca104b9c490d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:44.467988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc508b-609a-461d-8f10-616c7c508bf7 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:44.468350 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc508b-609a-461d-8f10-616c7c508bf7 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:44.468748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc508b-609a-461d-8f10-616c7c508bf7 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:44.472509 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 518/1053] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:44.473714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-2adf6a14-ba99-48ed-a497-ca104b9c490d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:44.474931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2adf6a14-ba99-48ed-a497-ca104b9c490d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:44.475460 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da151f4-9db5-43aa-941d-e65d736ed9c1 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:44.475778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da151f4-9db5-43aa-941d-e65d736ed9c1 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:44.476103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da151f4-9db5-43aa-941d-e65d736ed9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:44.494300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-5da151f4-9db5-43aa-941d-e65d736ed9c1 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:44.495494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5da151f4-9db5-43aa-941d-e65d736ed9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:44.584559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 536/1054] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:44.587395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 519/1055] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:44.605266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf6a14-ba99-48ed-a497-ca104b9c490d None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:44.615102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da151f4-9db5-43aa-941d-e65d736ed9c1 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:44.631355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:44.639008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:44.729972 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf6a14-ba99-48ed-a497-ca104b9c490d None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:44.739589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da151f4-9db5-43aa-941d-e65d736ed9c1 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:44.777816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f5d87-c29d-45d1-8625-48e9f195e244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:44.779637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f5d87-c29d-45d1-8625-48e9f195e244 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:44.779925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f5d87-c29d-45d1-8625-48e9f195e244 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:44.780042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd380ca3-c8c7-468d-996f-42a42cfdb9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:44.780790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f5d87-c29d-45d1-8625-48e9f195e244 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:44.780894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd380ca3-c8c7-468d-996f-42a42cfdb9e3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:44.781126 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd380ca3-c8c7-468d-996f-42a42cfdb9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:44.781401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd380ca3-c8c7-468d-996f-42a42cfdb9e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:44.791672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f5d87-c29d-45d1-8625-48e9f195e244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:44.792090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd380ca3-c8c7-468d-996f-42a42cfdb9e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-4a3f5d87-c29d-45d1-8625-48e9f195e244 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:44.800688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:44.801637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:44.807766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:44.807766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:44.807766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:44.807766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:44.807766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:44.807766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:44.807766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:44.807766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:44.807766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:44.807766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:44.807766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:37:44.807766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-fd380ca3-c8c7-468d-996f-42a42cfdb9e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:44.808431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:44.809579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:44.811983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 520/1057] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jul 20 17:37:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:44.813252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 537/1057] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:37:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:44.813335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd380ca3-c8c7-468d-996f-42a42cfdb9e3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:44.813413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f5d87-c29d-45d1-8625-48e9f195e244 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:44.896413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:44.903506 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:44.920355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f5d87-c29d-45d1-8625-48e9f195e244 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:44.922910 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd380ca3-c8c7-468d-996f-42a42cfdb9e3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:44.956501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7a2b3-7168-42df-9abd-74abfa1b3370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:44.957580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7a2b3-7168-42df-9abd-74abfa1b3370 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:44.957764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1b8d2-205d-4fcd-8e87-f3a6c08fa709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:44.958257 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7a2b3-7168-42df-9abd-74abfa1b3370 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:44.958433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1b8d2-205d-4fcd-8e87-f3a6c08fa709 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:44.958724 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1b8d2-205d-4fcd-8e87-f3a6c08fa709 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:44.959005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1b8d2-205d-4fcd-8e87-f3a6c08fa709 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:44.959267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7a2b3-7168-42df-9abd-74abfa1b3370 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:44.959760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1b8d2-205d-4fcd-8e87-f3a6c08fa709 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:44.960072 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1b8d2-205d-4fcd-8e87-f3a6c08fa709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:44.960819 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7a2b3-7168-42df-9abd-74abfa1b3370 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:44.961322 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7a2b3-7168-42df-9abd-74abfa1b3370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:44.961479 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1b8d2-205d-4fcd-8e87-f3a6c08fa709 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:44.963133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7a2b3-7168-42df-9abd-74abfa1b3370 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:44.972511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 521/1058] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 20 17:37:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:44.976356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1b8d2-205d-4fcd-8e87-f3a6c08fa709 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:44.982625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 538/1059] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:37:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:44.983722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7a2b3-7168-42df-9abd-74abfa1b3370 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:45.098510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1b8d2-205d-4fcd-8e87-f3a6c08fa709 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:45.111761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7a2b3-7168-42df-9abd-74abfa1b3370 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:45.137615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f142c-8bf7-4d4d-b857-3d903a088e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:45.138526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f142c-8bf7-4d4d-b857-3d903a088e25 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:45.138815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f142c-8bf7-4d4d-b857-3d903a088e25 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:45.139203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f142c-8bf7-4d4d-b857-3d903a088e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:45.142977 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:45.147107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccab70-e4b4-4cc8-a1f1-a346ff5ec5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:45.147992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccab70-e4b4-4cc8-a1f1-a346ff5ec5a1 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:45.148269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccab70-e4b4-4cc8-a1f1-a346ff5ec5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:45.148572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccab70-e4b4-4cc8-a1f1-a346ff5ec5a1 None admin] PATH_INFO: `/v3/users/76e35d8c78a947e99f43f930447bd5ad` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:45.153537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f142c-8bf7-4d4d-b857-3d903a088e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:45.155217 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f142c-8bf7-4d4d-b857-3d903a088e25 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:45.164174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccab70-e4b4-4cc8-a1f1-a346ff5ec5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=76e35d8c78a947e99f43f930447bd5ad)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:45.165664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccab70-e4b4-4cc8-a1f1-a346ff5ec5a1 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:45.167568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 539/1060] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:37:44 2022] GET /identity/v3/users/76e35d8c78a947e99f43f930447bd5ad => generated 285 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:45.173571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccab70-e4b4-4cc8-a1f1-a346ff5ec5a1 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-727f142c-8bf7-4d4d-b857-3d903a088e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:45.176374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:45.177439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:45.178437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:45.178437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:45.178437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:45.178437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:45.178695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:45.182013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 522/1061] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:45.187684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f142c-8bf7-4d4d-b857-3d903a088e25 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:45.297821 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccab70-e4b4-4cc8-a1f1-a346ff5ec5a1 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:45.304163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f142c-8bf7-4d4d-b857-3d903a088e25 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:45.334959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709103e-bdbd-4574-bcf4-8d21b0fa3fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:45.335631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709103e-bdbd-4574-bcf4-8d21b0fa3fb8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:45.335893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709103e-bdbd-4574-bcf4-8d21b0fa3fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:45.336225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709103e-bdbd-4574-bcf4-8d21b0fa3fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:45.341102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d132c-f54b-404d-9fae-ba30db160444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:45.341794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d132c-f54b-404d-9fae-ba30db160444 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:45.342081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d132c-f54b-404d-9fae-ba30db160444 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:45.342359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d132c-f54b-404d-9fae-ba30db160444 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:45.343093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d132c-f54b-404d-9fae-ba30db160444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:45.343402 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d132c-f54b-404d-9fae-ba30db160444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:45.344846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d132c-f54b-404d-9fae-ba30db160444 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:45.358271 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 523/1062] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:45.363937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d132c-f54b-404d-9fae-ba30db160444 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:45.418796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709103e-bdbd-4574-bcf4-8d21b0fa3fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:45.420364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709103e-bdbd-4574-bcf4-8d21b0fa3fb8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:45.423243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:45.423821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:45.482278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d132c-f54b-404d-9fae-ba30db160444 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:45.523028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6839623-34d2-4362-9d76-40542c86fc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:45.524236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6839623-34d2-4362-9d76-40542c86fc8e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:45.524661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 540/1063] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:37:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 17:37:45.525430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6839623-34d2-4362-9d76-40542c86fc8e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:45.525980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6839623-34d2-4362-9d76-40542c86fc8e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:45.531950 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709103e-bdbd-4574-bcf4-8d21b0fa3fb8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:45.537773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6839623-34d2-4362-9d76-40542c86fc8e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:45.539225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6839623-34d2-4362-9d76-40542c86fc8e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-f6839623-34d2-4362-9d76-40542c86fc8e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:45.554612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:45.555662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:45.557227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:45.557227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:45.557227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:45.557227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:45.557227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:45.557227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:45.557227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:45.557227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:45.557227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:37:45.557227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:45.557227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 524/1064] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 20 17:37:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:45.561871 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6839623-34d2-4362-9d76-40542c86fc8e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:45.648491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709103e-bdbd-4574-bcf4-8d21b0fa3fb8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:45.653101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:45.682660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6839623-34d2-4362-9d76-40542c86fc8e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:45.694575 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:45.697554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ffa91-6f5e-462a-bc35-8f7d0e84f33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:45.698448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ffa91-6f5e-462a-bc35-8f7d0e84f33d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:45.698736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ffa91-6f5e-462a-bc35-8f7d0e84f33d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:45.699010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ffa91-6f5e-462a-bc35-8f7d0e84f33d None admin] PATH_INFO: `/v3/projects/5d960c6aef344b898ea680956c46e330` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:45.701013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ffa91-6f5e-462a-bc35-8f7d0e84f33d None admin] RBAC: Authorizing `identity:get_project(project_id=5d960c6aef344b898ea680956c46e330)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:45.702494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ffa91-6f5e-462a-bc35-8f7d0e84f33d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:45.704330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 541/1065] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:37:45 2022] GET /identity/v3/projects/5d960c6aef344b898ea680956c46e330 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:45.710618 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ffa91-6f5e-462a-bc35-8f7d0e84f33d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:45.725446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c100608-79ba-44f2-92bd-162b9bed8f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:45.726384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c100608-79ba-44f2-92bd-162b9bed8f13 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:45.726823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c100608-79ba-44f2-92bd-162b9bed8f13 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:45.727248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c100608-79ba-44f2-92bd-162b9bed8f13 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:45.728375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c100608-79ba-44f2-92bd-162b9bed8f13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:45.729010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c100608-79ba-44f2-92bd-162b9bed8f13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:45.730813 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c100608-79ba-44f2-92bd-162b9bed8f13 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:45.754023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 525/1066] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 20 17:37:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:45.759407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c100608-79ba-44f2-92bd-162b9bed8f13 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:45.826496 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ffa91-6f5e-462a-bc35-8f7d0e84f33d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:45.867749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda1ce1-bf25-4b01-a587-072bf7bc7ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:45.868735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda1ce1-bf25-4b01-a587-072bf7bc7ee1 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:45.869260 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda1ce1-bf25-4b01-a587-072bf7bc7ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:45.869813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda1ce1-bf25-4b01-a587-072bf7bc7ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:45.870652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda1ce1-bf25-4b01-a587-072bf7bc7ee1 None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=5d960c6aef344b898ea680956c46e330, user.id=76e35d8c78a947e99f43f930447bd5ad) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:45.870970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda1ce1-bf25-4b01-a587-072bf7bc7ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:45.873463 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda1ce1-bf25-4b01-a587-072bf7bc7ee1 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:45.876359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c100608-79ba-44f2-92bd-162b9bed8f13 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:45.879918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 542/1067] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:37:45 2022] GET /identity/v3/role_assignments?user.id=76e35d8c78a947e99f43f930447bd5ad&scope.project.id=5d960c6aef344b898ea680956c46e330&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:45.922443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf790186-b542-4905-a3d6-1d8b7625f7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:45.923258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf790186-b542-4905-a3d6-1d8b7625f7e5 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:45.923541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf790186-b542-4905-a3d6-1d8b7625f7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:45.923817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf790186-b542-4905-a3d6-1d8b7625f7e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:45.937544 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf790186-b542-4905-a3d6-1d8b7625f7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:45.939106 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf790186-b542-4905-a3d6-1d8b7625f7e5 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-cf790186-b542-4905-a3d6-1d8b7625f7e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:45.960753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:45.961737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:45.962890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:45.962890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:45.962890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:45.962890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:45.962890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 526/1068] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:45.967997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda1ce1-bf25-4b01-a587-072bf7bc7ee1 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:46.013022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:46.049316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59524047-6a53-4b96-88b0-3a791b9eae22 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:46.049647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59524047-6a53-4b96-88b0-3a791b9eae22 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:46.049870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59524047-6a53-4b96-88b0-3a791b9eae22 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:46.051374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 527/1069] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:37:46.057025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf4255-759a-474c-9861-d842bb6cb0d6 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:46.057307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf4255-759a-474c-9861-d842bb6cb0d6 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:46.057587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf4255-759a-474c-9861-d842bb6cb0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:46.077465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e9bf4255-759a-474c-9861-d842bb6cb0d6 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:46.078597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e9bf4255-759a-474c-9861-d842bb6cb0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:46.090235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda1ce1-bf25-4b01-a587-072bf7bc7ee1 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:46.093947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:46.129156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13896af2-1d77-49c4-9c91-9d57e20f3aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:46.130022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13896af2-1d77-49c4-9c91-9d57e20f3aa8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:46.130413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13896af2-1d77-49c4-9c91-9d57e20f3aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:46.130797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13896af2-1d77-49c4-9c91-9d57e20f3aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:46.131661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13896af2-1d77-49c4-9c91-9d57e20f3aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:46.132073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13896af2-1d77-49c4-9c91-9d57e20f3aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:46.133572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13896af2-1d77-49c4-9c91-9d57e20f3aa8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:46.150853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 543/1070] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:46.151966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13896af2-1d77-49c4-9c91-9d57e20f3aa8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:46.160521 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 528/1071] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:46.183970 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf4255-759a-474c-9861-d842bb6cb0d6 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:46.260887 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:46.268233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13896af2-1d77-49c4-9c91-9d57e20f3aa8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:46.295572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf4255-759a-474c-9861-d842bb6cb0d6 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:46.308805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04920332-d3bd-4abb-b823-f607cc7bb751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:46.310427 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04920332-d3bd-4abb-b823-f607cc7bb751 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:46.310801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04920332-d3bd-4abb-b823-f607cc7bb751 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:46.311150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04920332-d3bd-4abb-b823-f607cc7bb751 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:46.318976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04920332-d3bd-4abb-b823-f607cc7bb751 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:46.320589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04920332-d3bd-4abb-b823-f607cc7bb751 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-04920332-d3bd-4abb-b823-f607cc7bb751 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:46.335708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:46.336918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:46.338158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:46.338158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:46.338158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:46.338158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:46.338158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:46.338158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:46.338158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:46.338158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:46.338720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9f875-12b4-41fd-92d2-55e372dcc68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:46.338720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9f875-12b4-41fd-92d2-55e372dcc68d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:46.344063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9f875-12b4-41fd-92d2-55e372dcc68d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:46.344159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 544/1072] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:46.344265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9f875-12b4-41fd-92d2-55e372dcc68d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:46.345273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04920332-d3bd-4abb-b823-f607cc7bb751 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:46.368612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:46.434956 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9f875-12b4-41fd-92d2-55e372dcc68d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:46.436699 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9f875-12b4-41fd-92d2-55e372dcc68d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:46.464766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04920332-d3bd-4abb-b823-f607cc7bb751 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:46.502192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb284dc5-be26-4107-a684-9fc57654a991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:46.502868 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb284dc5-be26-4107-a684-9fc57654a991 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:46.503154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb284dc5-be26-4107-a684-9fc57654a991 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:46.503436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb284dc5-be26-4107-a684-9fc57654a991 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:46.504269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb284dc5-be26-4107-a684-9fc57654a991 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:46.504912 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb284dc5-be26-4107-a684-9fc57654a991 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:46.506907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb284dc5-be26-4107-a684-9fc57654a991 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:46.522016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 545/1073] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:46.529522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb284dc5-be26-4107-a684-9fc57654a991 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:46.550847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:46.580174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 529/1074] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:37:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 17:37:46.586116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9f875-12b4-41fd-92d2-55e372dcc68d None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:46.639148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:46.680074 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb284dc5-be26-4107-a684-9fc57654a991 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:46.693066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9f875-12b4-41fd-92d2-55e372dcc68d None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:46.729424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579c7a7-2e96-4b1c-9477-9d53f9678694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:46.730216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c7a7-2e96-4b1c-9477-9d53f9678694 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:46.730503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c7a7-2e96-4b1c-9477-9d53f9678694 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:46.730785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c7a7-2e96-4b1c-9477-9d53f9678694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:46.739883 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d6f53-90a8-4cbe-8cbf-a950baeabdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:46.741477 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6f53-90a8-4cbe-8cbf-a950baeabdd7 None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:46.741958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6f53-90a8-4cbe-8cbf-a950baeabdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:46.742436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6f53-90a8-4cbe-8cbf-a950baeabdd7 None admin] PATH_INFO: `/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/3b52e88df44d49b186d54a8d045595ed/roles/8066522d348444c39a987e22e5767068` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:46.742924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579c7a7-2e96-4b1c-9477-9d53f9678694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:46.744371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579c7a7-2e96-4b1c-9477-9d53f9678694 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:46.746246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d6f53-90a8-4cbe-8cbf-a950baeabdd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f0f8db3986541468c474b78a9b3740a, user_id=3b52e88df44d49b186d54a8d045595ed, role_id=8066522d348444c39a987e22e5767068)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:46.749035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d6f53-90a8-4cbe-8cbf-a950baeabdd7 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-d579c7a7-2e96-4b1c-9477-9d53f9678694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:46.761875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:46.769114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:46.769995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:46.769995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:46.769995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:46.769995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:46.769995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 530/1075] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:46.769995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579c7a7-2e96-4b1c-9477-9d53f9678694 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:46.853371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 546/1076] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:37:46 2022] PUT /identity/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/3b52e88df44d49b186d54a8d045595ed/roles/8066522d348444c39a987e22e5767068 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:37:46.873094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:46.877303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579c7a7-2e96-4b1c-9477-9d53f9678694 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:46.918517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efa494-e10f-4f3e-834d-90069fb09b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:46.920021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efa494-e10f-4f3e-834d-90069fb09b49 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:46.920379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efa494-e10f-4f3e-834d-90069fb09b49 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:46.920747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efa494-e10f-4f3e-834d-90069fb09b49 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:46.921565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efa494-e10f-4f3e-834d-90069fb09b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:46.921942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efa494-e10f-4f3e-834d-90069fb09b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:46.923407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efa494-e10f-4f3e-834d-90069fb09b49 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:46.944510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 531/1077] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:48.007109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e2267-546c-4190-b139-bd9d09ae18ae None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:48.007676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e2267-546c-4190-b139-bd9d09ae18ae None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:48.007676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e2267-546c-4190-b139-bd9d09ae18ae None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:48.009041 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 547/1078] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:48.015506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae6afb-c088-4431-aebf-37516273bfd3 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:48.016105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae6afb-c088-4431-aebf-37516273bfd3 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:48.016105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae6afb-c088-4431-aebf-37516273bfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:48.033211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-52ae6afb-c088-4431-aebf-37516273bfd3 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:48.034265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-52ae6afb-c088-4431-aebf-37516273bfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:48.102917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 532/1079] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:48.125761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e2267-546c-4190-b139-bd9d09ae18ae None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:48.203299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:48.226490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e2267-546c-4190-b139-bd9d09ae18ae None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:48.261463 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7973a3e-93fd-4534-acd1-bf1b747fb594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:48.262177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7973a3e-93fd-4534-acd1-bf1b747fb594 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:48.263047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7973a3e-93fd-4534-acd1-bf1b747fb594 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:48.263347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7973a3e-93fd-4534-acd1-bf1b747fb594 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:48.273588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7973a3e-93fd-4534-acd1-bf1b747fb594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-b7973a3e-93fd-4534-acd1-bf1b747fb594 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:48.281474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:48.282434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:48.283286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 548/1080] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:48.289043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae6afb-c088-4431-aebf-37516273bfd3 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:48.379831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:48.389239 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae6afb-c088-4431-aebf-37516273bfd3 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:48.424142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8833-07fb-403a-9e7d-aaf9a1bb23db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:48.424867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8833-07fb-403a-9e7d-aaf9a1bb23db None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:48.425162 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8833-07fb-403a-9e7d-aaf9a1bb23db None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:48.425442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8833-07fb-403a-9e7d-aaf9a1bb23db None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:48.426197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8833-07fb-403a-9e7d-aaf9a1bb23db None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:48.426508 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8833-07fb-403a-9e7d-aaf9a1bb23db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:48.427928 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8833-07fb-403a-9e7d-aaf9a1bb23db None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:48.438118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 533/1081] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:48.443930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7973a3e-93fd-4534-acd1-bf1b747fb594 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:48.547742 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7973a3e-93fd-4534-acd1-bf1b747fb594 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:48.581235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df31da-eb48-4491-8da7-132dbc057932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:48.582109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df31da-eb48-4491-8da7-132dbc057932 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:48.582417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df31da-eb48-4491-8da7-132dbc057932 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:48.582693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df31da-eb48-4491-8da7-132dbc057932 None admin] PATH_INFO: `/v3/users/76e35d8c78a947e99f43f930447bd5ad` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:48.583892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df31da-eb48-4491-8da7-132dbc057932 None admin] RBAC: Authorizing `identity:get_user(user_id=76e35d8c78a947e99f43f930447bd5ad)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:48.585360 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df31da-eb48-4491-8da7-132dbc057932 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:48.587200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 549/1082] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:37:48 2022] GET /identity/v3/users/76e35d8c78a947e99f43f930447bd5ad => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:37:48.593700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8833-07fb-403a-9e7d-aaf9a1bb23db None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:48.692633 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8833-07fb-403a-9e7d-aaf9a1bb23db None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:48.726072 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c6a5a-96df-4371-9d3a-6bc66732889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:48.726930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c6a5a-96df-4371-9d3a-6bc66732889c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:48.727212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c6a5a-96df-4371-9d3a-6bc66732889c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:48.727488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c6a5a-96df-4371-9d3a-6bc66732889c None admin] PATH_INFO: `/v3/projects/5d960c6aef344b898ea680956c46e330` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:48.728694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c6a5a-96df-4371-9d3a-6bc66732889c None admin] RBAC: Authorizing `identity:get_project(project_id=5d960c6aef344b898ea680956c46e330)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:48.730123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c6a5a-96df-4371-9d3a-6bc66732889c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:48.731878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 534/1083] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:37:48 2022] GET /identity/v3/projects/5d960c6aef344b898ea680956c46e330 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:48.738006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df31da-eb48-4491-8da7-132dbc057932 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:48.741786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:48.843261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df31da-eb48-4491-8da7-132dbc057932 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:48.877765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30bb87-d72f-4462-ad5e-60b48de465a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:48.878660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30bb87-d72f-4462-ad5e-60b48de465a1 None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:48.878946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30bb87-d72f-4462-ad5e-60b48de465a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:48.879224 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30bb87-d72f-4462-ad5e-60b48de465a1 None admin] PATH_INFO: `/v3/projects/5d960c6aef344b898ea680956c46e330/users/76e35d8c78a947e99f43f930447bd5ad/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:48.881193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30bb87-d72f-4462-ad5e-60b48de465a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d960c6aef344b898ea680956c46e330, user_id=76e35d8c78a947e99f43f930447bd5ad, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:48.882630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30bb87-d72f-4462-ad5e-60b48de465a1 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:48.911366 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d74c35-7eef-4cfc-9125-e688168e0674 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:48.911654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d74c35-7eef-4cfc-9125-e688168e0674 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:48.911937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d74c35-7eef-4cfc-9125-e688168e0674 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:48.913654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 535/1084] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:37:48.918343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72211b1-9090-47df-9893-367e4c8a7bde None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:48.918668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72211b1-9090-47df-9893-367e4c8a7bde None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:48.918984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72211b1-9090-47df-9893-367e4c8a7bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:48.936344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d72211b1-9090-47df-9893-367e4c8a7bde None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:48.937614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d72211b1-9090-47df-9893-367e4c8a7bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:48.952587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:48.960686 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 550/1085] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:37:48 2022] PUT /identity/v3/projects/5d960c6aef344b898ea680956c46e330/users/76e35d8c78a947e99f43f930447bd5ad/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:37:49.009809 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 536/1086] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:49.034576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30bb87-d72f-4462-ad5e-60b48de465a1 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:49.102684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:49.142371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30bb87-d72f-4462-ad5e-60b48de465a1 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:49.177009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304133e-5d01-49ef-9a27-54ab63f00d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:49.178025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304133e-5d01-49ef-9a27-54ab63f00d41 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:49.178306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304133e-5d01-49ef-9a27-54ab63f00d41 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:49.178579 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304133e-5d01-49ef-9a27-54ab63f00d41 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:49.189718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304133e-5d01-49ef-9a27-54ab63f00d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-e304133e-5d01-49ef-9a27-54ab63f00d41 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:49.198497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:49.201744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:49.202791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 551/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Jul 20 17:37:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:49.206539 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72211b1-9090-47df-9893-367e4c8a7bde None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:49.309042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72211b1-9090-47df-9893-367e4c8a7bde None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:49.344327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b75c9-92bf-49df-a2a1-3b1c27162989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:49.345027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b75c9-92bf-49df-a2a1-3b1c27162989 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:49.345309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b75c9-92bf-49df-a2a1-3b1c27162989 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:49.345585 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b75c9-92bf-49df-a2a1-3b1c27162989 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:49.346340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b75c9-92bf-49df-a2a1-3b1c27162989 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:49.346650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b75c9-92bf-49df-a2a1-3b1c27162989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:49.348028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b75c9-92bf-49df-a2a1-3b1c27162989 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:49.357257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 537/1088] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 20 17:37:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:49.362782 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304133e-5d01-49ef-9a27-54ab63f00d41 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:49.470457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304133e-5d01-49ef-9a27-54ab63f00d41 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:49.493864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:49.505613 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a9d84-f930-49fc-80cd-ace2f9295c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:49.511964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a9d84-f930-49fc-80cd-ace2f9295c5c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:49.511964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a9d84-f930-49fc-80cd-ace2f9295c5c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:49.511964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a9d84-f930-49fc-80cd-ace2f9295c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:49.519043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a9d84-f930-49fc-80cd-ace2f9295c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:49.520517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a9d84-f930-49fc-80cd-ace2f9295c5c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-4d5a9d84-f930-49fc-80cd-ace2f9295c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:49.539210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:49.540241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:49.541815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:49.541815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:49.541815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:49.541815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:49.541815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 552/1089] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:49.546276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b75c9-92bf-49df-a2a1-3b1c27162989 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:49.562344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:49.649312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b75c9-92bf-49df-a2a1-3b1c27162989 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:49.683802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4bd3e-63b4-463c-9395-fddde275ea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:49.685209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4bd3e-63b4-463c-9395-fddde275ea02 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:49.685494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4bd3e-63b4-463c-9395-fddde275ea02 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:49.685770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4bd3e-63b4-463c-9395-fddde275ea02 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:49.686496 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4bd3e-63b4-463c-9395-fddde275ea02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:49.686804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4bd3e-63b4-463c-9395-fddde275ea02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:49.688178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4bd3e-63b4-463c-9395-fddde275ea02 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:49.700950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 538/1090] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:49.706409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a9d84-f930-49fc-80cd-ace2f9295c5c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:49.806151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a9d84-f930-49fc-80cd-ace2f9295c5c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:49.843644 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4301fa2-3f2e-437d-b785-e8defbe0d0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:49.844433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4301fa2-3f2e-437d-b785-e8defbe0d0af None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:49.844761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4301fa2-3f2e-437d-b785-e8defbe0d0af None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:49.845038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4301fa2-3f2e-437d-b785-e8defbe0d0af None admin] PATH_INFO: `/v3/users/nova` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:49.852647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4301fa2-3f2e-437d-b785-e8defbe0d0af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:49.854077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4301fa2-3f2e-437d-b785-e8defbe0d0af None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-b4301fa2-3f2e-437d-b785-e8defbe0d0af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:37:49.868847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:49.869882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:49.870805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:49.870805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:49.870805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:37:49.870805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:37:49.870805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:37:49.870805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:37:49.870805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:37:49.870805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:37:49.870805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 17:37:49.870805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:49.870805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 553/1091] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Jul 20 17:37:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:49.876611 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4bd3e-63b4-463c-9395-fddde275ea02 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:49.949709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:49.980436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4bd3e-63b4-463c-9395-fddde275ea02 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:50.018395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10a85a-2320-4962-8373-36cb93c35014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:50.019076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10a85a-2320-4962-8373-36cb93c35014 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:50.019342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10a85a-2320-4962-8373-36cb93c35014 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:50.019616 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10a85a-2320-4962-8373-36cb93c35014 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:50.020449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10a85a-2320-4962-8373-36cb93c35014 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:50.020780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10a85a-2320-4962-8373-36cb93c35014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:50.022199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10a85a-2320-4962-8373-36cb93c35014 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:50.041621 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 539/1092] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Jul 20 17:37:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:50.047904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4301fa2-3f2e-437d-b785-e8defbe0d0af None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:50.083893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:50.157616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4301fa2-3f2e-437d-b785-e8defbe0d0af None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:50.194893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c8a8d-8a11-48bf-8998-64f73e4f7367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:50.201043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c8a8d-8a11-48bf-8998-64f73e4f7367 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:50.201043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c8a8d-8a11-48bf-8998-64f73e4f7367 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:50.201043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c8a8d-8a11-48bf-8998-64f73e4f7367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:50.268290 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c8a8d-8a11-48bf-8998-64f73e4f7367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:50.269786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c8a8d-8a11-48bf-8998-64f73e4f7367 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:50.305864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:50.371130 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 554/1093] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:37:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:37:50.377103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10a85a-2320-4962-8373-36cb93c35014 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:50.481745 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10a85a-2320-4962-8373-36cb93c35014 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:50.510254 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:50.516734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8669e6-320e-45ae-9f7a-d8a48e3e7660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:50.521356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8669e6-320e-45ae-9f7a-d8a48e3e7660 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:50.521356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8669e6-320e-45ae-9f7a-d8a48e3e7660 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:50.521356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8669e6-320e-45ae-9f7a-d8a48e3e7660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:50.528852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8669e6-320e-45ae-9f7a-d8a48e3e7660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:50.530567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8669e6-320e-45ae-9f7a-d8a48e3e7660 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-dc8669e6-320e-45ae-9f7a-d8a48e3e7660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:37:50.548468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:50.549810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:50.550780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:37:50.550780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:37:50.550780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:37:50.550780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:50.550780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 540/1094] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:50.555441 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c8a8d-8a11-48bf-8998-64f73e4f7367 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:50.659317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c8a8d-8a11-48bf-8998-64f73e4f7367 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:50.692086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45926643-0c49-414b-97f8-2b1e453aa634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:50.692781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45926643-0c49-414b-97f8-2b1e453aa634 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:50.693065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45926643-0c49-414b-97f8-2b1e453aa634 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:50.693344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45926643-0c49-414b-97f8-2b1e453aa634 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:50.694063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45926643-0c49-414b-97f8-2b1e453aa634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:50.694371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45926643-0c49-414b-97f8-2b1e453aa634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:50.695737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45926643-0c49-414b-97f8-2b1e453aa634 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:50.698084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:50.709063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 555/1095] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:50.716296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8669e6-320e-45ae-9f7a-d8a48e3e7660 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:50.815619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8669e6-320e-45ae-9f7a-d8a48e3e7660 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:50.851571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa7298-db18-40ed-978b-315add47a34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:50.852364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7298-db18-40ed-978b-315add47a34f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:50.852673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7298-db18-40ed-978b-315add47a34f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:50.852953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7298-db18-40ed-978b-315add47a34f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:50.860561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa7298-db18-40ed-978b-315add47a34f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:50.862012 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa7298-db18-40ed-978b-315add47a34f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-aafa7298-db18-40ed-978b-315add47a34f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:37:50.876462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:50.877506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:50.878399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:37:50.878399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:37:50.878399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:37:50.878399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:37:50.878399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:37:50.878399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:37:50.878399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:37:50.878399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:37:50.878399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 541/1096] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:37:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:37:50.883641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45926643-0c49-414b-97f8-2b1e453aa634 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:50.984153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45926643-0c49-414b-97f8-2b1e453aa634 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:51.017662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141d3df-d432-4bb1-bcfc-540373b6fa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:51.018323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141d3df-d432-4bb1-bcfc-540373b6fa02 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:51.018607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141d3df-d432-4bb1-bcfc-540373b6fa02 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:51.018886 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141d3df-d432-4bb1-bcfc-540373b6fa02 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:51.019666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141d3df-d432-4bb1-bcfc-540373b6fa02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:51.019978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141d3df-d432-4bb1-bcfc-540373b6fa02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:51.021433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141d3df-d432-4bb1-bcfc-540373b6fa02 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:51.033582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 556/1097] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:37:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:51.039868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa7298-db18-40ed-978b-315add47a34f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:51.040628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854d927-0044-4b5c-aa58-55d5c976f138 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:51.040925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854d927-0044-4b5c-aa58-55d5c976f138 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:51.041207 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854d927-0044-4b5c-aa58-55d5c976f138 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:51.042555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 557/1098] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:37:51.048774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f7e54-9947-426f-a1fc-10c26d4d1cd9 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:51.049332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f7e54-9947-426f-a1fc-10c26d4d1cd9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:51.049332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f7e54-9947-426f-a1fc-10c26d4d1cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:51.065538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-aa3f7e54-9947-426f-a1fc-10c26d4d1cd9 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:51.066797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-aa3f7e54-9947-426f-a1fc-10c26d4d1cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:51.084518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:51.118538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:51.135530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 558/1099] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:37:51.142733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa7298-db18-40ed-978b-315add47a34f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:51.160548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f7e54-9947-426f-a1fc-10c26d4d1cd9 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:51.177749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4ecd2-d572-435b-b7e8-f4987c9bae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:51.178409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4ecd2-d572-435b-b7e8-f4987c9bae7f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:51.178687 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4ecd2-d572-435b-b7e8-f4987c9bae7f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:51.178958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4ecd2-d572-435b-b7e8-f4987c9bae7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:51.179793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4ecd2-d572-435b-b7e8-f4987c9bae7f None admin] RBAC: Adding query filter params (role.id=8066522d348444c39a987e22e5767068, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=3b52e88df44d49b186d54a8d045595ed) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:51.180098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4ecd2-d572-435b-b7e8-f4987c9bae7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:51.181569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4ecd2-d572-435b-b7e8-f4987c9bae7f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:51.187721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 542/1100] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:37:51 2022] GET /identity/v3/role_assignments?user.id=3b52e88df44d49b186d54a8d045595ed&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=8066522d348444c39a987e22e5767068 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:51.274771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f7e54-9947-426f-a1fc-10c26d4d1cd9 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:51.311195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc932fbc-7624-41bf-9048-7c829241a4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:51.312005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc932fbc-7624-41bf-9048-7c829241a4a4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:51.312293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc932fbc-7624-41bf-9048-7c829241a4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:51.312606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc932fbc-7624-41bf-9048-7c829241a4a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:51.323941 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc932fbc-7624-41bf-9048-7c829241a4a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-fc932fbc-7624-41bf-9048-7c829241a4a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:37:51.331771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:37:51.332825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:37:51.333664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 559/1101] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:37:51.339438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4ecd2-d572-435b-b7e8-f4987c9bae7f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:51.447436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4ecd2-d572-435b-b7e8-f4987c9bae7f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:51.454829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:51.482682 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ba7c2-e418-42c6-af0e-619c7394d0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:51.483347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ba7c2-e418-42c6-af0e-619c7394d0f6 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:51.484173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ba7c2-e418-42c6-af0e-619c7394d0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:51.484173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ba7c2-e418-42c6-af0e-619c7394d0f6 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:51.484664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ba7c2-e418-42c6-af0e-619c7394d0f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:51.485012 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ba7c2-e418-42c6-af0e-619c7394d0f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:51.487225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ba7c2-e418-42c6-af0e-619c7394d0f6 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:51.496021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 543/1102] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:37:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:51.502540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc932fbc-7624-41bf-9048-7c829241a4a4 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:51.552807 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:51.609115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc932fbc-7624-41bf-9048-7c829241a4a4 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:51.644451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a20f2e-0d67-4c5c-a868-643dbbea7da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:51.645349 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a20f2e-0d67-4c5c-a868-643dbbea7da7 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:51.645628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a20f2e-0d67-4c5c-a868-643dbbea7da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:51.645901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a20f2e-0d67-4c5c-a868-643dbbea7da7 None admin] PATH_INFO: `/v3/users/76e35d8c78a947e99f43f930447bd5ad` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:51.647075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a20f2e-0d67-4c5c-a868-643dbbea7da7 None admin] RBAC: Authorizing `identity:get_user(user_id=76e35d8c78a947e99f43f930447bd5ad)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:51.648522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a20f2e-0d67-4c5c-a868-643dbbea7da7 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:51.650442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 560/1103] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:37:51 2022] GET /identity/v3/users/76e35d8c78a947e99f43f930447bd5ad => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:51.656668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ba7c2-e418-42c6-af0e-619c7394d0f6 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:51.765865 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ba7c2-e418-42c6-af0e-619c7394d0f6 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:51.802331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231bab5-41d9-4b32-a06f-196afef2cfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:51.802986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231bab5-41d9-4b32-a06f-196afef2cfb3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:51.803272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231bab5-41d9-4b32-a06f-196afef2cfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:51.803551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231bab5-41d9-4b32-a06f-196afef2cfb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:51.838705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:51.875817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231bab5-41d9-4b32-a06f-196afef2cfb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:51.877217 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231bab5-41d9-4b32-a06f-196afef2cfb3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:51.979692 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 544/1104] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:37:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:37:51.986342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a20f2e-0d67-4c5c-a868-643dbbea7da7 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:52.091368 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a20f2e-0d67-4c5c-a868-643dbbea7da7 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:52.105225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:52.126497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de15a2-3cf9-49dd-a08b-e37854fa41c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:52.127293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de15a2-3cf9-49dd-a08b-e37854fa41c3 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:52.127573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de15a2-3cf9-49dd-a08b-e37854fa41c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:52.127847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de15a2-3cf9-49dd-a08b-e37854fa41c3 None admin] PATH_INFO: `/v3/projects/5d960c6aef344b898ea680956c46e330` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:52.129121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de15a2-3cf9-49dd-a08b-e37854fa41c3 None admin] RBAC: Authorizing `identity:get_project(project_id=5d960c6aef344b898ea680956c46e330)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:52.130651 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de15a2-3cf9-49dd-a08b-e37854fa41c3 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:52.132397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 561/1105] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:37:51 2022] GET /identity/v3/projects/5d960c6aef344b898ea680956c46e330 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:52.139230 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231bab5-41d9-4b32-a06f-196afef2cfb3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:52.206662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:52.240025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231bab5-41d9-4b32-a06f-196afef2cfb3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:52.272653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d4672-d930-438e-9357-6547b6a2d197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:52.273298 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d4672-d930-438e-9357-6547b6a2d197 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:52.273578 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d4672-d930-438e-9357-6547b6a2d197 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:52.273868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d4672-d930-438e-9357-6547b6a2d197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:52.274899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d4672-d930-438e-9357-6547b6a2d197 None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=5d960c6aef344b898ea680956c46e330, user.id=76e35d8c78a947e99f43f930447bd5ad) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:52.275445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d4672-d930-438e-9357-6547b6a2d197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:52.277393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d4672-d930-438e-9357-6547b6a2d197 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:52.284457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 545/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:37:52 2022] GET /identity/v3/role_assignments?user.id=76e35d8c78a947e99f43f930447bd5ad&scope.project.id=5d960c6aef344b898ea680956c46e330&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:54.340668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc070a09-a3bf-4a53-a27e-6a248c2d8a24 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:54.341229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc070a09-a3bf-4a53-a27e-6a248c2d8a24 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:54.341229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc070a09-a3bf-4a53-a27e-6a248c2d8a24 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:54.342563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 562/1107] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:54.347906 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68618a49-4367-4d0f-8d8b-7f92c93d3b94 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:54.348325 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68618a49-4367-4d0f-8d8b-7f92c93d3b94 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:54.348457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68618a49-4367-4d0f-8d8b-7f92c93d3b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:54.365500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-68618a49-4367-4d0f-8d8b-7f92c93d3b94 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:54.366707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-68618a49-4367-4d0f-8d8b-7f92c93d3b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:54.434765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 546/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:54.459990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc070a09-a3bf-4a53-a27e-6a248c2d8a24 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:54.562231 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc070a09-a3bf-4a53-a27e-6a248c2d8a24 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:54.595777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dd767-748a-43c7-a571-1722fd09ab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:54.596509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dd767-748a-43c7-a571-1722fd09ab45 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:54.596795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dd767-748a-43c7-a571-1722fd09ab45 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:54.597065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dd767-748a-43c7-a571-1722fd09ab45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:54.598213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dd767-748a-43c7-a571-1722fd09ab45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:54.599615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dd767-748a-43c7-a571-1722fd09ab45 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:54.601246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 563/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:54.607688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68618a49-4367-4d0f-8d8b-7f92c93d3b94 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:54.667612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:54.706497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68618a49-4367-4d0f-8d8b-7f92c93d3b94 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:54.738951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae29abc-c041-4974-9a21-52fcb43dfef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:54.739617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae29abc-c041-4974-9a21-52fcb43dfef1 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:54.739901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae29abc-c041-4974-9a21-52fcb43dfef1 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:54.740179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae29abc-c041-4974-9a21-52fcb43dfef1 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:54.740915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae29abc-c041-4974-9a21-52fcb43dfef1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:54.742368 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae29abc-c041-4974-9a21-52fcb43dfef1 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:54.834528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 547/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:37:54 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:37:56.904862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6215225-b03e-4989-8e78-b3e1639d5131 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:56.905423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6215225-b03e-4989-8e78-b3e1639d5131 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:56.905423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6215225-b03e-4989-8e78-b3e1639d5131 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:56.906755 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 564/1111] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:56.912767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfefc71-ab6d-49d2-9a2d-913d3de0d195 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:56.913184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfefc71-ab6d-49d2-9a2d-913d3de0d195 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:56.913317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfefc71-ab6d-49d2-9a2d-913d3de0d195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:56.931684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-dcfefc71-ab6d-49d2-9a2d-913d3de0d195 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:56.932949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-dcfefc71-ab6d-49d2-9a2d-913d3de0d195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:37:57.009020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 548/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:37:57.034792 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6215225-b03e-4989-8e78-b3e1639d5131 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:57.089383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:57.144030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6215225-b03e-4989-8e78-b3e1639d5131 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:57.177307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456773d-ef62-4dd7-97fa-97b7d8d68765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:57.178068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456773d-ef62-4dd7-97fa-97b7d8d68765 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:57.178353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456773d-ef62-4dd7-97fa-97b7d8d68765 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:57.178630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456773d-ef62-4dd7-97fa-97b7d8d68765 None admin] PATH_INFO: `/v3/roles/7c97532e07d14d4096b310fb69816951` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:57.180124 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456773d-ef62-4dd7-97fa-97b7d8d68765 None admin] RBAC: Authorizing `identity:get_role(role_id=7c97532e07d14d4096b310fb69816951)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:57.181518 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456773d-ef62-4dd7-97fa-97b7d8d68765 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:57.182913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 565/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:37:57 2022] GET /identity/v3/roles/7c97532e07d14d4096b310fb69816951 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:57.189455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfefc71-ab6d-49d2-9a2d-913d3de0d195 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:57.236689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:57.287747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfefc71-ab6d-49d2-9a2d-913d3de0d195 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:57.323445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbef973-ff86-4349-9fd0-15ef6bf546b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:57.324307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbef973-ff86-4349-9fd0-15ef6bf546b0 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:57.324667 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbef973-ff86-4349-9fd0-15ef6bf546b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:57.325537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbef973-ff86-4349-9fd0-15ef6bf546b0 None admin] PATH_INFO: `/v3/users/f6aa0d10a7844bb386e6f64dc12cd995` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:57.338520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbef973-ff86-4349-9fd0-15ef6bf546b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f6aa0d10a7844bb386e6f64dc12cd995)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:57.339952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbef973-ff86-4349-9fd0-15ef6bf546b0 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:57.342198 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 549/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:37:57 2022] GET /identity/v3/users/f6aa0d10a7844bb386e6f64dc12cd995 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:57.348114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456773d-ef62-4dd7-97fa-97b7d8d68765 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:57.447018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456773d-ef62-4dd7-97fa-97b7d8d68765 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:57.463091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:57.478987 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b151573-5598-47c9-ad26-443037a4d2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:57.479628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b151573-5598-47c9-ad26-443037a4d2bf None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:57.479911 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b151573-5598-47c9-ad26-443037a4d2bf None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:57.480188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b151573-5598-47c9-ad26-443037a4d2bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:57.546245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b151573-5598-47c9-ad26-443037a4d2bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:57.547682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b151573-5598-47c9-ad26-443037a4d2bf None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:57.643936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 566/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:37:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 17:37:57.650114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbef973-ff86-4349-9fd0-15ef6bf546b0 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:57.749448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbef973-ff86-4349-9fd0-15ef6bf546b0 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:57.756842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:57.783808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b9c49-807d-45af-8eb6-743747228c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:57.784694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b9c49-807d-45af-8eb6-743747228c18 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:57.785091 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b9c49-807d-45af-8eb6-743747228c18 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:57.785380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b9c49-807d-45af-8eb6-743747228c18 None admin] PATH_INFO: `/v3/projects/5d960c6aef344b898ea680956c46e330` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:57.786559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b9c49-807d-45af-8eb6-743747228c18 None admin] RBAC: Authorizing `identity:get_project(project_id=5d960c6aef344b898ea680956c46e330)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:57.788317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b9c49-807d-45af-8eb6-743747228c18 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:57.790064 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 550/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:37:57 2022] GET /identity/v3/projects/5d960c6aef344b898ea680956c46e330 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:57.797526 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b151573-5598-47c9-ad26-443037a4d2bf None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:37:57.818582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:37:57.898267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b151573-5598-47c9-ad26-443037a4d2bf None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:37:57.932308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e3a87-3f62-4d30-9083-862c7604ff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:37:57.932991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e3a87-3f62-4d30-9083-862c7604ff23 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:57.933275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e3a87-3f62-4d30-9083-862c7604ff23 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:57.933554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e3a87-3f62-4d30-9083-862c7604ff23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:57.934442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e3a87-3f62-4d30-9083-862c7604ff23 None admin] RBAC: Adding query filter params (role.id=7c97532e07d14d4096b310fb69816951, scope.project.id=5d960c6aef344b898ea680956c46e330, user.id=f6aa0d10a7844bb386e6f64dc12cd995) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:37:57.934755 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e3a87-3f62-4d30-9083-862c7604ff23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:37:57.936162 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e3a87-3f62-4d30-9083-862c7604ff23 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:37:57.941669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 567/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:37:57 2022] GET /identity/v3/role_assignments?user.id=f6aa0d10a7844bb386e6f64dc12cd995&scope.project.id=5d960c6aef344b898ea680956c46e330&role.id=7c97532e07d14d4096b310fb69816951 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:37:59.969453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a1c19-6f1b-4b2b-b847-e904b1fb6de5 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:59.970029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a1c19-6f1b-4b2b-b847-e904b1fb6de5 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:59.970029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a1c19-6f1b-4b2b-b847-e904b1fb6de5 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:59.971380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 551/1118] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:37:59.976820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a4355-2d24-410f-b3bb-869c3129bcb8 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:37:59.977293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a4355-2d24-410f-b3bb-869c3129bcb8 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:37:59.977387 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a4355-2d24-410f-b3bb-869c3129bcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:37:59.994203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-720a4355-2d24-410f-b3bb-869c3129bcb8 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:37:59.995426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-720a4355-2d24-410f-b3bb-869c3129bcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:00.068449 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 568/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:37:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:38:00.091884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a1c19-6f1b-4b2b-b847-e904b1fb6de5 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:00.196706 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a1c19-6f1b-4b2b-b847-e904b1fb6de5 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:00.230725 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b1cb2-4af0-48a7-be3e-71a4fa7e9884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:00.231526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b1cb2-4af0-48a7-be3e-71a4fa7e9884 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:00.231807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b1cb2-4af0-48a7-be3e-71a4fa7e9884 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:00.232082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b1cb2-4af0-48a7-be3e-71a4fa7e9884 None admin] PATH_INFO: `/v3/roles/7c97532e07d14d4096b310fb69816951` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:00.233569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b1cb2-4af0-48a7-be3e-71a4fa7e9884 None admin] RBAC: Authorizing `identity:get_role(role_id=7c97532e07d14d4096b310fb69816951)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:00.234940 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b1cb2-4af0-48a7-be3e-71a4fa7e9884 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:00.236323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 552/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:38:00 2022] GET /identity/v3/roles/7c97532e07d14d4096b310fb69816951 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:00.242277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a4355-2d24-410f-b3bb-869c3129bcb8 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:00.256742 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:00.339272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a4355-2d24-410f-b3bb-869c3129bcb8 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:00.372723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6015-903c-4258-892a-c6014b79d8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:00.373592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6015-903c-4258-892a-c6014b79d8f8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:00.373869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6015-903c-4258-892a-c6014b79d8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:00.374142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6015-903c-4258-892a-c6014b79d8f8 None admin] PATH_INFO: `/v3/users/f6aa0d10a7844bb386e6f64dc12cd995` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:00.375314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca6015-903c-4258-892a-c6014b79d8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=f6aa0d10a7844bb386e6f64dc12cd995)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:00.376763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca6015-903c-4258-892a-c6014b79d8f8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:00.378390 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 569/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:38:00 2022] GET /identity/v3/users/f6aa0d10a7844bb386e6f64dc12cd995 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:00.384194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b1cb2-4af0-48a7-be3e-71a4fa7e9884 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:00.427844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:00.482586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b1cb2-4af0-48a7-be3e-71a4fa7e9884 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:00.515521 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb446fd-cb19-4e59-8a20-435af8efcc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:00.516363 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb446fd-cb19-4e59-8a20-435af8efcc3d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:00.516671 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb446fd-cb19-4e59-8a20-435af8efcc3d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:00.516946 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb446fd-cb19-4e59-8a20-435af8efcc3d None admin] PATH_INFO: `/v3/projects/5d960c6aef344b898ea680956c46e330` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:00.518108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb446fd-cb19-4e59-8a20-435af8efcc3d None admin] RBAC: Authorizing `identity:get_project(project_id=5d960c6aef344b898ea680956c46e330)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:00.519535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb446fd-cb19-4e59-8a20-435af8efcc3d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:00.521263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 553/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:38:00 2022] GET /identity/v3/projects/5d960c6aef344b898ea680956c46e330 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:00.527597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6015-903c-4258-892a-c6014b79d8f8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:00.604907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:00.625033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6015-903c-4258-892a-c6014b79d8f8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:00.658384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813004f-fdb7-4c35-9cc2-80f4fa83df3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:00.659266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813004f-fdb7-4c35-9cc2-80f4fa83df3e None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:00.659546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813004f-fdb7-4c35-9cc2-80f4fa83df3e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:00.659821 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813004f-fdb7-4c35-9cc2-80f4fa83df3e None admin] PATH_INFO: `/v3/projects/5d960c6aef344b898ea680956c46e330/users/f6aa0d10a7844bb386e6f64dc12cd995/roles/7c97532e07d14d4096b310fb69816951` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:00.662020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813004f-fdb7-4c35-9cc2-80f4fa83df3e None admin] RBAC: Authorizing `identity:create_grant(project_id=5d960c6aef344b898ea680956c46e330, user_id=f6aa0d10a7844bb386e6f64dc12cd995, role_id=7c97532e07d14d4096b310fb69816951)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:00.663703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813004f-fdb7-4c35-9cc2-80f4fa83df3e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:00.743811 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 570/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:38:00 2022] PUT /identity/v3/projects/5d960c6aef344b898ea680956c46e330/users/f6aa0d10a7844bb386e6f64dc12cd995/roles/7c97532e07d14d4096b310fb69816951 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:38:02.753465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafd0f8-08bc-4aab-a59d-06e729819b88 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:02.754056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafd0f8-08bc-4aab-a59d-06e729819b88 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:02.754150 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafd0f8-08bc-4aab-a59d-06e729819b88 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:02.755532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 554/1124] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:02.761398 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17ef61-d5e8-4cfc-a668-eb1d1c381978 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:02.761893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17ef61-d5e8-4cfc-a668-eb1d1c381978 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:02.762036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17ef61-d5e8-4cfc-a668-eb1d1c381978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:02.779582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-9d17ef61-d5e8-4cfc-a668-eb1d1c381978 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:02.780848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9d17ef61-d5e8-4cfc-a668-eb1d1c381978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:02.851481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 571/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:38:02.876900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafd0f8-08bc-4aab-a59d-06e729819b88 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:02.979808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafd0f8-08bc-4aab-a59d-06e729819b88 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:02.992038 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:03.015988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c5be3-0371-4e54-99af-0d2bfe69858c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:03.015988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c5be3-0371-4e54-99af-0d2bfe69858c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:03.015988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c5be3-0371-4e54-99af-0d2bfe69858c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:03.016384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c5be3-0371-4e54-99af-0d2bfe69858c None admin] PATH_INFO: `/v3/roles/7c97532e07d14d4096b310fb69816951` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:03.017726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c5be3-0371-4e54-99af-0d2bfe69858c None admin] RBAC: Authorizing `identity:get_role(role_id=7c97532e07d14d4096b310fb69816951)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:03.019085 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c5be3-0371-4e54-99af-0d2bfe69858c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:03.020469 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 555/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:38:02 2022] GET /identity/v3/roles/7c97532e07d14d4096b310fb69816951 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:03.026313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17ef61-d5e8-4cfc-a668-eb1d1c381978 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:03.095468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:03.129844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17ef61-d5e8-4cfc-a668-eb1d1c381978 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:03.164624 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfb648-70b5-4718-9c10-2a39507a6fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:03.165494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfb648-70b5-4718-9c10-2a39507a6fe4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:03.165779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfb648-70b5-4718-9c10-2a39507a6fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:03.166055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfb648-70b5-4718-9c10-2a39507a6fe4 None admin] PATH_INFO: `/v3/users/f6aa0d10a7844bb386e6f64dc12cd995` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:03.167258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfb648-70b5-4718-9c10-2a39507a6fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=f6aa0d10a7844bb386e6f64dc12cd995)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:03.169372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfb648-70b5-4718-9c10-2a39507a6fe4 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:03.171009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 572/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:38:03 2022] GET /identity/v3/users/f6aa0d10a7844bb386e6f64dc12cd995 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:03.176769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c5be3-0371-4e54-99af-0d2bfe69858c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:03.274043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c5be3-0371-4e54-99af-0d2bfe69858c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:03.307233 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480cbf8-fb9c-4f67-b4a3-b2d6dcb40e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:03.307868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480cbf8-fb9c-4f67-b4a3-b2d6dcb40e4c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:03.308152 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480cbf8-fb9c-4f67-b4a3-b2d6dcb40e4c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:03.308431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480cbf8-fb9c-4f67-b4a3-b2d6dcb40e4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:03.353189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:03.376153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480cbf8-fb9c-4f67-b4a3-b2d6dcb40e4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:03.377679 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480cbf8-fb9c-4f67-b4a3-b2d6dcb40e4c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:03.477638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 556/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:38:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:38:03.483247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfb648-70b5-4718-9c10-2a39507a6fe4 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:03.581403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfb648-70b5-4718-9c10-2a39507a6fe4 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:03.614847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf3e72-d7e5-49de-9c65-4a645d73941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:03.615708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf3e72-d7e5-49de-9c65-4a645d73941e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:03.615993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf3e72-d7e5-49de-9c65-4a645d73941e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:03.616272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf3e72-d7e5-49de-9c65-4a645d73941e None admin] PATH_INFO: `/v3/projects/5d960c6aef344b898ea680956c46e330` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:03.617474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf3e72-d7e5-49de-9c65-4a645d73941e None admin] RBAC: Authorizing `identity:get_project(project_id=5d960c6aef344b898ea680956c46e330)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:03.618901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf3e72-d7e5-49de-9c65-4a645d73941e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:03.620630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 573/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:38:03 2022] GET /identity/v3/projects/5d960c6aef344b898ea680956c46e330 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:03.627472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480cbf8-fb9c-4f67-b4a3-b2d6dcb40e4c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:03.704448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:03.725103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480cbf8-fb9c-4f67-b4a3-b2d6dcb40e4c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:03.758978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6ddb5-bf1f-475b-bb56-7b85b34f5b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:03.759641 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6ddb5-bf1f-475b-bb56-7b85b34f5b0d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:03.759922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6ddb5-bf1f-475b-bb56-7b85b34f5b0d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:03.760192 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6ddb5-bf1f-475b-bb56-7b85b34f5b0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:03.761051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6ddb5-bf1f-475b-bb56-7b85b34f5b0d None admin] RBAC: Adding query filter params (role.id=7c97532e07d14d4096b310fb69816951, scope.project.id=5d960c6aef344b898ea680956c46e330, user.id=f6aa0d10a7844bb386e6f64dc12cd995) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:38:03.761379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6ddb5-bf1f-475b-bb56-7b85b34f5b0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:03.763554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6ddb5-bf1f-475b-bb56-7b85b34f5b0d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:03.769453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 557/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:38:03 2022] GET /identity/v3/role_assignments?user.id=f6aa0d10a7844bb386e6f64dc12cd995&scope.project.id=5d960c6aef344b898ea680956c46e330&role.id=7c97532e07d14d4096b310fb69816951 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:05.827117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d9b55-dd96-4f94-882c-866c911c57c3 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:05.827660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d9b55-dd96-4f94-882c-866c911c57c3 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:05.827660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d9b55-dd96-4f94-882c-866c911c57c3 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:05.829118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 574/1131] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:05.834981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c91e4-9535-41fa-9f52-e89ddb1c5169 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:05.835517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c91e4-9535-41fa-9f52-e89ddb1c5169 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:05.835517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c91e4-9535-41fa-9f52-e89ddb1c5169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:05.853300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-f78c91e4-9535-41fa-9f52-e89ddb1c5169 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:05.854511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f78c91e4-9535-41fa-9f52-e89ddb1c5169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:05.927263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 558/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:38:05.950793 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d9b55-dd96-4f94-882c-866c911c57c3 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:05.960006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:06.056895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d9b55-dd96-4f94-882c-866c911c57c3 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:06.091055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf898896-9ac3-4102-bfa8-c1bd929b40fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:06.091787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf898896-9ac3-4102-bfa8-c1bd929b40fb None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:06.092118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf898896-9ac3-4102-bfa8-c1bd929b40fb None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:06.092413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf898896-9ac3-4102-bfa8-c1bd929b40fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:06.093634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf898896-9ac3-4102-bfa8-c1bd929b40fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:06.095155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf898896-9ac3-4102-bfa8-c1bd929b40fb None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:06.096872 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 575/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:06.102683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c91e4-9535-41fa-9f52-e89ddb1c5169 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:06.171816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:06.200391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c91e4-9535-41fa-9f52-e89ddb1c5169 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:06.237045 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b389c03-48fc-461f-96b0-3c0bd967f517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:06.237742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b389c03-48fc-461f-96b0-3c0bd967f517 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:06.238023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b389c03-48fc-461f-96b0-3c0bd967f517 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:06.238298 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b389c03-48fc-461f-96b0-3c0bd967f517 None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:06.239009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b389c03-48fc-461f-96b0-3c0bd967f517 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:06.240425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b389c03-48fc-461f-96b0-3c0bd967f517 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:06.343508 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 559/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:38:06 2022] POST /identity/v3/projects => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:38:08.433135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83690c8c-90eb-4764-9ada-ea003b7eddc1 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:08.433788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83690c8c-90eb-4764-9ada-ea003b7eddc1 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:08.433788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83690c8c-90eb-4764-9ada-ea003b7eddc1 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:08.435759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 576/1135] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:08.441982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcbd30-6491-4d2c-998d-da5e21b0f0c5 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:08.442430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcbd30-6491-4d2c-998d-da5e21b0f0c5 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:08.442571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbcbd30-6491-4d2c-998d-da5e21b0f0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:08.460705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-6dbcbd30-6491-4d2c-998d-da5e21b0f0c5 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:08.461900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6dbcbd30-6491-4d2c-998d-da5e21b0f0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:08.530517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 560/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:38:08.555741 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83690c8c-90eb-4764-9ada-ea003b7eddc1 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:08.631033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:08.657379 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83690c8c-90eb-4764-9ada-ea003b7eddc1 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:08.693936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502902be-d300-4070-8973-c6e97011324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:08.694754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502902be-d300-4070-8973-c6e97011324a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:08.695036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502902be-d300-4070-8973-c6e97011324a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:08.695309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502902be-d300-4070-8973-c6e97011324a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:08.696658 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502902be-d300-4070-8973-c6e97011324a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:08.698119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502902be-d300-4070-8973-c6e97011324a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:08.700381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 577/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:38:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:08.706581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcbd30-6491-4d2c-998d-da5e21b0f0c5 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:08.765251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:08.813332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbcbd30-6491-4d2c-998d-da5e21b0f0c5 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:08.848903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edb59d-4400-4b38-964b-aefc6c9e3e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:08.849594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb59d-4400-4b38-964b-aefc6c9e3e55 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:08.849887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb59d-4400-4b38-964b-aefc6c9e3e55 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:08.850165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb59d-4400-4b38-964b-aefc6c9e3e55 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:08.850896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edb59d-4400-4b38-964b-aefc6c9e3e55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:08.852340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edb59d-4400-4b38-964b-aefc6c9e3e55 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:08.984167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 561/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:38:08 2022] POST /identity/v3/users => generated 286 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:38:11.071348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178cc05-3f84-450f-9b8a-5751bfc56fda None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:11.071910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178cc05-3f84-450f-9b8a-5751bfc56fda None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:11.071910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178cc05-3f84-450f-9b8a-5751bfc56fda None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:11.073294 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 578/1139] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:11.079264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ec53d-5801-49a3-acb1-bdc738569da5 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:11.079693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ec53d-5801-49a3-acb1-bdc738569da5 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:11.079826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ec53d-5801-49a3-acb1-bdc738569da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:11.097120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c20ec53d-5801-49a3-acb1-bdc738569da5 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:11.098319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c20ec53d-5801-49a3-acb1-bdc738569da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:11.164935 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 562/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:38:11.188879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178cc05-3f84-450f-9b8a-5751bfc56fda None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:11.289308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178cc05-3f84-450f-9b8a-5751bfc56fda None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:11.322754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0081f-6cc0-47fb-991c-374d457b550a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:11.323461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0081f-6cc0-47fb-991c-374d457b550a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:11.323738 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0081f-6cc0-47fb-991c-374d457b550a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:11.324010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0081f-6cc0-47fb-991c-374d457b550a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:11.334539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0081f-6cc0-47fb-991c-374d457b550a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-a3b0081f-6cc0-47fb-991c-374d457b550a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:38:11.342287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:38:11.343405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:38:11.344447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 579/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:38:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:38:11.349651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ec53d-5801-49a3-acb1-bdc738569da5 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:11.394583 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:11.453428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ec53d-5801-49a3-acb1-bdc738569da5 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:11.487142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50250ef0-ed51-4de7-976d-068d21fbd06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:11.487811 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50250ef0-ed51-4de7-976d-068d21fbd06e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:11.488094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50250ef0-ed51-4de7-976d-068d21fbd06e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:11.488374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50250ef0-ed51-4de7-976d-068d21fbd06e None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:11.489162 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50250ef0-ed51-4de7-976d-068d21fbd06e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:38:11.489467 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50250ef0-ed51-4de7-976d-068d21fbd06e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:11.490852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50250ef0-ed51-4de7-976d-068d21fbd06e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:11.500548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 563/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:38:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:11.506362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0081f-6cc0-47fb-991c-374d457b550a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:11.509214 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:11.609055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0081f-6cc0-47fb-991c-374d457b550a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:11.642669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e50b0-4510-4c24-ac2f-d868fab98a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:11.643551 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e50b0-4510-4c24-ac2f-d868fab98a01 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:11.643833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e50b0-4510-4c24-ac2f-d868fab98a01 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:11.644110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e50b0-4510-4c24-ac2f-d868fab98a01 None admin] PATH_INFO: `/v3/users/56509a89af5f4b33926a72ece6c7ccf5` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:11.658138 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e50b0-4510-4c24-ac2f-d868fab98a01 None admin] RBAC: Authorizing `identity:get_user(user_id=56509a89af5f4b33926a72ece6c7ccf5)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:11.659593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e50b0-4510-4c24-ac2f-d868fab98a01 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:11.661355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 580/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:38:11 2022] GET /identity/v3/users/56509a89af5f4b33926a72ece6c7ccf5 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:11.667677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50250ef0-ed51-4de7-976d-068d21fbd06e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:11.766293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50250ef0-ed51-4de7-976d-068d21fbd06e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:11.767864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:11.801472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29227a3-cc4b-40ec-85ad-f5170b3fdd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:11.802121 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29227a3-cc4b-40ec-85ad-f5170b3fdd5d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:11.802403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29227a3-cc4b-40ec-85ad-f5170b3fdd5d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:11.802676 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29227a3-cc4b-40ec-85ad-f5170b3fdd5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:11.869076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29227a3-cc4b-40ec-85ad-f5170b3fdd5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:11.870447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29227a3-cc4b-40ec-85ad-f5170b3fdd5d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:11.969123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 564/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:38:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:38:11.975187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e50b0-4510-4c24-ac2f-d868fab98a01 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:12.034029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:12.078379 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e50b0-4510-4c24-ac2f-d868fab98a01 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:12.111366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c4527-c723-4497-9eb1-0f6ee695456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:12.112217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c4527-c723-4497-9eb1-0f6ee695456a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:12.112516 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c4527-c723-4497-9eb1-0f6ee695456a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:12.112789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c4527-c723-4497-9eb1-0f6ee695456a None admin] PATH_INFO: `/v3/projects/2dfa45c7ecb7421c81dc67e5de4ab77d` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:12.113950 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c4527-c723-4497-9eb1-0f6ee695456a None admin] RBAC: Authorizing `identity:get_project(project_id=2dfa45c7ecb7421c81dc67e5de4ab77d)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:12.115353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c4527-c723-4497-9eb1-0f6ee695456a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:12.117075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 581/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:38:11 2022] GET /identity/v3/projects/2dfa45c7ecb7421c81dc67e5de4ab77d => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:12.124374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29227a3-cc4b-40ec-85ad-f5170b3fdd5d None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:12.126751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:12.223002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29227a3-cc4b-40ec-85ad-f5170b3fdd5d None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:12.256971 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8eced-8200-4e85-80ef-9279a22f69cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:12.257642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8eced-8200-4e85-80ef-9279a22f69cc None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:12.257922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8eced-8200-4e85-80ef-9279a22f69cc None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:12.258195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8eced-8200-4e85-80ef-9279a22f69cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:12.259042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8eced-8200-4e85-80ef-9279a22f69cc None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=2dfa45c7ecb7421c81dc67e5de4ab77d, user.id=56509a89af5f4b33926a72ece6c7ccf5) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:38:12.259353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8eced-8200-4e85-80ef-9279a22f69cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:12.260854 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8eced-8200-4e85-80ef-9279a22f69cc None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:12.268088 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 565/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:38:12 2022] GET /identity/v3/role_assignments?user.id=56509a89af5f4b33926a72ece6c7ccf5&scope.project.id=2dfa45c7ecb7421c81dc67e5de4ab77d&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:14.341179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66991397-50df-40c0-b2a7-1dee8450be94 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:14.341813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66991397-50df-40c0-b2a7-1dee8450be94 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:14.341813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66991397-50df-40c0-b2a7-1dee8450be94 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:14.343109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 582/1147] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:14.348534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e6a7c-dcc9-4151-a6d5-dec7c96515de None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:14.348974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e6a7c-dcc9-4151-a6d5-dec7c96515de None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:14.349069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e6a7c-dcc9-4151-a6d5-dec7c96515de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:14.368203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-496e6a7c-dcc9-4151-a6d5-dec7c96515de None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:14.369472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-496e6a7c-dcc9-4151-a6d5-dec7c96515de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:14.430511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:14.437932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 566/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:38:14.460436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66991397-50df-40c0-b2a7-1dee8450be94 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:14.563430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66991397-50df-40c0-b2a7-1dee8450be94 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:14.590257 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:14.598351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8e97b-97aa-4941-b60a-a0171825b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:14.599088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8e97b-97aa-4941-b60a-a0171825b35e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:14.599366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8e97b-97aa-4941-b60a-a0171825b35e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:14.599643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8e97b-97aa-4941-b60a-a0171825b35e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:14.610011 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8e97b-97aa-4941-b60a-a0171825b35e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-66d8e97b-97aa-4941-b60a-a0171825b35e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:38:14.618149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:38:14.619149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:38:14.620051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 583/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:38:14.625837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e6a7c-dcc9-4151-a6d5-dec7c96515de None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:14.735719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e6a7c-dcc9-4151-a6d5-dec7c96515de None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:14.769034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a7a9-354a-42e1-9721-d0b3c14946fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:14.769698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a7a9-354a-42e1-9721-d0b3c14946fc None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:14.769982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a7a9-354a-42e1-9721-d0b3c14946fc None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:14.770260 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a7a9-354a-42e1-9721-d0b3c14946fc None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:14.771004 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913a7a9-354a-42e1-9721-d0b3c14946fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:38:14.771313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913a7a9-354a-42e1-9721-d0b3c14946fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:14.772721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913a7a9-354a-42e1-9721-d0b3c14946fc None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:14.781465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 567/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:14.787358 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8e97b-97aa-4941-b60a-a0171825b35e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:14.887388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8e97b-97aa-4941-b60a-a0171825b35e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:14.920268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef77e1-2338-482a-a353-fd5bdae152bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:14.921170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef77e1-2338-482a-a353-fd5bdae152bd None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:14.921457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef77e1-2338-482a-a353-fd5bdae152bd None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:14.921732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef77e1-2338-482a-a353-fd5bdae152bd None admin] PATH_INFO: `/v3/users/56509a89af5f4b33926a72ece6c7ccf5` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:14.922910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef77e1-2338-482a-a353-fd5bdae152bd None admin] RBAC: Authorizing `identity:get_user(user_id=56509a89af5f4b33926a72ece6c7ccf5)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:14.924332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef77e1-2338-482a-a353-fd5bdae152bd None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:14.926002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 584/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:38:14 2022] GET /identity/v3/users/56509a89af5f4b33926a72ece6c7ccf5 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:14.932014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a7a9-354a-42e1-9721-d0b3c14946fc None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:14.990379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:15.032262 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a7a9-354a-42e1-9721-d0b3c14946fc None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:15.066525 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1298f1-f5a8-4159-92e7-b090ff6616b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:15.067373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1298f1-f5a8-4159-92e7-b090ff6616b5 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:15.067657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1298f1-f5a8-4159-92e7-b090ff6616b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:15.067933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1298f1-f5a8-4159-92e7-b090ff6616b5 None admin] PATH_INFO: `/v3/projects/2dfa45c7ecb7421c81dc67e5de4ab77d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:15.069128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1298f1-f5a8-4159-92e7-b090ff6616b5 None admin] RBAC: Authorizing `identity:get_project(project_id=2dfa45c7ecb7421c81dc67e5de4ab77d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:15.071668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1298f1-f5a8-4159-92e7-b090ff6616b5 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:15.072240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 568/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:38:14 2022] GET /identity/v3/projects/2dfa45c7ecb7421c81dc67e5de4ab77d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:15.079087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef77e1-2338-482a-a353-fd5bdae152bd None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:15.134682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:15.179270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef77e1-2338-482a-a353-fd5bdae152bd None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:15.213609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50140076-f99d-4a76-b314-11f2a27a9ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:15.214494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50140076-f99d-4a76-b314-11f2a27a9ede None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:15.214774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50140076-f99d-4a76-b314-11f2a27a9ede None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:15.215120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50140076-f99d-4a76-b314-11f2a27a9ede None admin] PATH_INFO: `/v3/projects/2dfa45c7ecb7421c81dc67e5de4ab77d/users/56509a89af5f4b33926a72ece6c7ccf5/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:15.217146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50140076-f99d-4a76-b314-11f2a27a9ede None admin] RBAC: Authorizing `identity:create_grant(project_id=2dfa45c7ecb7421c81dc67e5de4ab77d, user_id=56509a89af5f4b33926a72ece6c7ccf5, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:15.218573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50140076-f99d-4a76-b314-11f2a27a9ede None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:15.327227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 585/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:38:15 2022] PUT /identity/v3/projects/2dfa45c7ecb7421c81dc67e5de4ab77d/users/56509a89af5f4b33926a72ece6c7ccf5/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:38:17.394761 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629cd81-c42f-4604-b51f-067393490e9c None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:17.395208 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629cd81-c42f-4604-b51f-067393490e9c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:17.395316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629cd81-c42f-4604-b51f-067393490e9c None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:17.396888 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 569/1154] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:17.401986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb01c0-a3e8-4903-8492-7d802d999f51 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:17.402431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb01c0-a3e8-4903-8492-7d802d999f51 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:17.402543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb01c0-a3e8-4903-8492-7d802d999f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:17.419048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a8eb01c0-a3e8-4903-8492-7d802d999f51 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:17.420229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a8eb01c0-a3e8-4903-8492-7d802d999f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:17.484942 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 586/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:38:17.509217 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629cd81-c42f-4604-b51f-067393490e9c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:17.616732 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629cd81-c42f-4604-b51f-067393490e9c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:17.642572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:17.671265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009743ef-b4a9-4e92-8c99-262f90e1a2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:17.671265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009743ef-b4a9-4e92-8c99-262f90e1a2cb None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:17.671265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009743ef-b4a9-4e92-8c99-262f90e1a2cb None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:17.671265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009743ef-b4a9-4e92-8c99-262f90e1a2cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009743ef-b4a9-4e92-8c99-262f90e1a2cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-009743ef-b4a9-4e92-8c99-262f90e1a2cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:38:17.671713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:38:17.672712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:38:17.673856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 570/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:38:17.678600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb01c0-a3e8-4903-8492-7d802d999f51 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:17.724837 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:17.778214 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb01c0-a3e8-4903-8492-7d802d999f51 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:17.812182 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa52c0f-d505-4dff-8ac7-85d01c4d97c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:17.812863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa52c0f-d505-4dff-8ac7-85d01c4d97c8 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:17.813141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa52c0f-d505-4dff-8ac7-85d01c4d97c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:17.813411 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa52c0f-d505-4dff-8ac7-85d01c4d97c8 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:17.814149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa52c0f-d505-4dff-8ac7-85d01c4d97c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:38:17.814452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa52c0f-d505-4dff-8ac7-85d01c4d97c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:17.815815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa52c0f-d505-4dff-8ac7-85d01c4d97c8 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:17.823787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 587/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:17.830186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009743ef-b4a9-4e92-8c99-262f90e1a2cb None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:17.930022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009743ef-b4a9-4e92-8c99-262f90e1a2cb None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:17.963220 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9b6e4-c19e-483c-9028-16361fac362c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:17.964086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9b6e4-c19e-483c-9028-16361fac362c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:17.964364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9b6e4-c19e-483c-9028-16361fac362c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:17.964670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9b6e4-c19e-483c-9028-16361fac362c None admin] PATH_INFO: `/v3/users/56509a89af5f4b33926a72ece6c7ccf5` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:17.966500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9b6e4-c19e-483c-9028-16361fac362c None admin] RBAC: Authorizing `identity:get_user(user_id=56509a89af5f4b33926a72ece6c7ccf5)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:17.967920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9b6e4-c19e-483c-9028-16361fac362c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:17.969580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 571/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:38:17 2022] GET /identity/v3/users/56509a89af5f4b33926a72ece6c7ccf5 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:17.975555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa52c0f-d505-4dff-8ac7-85d01c4d97c8 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:18.077072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa52c0f-d505-4dff-8ac7-85d01c4d97c8 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:18.085911 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:18.111692 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6632a-772f-407b-b9b0-d9565c08405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:18.112341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6632a-772f-407b-b9b0-d9565c08405c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:18.112656 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6632a-772f-407b-b9b0-d9565c08405c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:18.112932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6632a-772f-407b-b9b0-d9565c08405c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:18.181976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6632a-772f-407b-b9b0-d9565c08405c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:18.183341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6632a-772f-407b-b9b0-d9565c08405c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:18.281471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 588/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:38:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:38:18.287770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9b6e4-c19e-483c-9028-16361fac362c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:18.343560 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:18.388967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9b6e4-c19e-483c-9028-16361fac362c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:18.423609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42dd01-edfd-4740-be1e-c75e4f4a144d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:18.424463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42dd01-edfd-4740-be1e-c75e4f4a144d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:18.424773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42dd01-edfd-4740-be1e-c75e4f4a144d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:18.425047 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42dd01-edfd-4740-be1e-c75e4f4a144d None admin] PATH_INFO: `/v3/projects/2dfa45c7ecb7421c81dc67e5de4ab77d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:18.426221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42dd01-edfd-4740-be1e-c75e4f4a144d None admin] RBAC: Authorizing `identity:get_project(project_id=2dfa45c7ecb7421c81dc67e5de4ab77d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:18.427651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42dd01-edfd-4740-be1e-c75e4f4a144d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:18.429384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 572/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:38:18 2022] GET /identity/v3/projects/2dfa45c7ecb7421c81dc67e5de4ab77d => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:18.435704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6632a-772f-407b-b9b0-d9565c08405c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:18.445653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:18.538901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6632a-772f-407b-b9b0-d9565c08405c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:18.577219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87233293-c3f9-49ec-be2a-deae8d98bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:18.577870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87233293-c3f9-49ec-be2a-deae8d98bf22 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:18.578149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87233293-c3f9-49ec-be2a-deae8d98bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:18.578423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87233293-c3f9-49ec-be2a-deae8d98bf22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:18.579246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87233293-c3f9-49ec-be2a-deae8d98bf22 None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=2dfa45c7ecb7421c81dc67e5de4ab77d, user.id=56509a89af5f4b33926a72ece6c7ccf5) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:38:18.579555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87233293-c3f9-49ec-be2a-deae8d98bf22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:18.580996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87233293-c3f9-49ec-be2a-deae8d98bf22 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:18.586788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 589/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:38:18 2022] GET /identity/v3/role_assignments?user.id=56509a89af5f4b33926a72ece6c7ccf5&scope.project.id=2dfa45c7ecb7421c81dc67e5de4ab77d&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:38:20.669298 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac069127-624a-4436-a24d-5370972d37ed None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:20.669798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac069127-624a-4436-a24d-5370972d37ed None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:20.669798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac069127-624a-4436-a24d-5370972d37ed None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:20.671262 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 573/1162] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:20.676580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780f986-4fe3-4907-89dc-e567ee89f34c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:20.677016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780f986-4fe3-4907-89dc-e567ee89f34c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:20.677140 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780f986-4fe3-4907-89dc-e567ee89f34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:20.694939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-3780f986-4fe3-4907-89dc-e567ee89f34c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:20.696118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3780f986-4fe3-4907-89dc-e567ee89f34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:20.761797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 590/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:38:20.784764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac069127-624a-4436-a24d-5370972d37ed None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:20.893313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac069127-624a-4436-a24d-5370972d37ed None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:20.916811 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:20.932170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f6ea0-f7b0-46de-bbd9-056d2d2627b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:20.932170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f6ea0-f7b0-46de-bbd9-056d2d2627b9 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:20.932170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f6ea0-f7b0-46de-bbd9-056d2d2627b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:20.932170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f6ea0-f7b0-46de-bbd9-056d2d2627b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:20.998721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f6ea0-f7b0-46de-bbd9-056d2d2627b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:21.000157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f6ea0-f7b0-46de-bbd9-056d2d2627b9 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:21.096560 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 574/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:38:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:38:21.102635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780f986-4fe3-4907-89dc-e567ee89f34c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:21.104831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:21.201579 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780f986-4fe3-4907-89dc-e567ee89f34c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:21.239959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af64398-f602-4a1e-98e4-1aaba0709a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:21.240792 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af64398-f602-4a1e-98e4-1aaba0709a88 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:21.241076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af64398-f602-4a1e-98e4-1aaba0709a88 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:21.241351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af64398-f602-4a1e-98e4-1aaba0709a88 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:21.248604 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af64398-f602-4a1e-98e4-1aaba0709a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:21.250039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af64398-f602-4a1e-98e4-1aaba0709a88 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-7af64398-f602-4a1e-98e4-1aaba0709a88 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:38:21.264642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:38:21.265904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:38:21.266784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 591/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 20 17:38:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:38:21.271895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f6ea0-f7b0-46de-bbd9-056d2d2627b9 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:21.296154 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:21.369986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f6ea0-f7b0-46de-bbd9-056d2d2627b9 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:21.406358 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b51088-ed86-4e80-ba44-bb78881d3b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:21.407016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b51088-ed86-4e80-ba44-bb78881d3b3e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:21.407297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b51088-ed86-4e80-ba44-bb78881d3b3e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:21.407566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b51088-ed86-4e80-ba44-bb78881d3b3e None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:21.408277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b51088-ed86-4e80-ba44-bb78881d3b3e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:38:21.408613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b51088-ed86-4e80-ba44-bb78881d3b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:21.409964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b51088-ed86-4e80-ba44-bb78881d3b3e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:21.417307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 575/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Jul 20 17:38:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:23.462996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f7077-b76a-4e22-8b22-5d6b957de8f5 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:23.463525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f7077-b76a-4e22-8b22-5d6b957de8f5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:23.463525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f7077-b76a-4e22-8b22-5d6b957de8f5 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:23.465789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 592/1167] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:23.471541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa446b-7066-49c4-8915-dea5c784fbe4 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:23.472062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa446b-7066-49c4-8915-dea5c784fbe4 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:23.472164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa446b-7066-49c4-8915-dea5c784fbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:23.490556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-46fa446b-7066-49c4-8915-dea5c784fbe4 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:23.491749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-46fa446b-7066-49c4-8915-dea5c784fbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:23.563819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 576/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:38:23.587186 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f7077-b76a-4e22-8b22-5d6b957de8f5 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:23.649715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:23.689606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f7077-b76a-4e22-8b22-5d6b957de8f5 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:23.724465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1953341-798a-45e8-b0a2-4fa48641fb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:23.725160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953341-798a-45e8-b0a2-4fa48641fb82 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:23.725445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953341-798a-45e8-b0a2-4fa48641fb82 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:23.725723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953341-798a-45e8-b0a2-4fa48641fb82 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:23.726478 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1953341-798a-45e8-b0a2-4fa48641fb82 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:23.727876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1953341-798a-45e8-b0a2-4fa48641fb82 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:23.851465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 593/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Wed Jul 20 17:38:23 2022] POST /identity/v3/domains => generated 267 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:38:25.936027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49d6f9-1c8a-4ce5-82c4-9599a1bf014f None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:25.936580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49d6f9-1c8a-4ce5-82c4-9599a1bf014f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:25.936580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49d6f9-1c8a-4ce5-82c4-9599a1bf014f None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:25.937980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 577/1170] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:25.943308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd877f-0e46-48c3-a929-41ef0b642699 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:25.943724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd877f-0e46-48c3-a929-41ef0b642699 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:25.943855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd877f-0e46-48c3-a929-41ef0b642699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:25.960822 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-4acd877f-0e46-48c3-a929-41ef0b642699 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:25.962018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4acd877f-0e46-48c3-a929-41ef0b642699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:26.027023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 594/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:38:26.051110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49d6f9-1c8a-4ce5-82c4-9599a1bf014f None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:26.069291 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:26.154130 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49d6f9-1c8a-4ce5-82c4-9599a1bf014f None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:26.188084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1e443-1ca2-4443-b5c0-861517d54874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:26.188892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1e443-1ca2-4443-b5c0-861517d54874 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:26.189171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1e443-1ca2-4443-b5c0-861517d54874 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:26.189445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1e443-1ca2-4443-b5c0-861517d54874 None admin] PATH_INFO: `/v3/domains/bbdd2b6a57fe4070bc4cb74641d6f8a3` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:26.199742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1e443-1ca2-4443-b5c0-861517d54874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bbdd2b6a57fe4070bc4cb74641d6f8a3)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:26.201216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1e443-1ca2-4443-b5c0-861517d54874 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:26.202883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 578/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Jul 20 17:38:26 2022] GET /identity/v3/domains/bbdd2b6a57fe4070bc4cb74641d6f8a3 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:26.209075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd877f-0e46-48c3-a929-41ef0b642699 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:26.261064 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:26.308454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd877f-0e46-48c3-a929-41ef0b642699 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:26.342242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1196e-07e5-477d-8848-3f5e878d2026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:26.343074 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1196e-07e5-477d-8848-3f5e878d2026 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:26.343589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1196e-07e5-477d-8848-3f5e878d2026 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:26.344377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1196e-07e5-477d-8848-3f5e878d2026 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:26.345162 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1196e-07e5-477d-8848-3f5e878d2026 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:26.346609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1196e-07e5-477d-8848-3f5e878d2026 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:26.465350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 595/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:38:26 2022] POST /identity/v3/projects => generated 361 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:38:28.552721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29218a-6ab8-4716-b2c1-3daeba6c19b0 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:28.553250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29218a-6ab8-4716-b2c1-3daeba6c19b0 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:28.553250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29218a-6ab8-4716-b2c1-3daeba6c19b0 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:28.554643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 579/1174] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:28.560366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662610a-5bf9-4a16-b57b-fc6867e1c56d None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:28.560828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662610a-5bf9-4a16-b57b-fc6867e1c56d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:28.560945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662610a-5bf9-4a16-b57b-fc6867e1c56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:28.577693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-3662610a-5bf9-4a16-b57b-fc6867e1c56d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:28.578885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3662610a-5bf9-4a16-b57b-fc6867e1c56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:28.645305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 596/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:38:28.671916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29218a-6ab8-4716-b2c1-3daeba6c19b0 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:28.754040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:28.778528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29218a-6ab8-4716-b2c1-3daeba6c19b0 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:28.813266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ba509-3c61-4751-aa79-1beaff71cc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:28.814115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ba509-3c61-4751-aa79-1beaff71cc06 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:28.814398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ba509-3c61-4751-aa79-1beaff71cc06 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:28.814674 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ba509-3c61-4751-aa79-1beaff71cc06 None admin] PATH_INFO: `/v3/domains/bbdd2b6a57fe4070bc4cb74641d6f8a3` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:28.815891 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ba509-3c61-4751-aa79-1beaff71cc06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bbdd2b6a57fe4070bc4cb74641d6f8a3)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:28.817342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ba509-3c61-4751-aa79-1beaff71cc06 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:28.818970 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 580/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Jul 20 17:38:28 2022] GET /identity/v3/domains/bbdd2b6a57fe4070bc4cb74641d6f8a3 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:28.825113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662610a-5bf9-4a16-b57b-fc6867e1c56d None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:28.857482 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:28.921412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662610a-5bf9-4a16-b57b-fc6867e1c56d None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:28.955907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa40a7-ac28-4365-955a-7891624d167a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:28.956501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa40a7-ac28-4365-955a-7891624d167a None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:28.956785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa40a7-ac28-4365-955a-7891624d167a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:28.957058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa40a7-ac28-4365-955a-7891624d167a None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:28.957767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa40a7-ac28-4365-955a-7891624d167a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:28.959228 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa40a7-ac28-4365-955a-7891624d167a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:29.097711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 597/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:38:28 2022] POST /identity/v3/users => generated 311 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:38:31.224821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf567fe-b25a-4700-86eb-c622f911f32c None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:31.225357 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf567fe-b25a-4700-86eb-c622f911f32c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:31.225357 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf567fe-b25a-4700-86eb-c622f911f32c None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:31.226719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 581/1178] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:31.232572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e94bf0-d025-42b6-8a15-da39dbdb2ccc None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:31.233029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e94bf0-d025-42b6-8a15-da39dbdb2ccc None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:31.233123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e94bf0-d025-42b6-8a15-da39dbdb2ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:31.251287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-82e94bf0-d025-42b6-8a15-da39dbdb2ccc None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:31.252560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-82e94bf0-d025-42b6-8a15-da39dbdb2ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:31.319144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 598/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:38:31.343129 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf567fe-b25a-4700-86eb-c622f911f32c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:31.445435 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf567fe-b25a-4700-86eb-c622f911f32c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:31.478556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0074c-f2b9-456e-a495-ca7a5ae024e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:31.479272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0074c-f2b9-456e-a495-ca7a5ae024e7 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:31.479555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0074c-f2b9-456e-a495-ca7a5ae024e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:31.479832 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0074c-f2b9-456e-a495-ca7a5ae024e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:31.491122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0074c-f2b9-456e-a495-ca7a5ae024e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-82b0074c-f2b9-456e-a495-ca7a5ae024e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:38:31.498901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:38:31.500034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:38:31.501023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 582/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:38:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:38:31.506268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e94bf0-d025-42b6-8a15-da39dbdb2ccc None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:31.527544 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:31.603075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e94bf0-d025-42b6-8a15-da39dbdb2ccc None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:31.637664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa98001-323e-4bf9-987c-64a61d16aa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:31.638707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa98001-323e-4bf9-987c-64a61d16aa74 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:31.638991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa98001-323e-4bf9-987c-64a61d16aa74 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:31.639268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa98001-323e-4bf9-987c-64a61d16aa74 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:31.640019 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa98001-323e-4bf9-987c-64a61d16aa74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:38:31.640328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa98001-323e-4bf9-987c-64a61d16aa74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:31.641736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa98001-323e-4bf9-987c-64a61d16aa74 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:31.649867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 599/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:38:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:31.656523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0074c-f2b9-456e-a495-ca7a5ae024e7 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:31.660391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:31.757441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0074c-f2b9-456e-a495-ca7a5ae024e7 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:31.796399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bb299-61de-4ca2-862c-acfd34793ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:31.797322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bb299-61de-4ca2-862c-acfd34793ec2 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:31.797611 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bb299-61de-4ca2-862c-acfd34793ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:31.797893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bb299-61de-4ca2-862c-acfd34793ec2 None admin] PATH_INFO: `/v3/users/8ff2ac241e13468f9c44ed465f1c4207` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:31.812607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bb299-61de-4ca2-862c-acfd34793ec2 None admin] RBAC: Authorizing `identity:get_user(user_id=8ff2ac241e13468f9c44ed465f1c4207)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:31.814070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bb299-61de-4ca2-862c-acfd34793ec2 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:31.815826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 583/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:38:31 2022] GET /identity/v3/users/8ff2ac241e13468f9c44ed465f1c4207 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:31.821653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa98001-323e-4bf9-987c-64a61d16aa74 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:31.903907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:31.922301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa98001-323e-4bf9-987c-64a61d16aa74 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:31.957247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522dce6-3531-4b15-b09d-b23356b15bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:31.957903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522dce6-3531-4b15-b09d-b23356b15bb4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:31.958189 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522dce6-3531-4b15-b09d-b23356b15bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:31.958485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522dce6-3531-4b15-b09d-b23356b15bb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:32.025415 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522dce6-3531-4b15-b09d-b23356b15bb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:32.026767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522dce6-3531-4b15-b09d-b23356b15bb4 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:32.107514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:32.125866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 600/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:38:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 17:38:32.131833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bb299-61de-4ca2-862c-acfd34793ec2 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:32.193622 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:32.232936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bb299-61de-4ca2-862c-acfd34793ec2 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:32.267217 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127d492-54a8-47d6-a73b-ac28f80e9d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:32.268072 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127d492-54a8-47d6-a73b-ac28f80e9d9f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:32.268356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127d492-54a8-47d6-a73b-ac28f80e9d9f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:32.268664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127d492-54a8-47d6-a73b-ac28f80e9d9f None admin] PATH_INFO: `/v3/projects/2a8eb07db43741a3ae90deb172558f51` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:32.269846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127d492-54a8-47d6-a73b-ac28f80e9d9f None admin] RBAC: Authorizing `identity:get_project(project_id=2a8eb07db43741a3ae90deb172558f51)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:32.271283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127d492-54a8-47d6-a73b-ac28f80e9d9f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:32.273071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 584/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:38:32 2022] GET /identity/v3/projects/2a8eb07db43741a3ae90deb172558f51 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:32.279482 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522dce6-3531-4b15-b09d-b23356b15bb4 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:32.389952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522dce6-3531-4b15-b09d-b23356b15bb4 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:32.426993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5418-2149-4752-84a1-0b26fb7cf62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:32.427646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5418-2149-4752-84a1-0b26fb7cf62f None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:32.427932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5418-2149-4752-84a1-0b26fb7cf62f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:32.428211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5418-2149-4752-84a1-0b26fb7cf62f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:32.429075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d5418-2149-4752-84a1-0b26fb7cf62f None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=2a8eb07db43741a3ae90deb172558f51, user.id=8ff2ac241e13468f9c44ed465f1c4207) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:38:32.429394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d5418-2149-4752-84a1-0b26fb7cf62f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:32.430815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d5418-2149-4752-84a1-0b26fb7cf62f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:32.436849 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 601/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:38:32 2022] GET /identity/v3/role_assignments?user.id=8ff2ac241e13468f9c44ed465f1c4207&scope.project.id=2a8eb07db43741a3ae90deb172558f51&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:34.513550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12ce7c-51e2-4929-a233-aba931eed4db None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:34.514072 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12ce7c-51e2-4929-a233-aba931eed4db None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:34.514191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12ce7c-51e2-4929-a233-aba931eed4db None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:34.515501 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 585/1186] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:34.521071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce9b88-2213-43dd-a461-a352b774a5c3 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:34.521552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce9b88-2213-43dd-a461-a352b774a5c3 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:34.521661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce9b88-2213-43dd-a461-a352b774a5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:34.539030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f8ce9b88-2213-43dd-a461-a352b774a5c3 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:34.540223 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f8ce9b88-2213-43dd-a461-a352b774a5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:34.582092 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:34.606071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 602/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:38:34.629104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12ce7c-51e2-4929-a233-aba931eed4db None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:34.732502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12ce7c-51e2-4929-a233-aba931eed4db None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:34.760961 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:34.767186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab4385-faca-4a84-80cf-d409ad8819bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:34.767980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab4385-faca-4a84-80cf-d409ad8819bc None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:34.768259 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab4385-faca-4a84-80cf-d409ad8819bc None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:34.768562 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab4385-faca-4a84-80cf-d409ad8819bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:34.779606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab4385-faca-4a84-80cf-d409ad8819bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-c2ab4385-faca-4a84-80cf-d409ad8819bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:38:34.787393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:38:34.788951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:38:34.790209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 586/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:38:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:38:34.795087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce9b88-2213-43dd-a461-a352b774a5c3 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:34.891698 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce9b88-2213-43dd-a461-a352b774a5c3 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:34.929057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafccbd3-b18b-4648-81e1-27f1edbe04e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:34.929715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafccbd3-b18b-4648-81e1-27f1edbe04e2 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:34.929993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafccbd3-b18b-4648-81e1-27f1edbe04e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:34.930262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafccbd3-b18b-4648-81e1-27f1edbe04e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:34.930995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafccbd3-b18b-4648-81e1-27f1edbe04e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:38:34.931297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafccbd3-b18b-4648-81e1-27f1edbe04e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:34.932686 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafccbd3-b18b-4648-81e1-27f1edbe04e2 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:34.940773 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 603/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:38:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:34.946612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab4385-faca-4a84-80cf-d409ad8819bc None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:35.047404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab4385-faca-4a84-80cf-d409ad8819bc None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:35.080338 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b2d00-20fa-442f-be45-703caa9d5fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:35.081230 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b2d00-20fa-442f-be45-703caa9d5fd3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:35.081538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b2d00-20fa-442f-be45-703caa9d5fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:35.081814 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b2d00-20fa-442f-be45-703caa9d5fd3 None admin] PATH_INFO: `/v3/users/8ff2ac241e13468f9c44ed465f1c4207` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:35.083004 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b2d00-20fa-442f-be45-703caa9d5fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=8ff2ac241e13468f9c44ed465f1c4207)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:35.084462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b2d00-20fa-442f-be45-703caa9d5fd3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:35.086132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 587/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:38:34 2022] GET /identity/v3/users/8ff2ac241e13468f9c44ed465f1c4207 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:35.092702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafccbd3-b18b-4648-81e1-27f1edbe04e2 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:35.132166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:35.190773 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafccbd3-b18b-4648-81e1-27f1edbe04e2 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:35.224286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb4eee-5370-4278-b05a-b2585916dae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:35.225175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb4eee-5370-4278-b05a-b2585916dae1 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:35.225451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb4eee-5370-4278-b05a-b2585916dae1 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:35.225722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb4eee-5370-4278-b05a-b2585916dae1 None admin] PATH_INFO: `/v3/projects/2a8eb07db43741a3ae90deb172558f51` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:35.226952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb4eee-5370-4278-b05a-b2585916dae1 None admin] RBAC: Authorizing `identity:get_project(project_id=2a8eb07db43741a3ae90deb172558f51)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:35.228372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb4eee-5370-4278-b05a-b2585916dae1 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:35.230364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 604/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:38:35 2022] GET /identity/v3/projects/2a8eb07db43741a3ae90deb172558f51 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:35.236499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b2d00-20fa-442f-be45-703caa9d5fd3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:35.294178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:35.336407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b2d00-20fa-442f-be45-703caa9d5fd3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:35.371594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5868016-ef90-4d38-8d78-4998cfd3a74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:35.372748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868016-ef90-4d38-8d78-4998cfd3a74a None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:35.373032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868016-ef90-4d38-8d78-4998cfd3a74a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:35.373306 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868016-ef90-4d38-8d78-4998cfd3a74a None admin] PATH_INFO: `/v3/projects/2a8eb07db43741a3ae90deb172558f51/users/8ff2ac241e13468f9c44ed465f1c4207/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:35.375401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5868016-ef90-4d38-8d78-4998cfd3a74a None admin] RBAC: Authorizing `identity:create_grant(project_id=2a8eb07db43741a3ae90deb172558f51, user_id=8ff2ac241e13468f9c44ed465f1c4207, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:35.376928 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5868016-ef90-4d38-8d78-4998cfd3a74a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:35.466825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 588/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:38:35 2022] PUT /identity/v3/projects/2a8eb07db43741a3ae90deb172558f51/users/8ff2ac241e13468f9c44ed465f1c4207/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:38:37.549474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afb19b-d5b8-4e42-a249-3a7722a7995d None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:37.550023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afb19b-d5b8-4e42-a249-3a7722a7995d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:37.550023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afb19b-d5b8-4e42-a249-3a7722a7995d None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:37.551380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 605/1193] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:38:37.556640 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc19c-80ac-4bf3-8775-68220efbe9be None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:37.557076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc19c-80ac-4bf3-8775-68220efbe9be None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:37.557233 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc19c-80ac-4bf3-8775-68220efbe9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:37.575853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-27abc19c-80ac-4bf3-8775-68220efbe9be None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:38:37.577083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-27abc19c-80ac-4bf3-8775-68220efbe9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:38:37.645141 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 589/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:38:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:38:37.668728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afb19b-d5b8-4e42-a249-3a7722a7995d None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:37.777200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afb19b-d5b8-4e42-a249-3a7722a7995d None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:37.785838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:37.817752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1714ed-9585-44f1-9a84-1f26a54fe737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:37.818582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1714ed-9585-44f1-9a84-1f26a54fe737 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:37.818862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1714ed-9585-44f1-9a84-1f26a54fe737 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:37.819138 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1714ed-9585-44f1-9a84-1f26a54fe737 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:37.831176 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1714ed-9585-44f1-9a84-1f26a54fe737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-4b1714ed-9585-44f1-9a84-1f26a54fe737 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:38:37.839240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:38:37.840439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:38:37.841557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 606/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:38:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:38:37.847001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abc19c-80ac-4bf3-8775-68220efbe9be None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:37.901401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:37.957556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abc19c-80ac-4bf3-8775-68220efbe9be None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:37.992981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a21c2-083c-4957-8223-e2ff188b32a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:37.993670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a21c2-083c-4957-8223-e2ff188b32a3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:37.993954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a21c2-083c-4957-8223-e2ff188b32a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:37.994229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a21c2-083c-4957-8223-e2ff188b32a3 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:37.995000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a21c2-083c-4957-8223-e2ff188b32a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:38:37.995308 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a21c2-083c-4957-8223-e2ff188b32a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:37.997462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a21c2-083c-4957-8223-e2ff188b32a3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:38.007185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 590/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:38.013339 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1714ed-9585-44f1-9a84-1f26a54fe737 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:38.114110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1714ed-9585-44f1-9a84-1f26a54fe737 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:38.147149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e190d2-855a-4c82-bf00-3bac24bdf451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:38.148018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e190d2-855a-4c82-bf00-3bac24bdf451 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:38.148298 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e190d2-855a-4c82-bf00-3bac24bdf451 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:38.148599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e190d2-855a-4c82-bf00-3bac24bdf451 None admin] PATH_INFO: `/v3/users/8ff2ac241e13468f9c44ed465f1c4207` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:38.149775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e190d2-855a-4c82-bf00-3bac24bdf451 None admin] RBAC: Authorizing `identity:get_user(user_id=8ff2ac241e13468f9c44ed465f1c4207)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:38.151193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e190d2-855a-4c82-bf00-3bac24bdf451 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:38.153634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 607/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Jul 20 17:38:38 2022] GET /identity/v3/users/8ff2ac241e13468f9c44ed465f1c4207 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:38.159359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a21c2-083c-4957-8223-e2ff188b32a3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:38.259603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a21c2-083c-4957-8223-e2ff188b32a3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:38.269893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:38.294062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9068c8-697f-464e-8a05-3de4865c0c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:38.294709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9068c8-697f-464e-8a05-3de4865c0c8b None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:38.294993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9068c8-697f-464e-8a05-3de4865c0c8b None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:38.295270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9068c8-697f-464e-8a05-3de4865c0c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:38.364786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9068c8-697f-464e-8a05-3de4865c0c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:38.366236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9068c8-697f-464e-8a05-3de4865c0c8b None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:38.465503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 591/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:38:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:38:38.471411 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e190d2-855a-4c82-bf00-3bac24bdf451 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:38.507007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:38.573494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e190d2-855a-4c82-bf00-3bac24bdf451 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:38.606411 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00357d5e-a688-4e5d-a0b3-946381b16f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:38.607300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00357d5e-a688-4e5d-a0b3-946381b16f41 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:38.607608 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00357d5e-a688-4e5d-a0b3-946381b16f41 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:38.607888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00357d5e-a688-4e5d-a0b3-946381b16f41 None admin] PATH_INFO: `/v3/projects/2a8eb07db43741a3ae90deb172558f51` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:38.609102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00357d5e-a688-4e5d-a0b3-946381b16f41 None admin] RBAC: Authorizing `identity:get_project(project_id=2a8eb07db43741a3ae90deb172558f51)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:38.610559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00357d5e-a688-4e5d-a0b3-946381b16f41 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:38.612252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 608/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Jul 20 17:38:38 2022] GET /identity/v3/projects/2a8eb07db43741a3ae90deb172558f51 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:38.618446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9068c8-697f-464e-8a05-3de4865c0c8b None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:38:38.631680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:38.719335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9068c8-697f-464e-8a05-3de4865c0c8b None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:38:38.753710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dc9dc-1018-43dd-b7f9-b15d3bc88728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:38:38.754361 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dc9dc-1018-43dd-b7f9-b15d3bc88728 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:38:38.754644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dc9dc-1018-43dd-b7f9-b15d3bc88728 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:38:38.754921 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dc9dc-1018-43dd-b7f9-b15d3bc88728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:38:38.755750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dc9dc-1018-43dd-b7f9-b15d3bc88728 None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=2a8eb07db43741a3ae90deb172558f51, user.id=8ff2ac241e13468f9c44ed465f1c4207) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:38:38.756063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dc9dc-1018-43dd-b7f9-b15d3bc88728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:38:38.757525 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dc9dc-1018-43dd-b7f9-b15d3bc88728 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:38:38.764225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 592/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:38:38 2022] GET /identity/v3/role_assignments?user.id=8ff2ac241e13468f9c44ed465f1c4207&scope.project.id=2a8eb07db43741a3ae90deb172558f51&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:38:48.601703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=49 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:38:48.760885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=63 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:01.256270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0f490-2cc6-418c-86b1-e589c7cf34d0 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:01.256899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0f490-2cc6-418c-86b1-e589c7cf34d0 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:01.256899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0f490-2cc6-418c-86b1-e589c7cf34d0 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:01.258233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 609/1201] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:40:01.263882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea3cb6-081c-4db8-ab65-d01255c6bef5 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:01.264359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea3cb6-081c-4db8-ab65-d01255c6bef5 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:01.264462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea3cb6-081c-4db8-ab65-d01255c6bef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:01.282849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-6cea3cb6-081c-4db8-ab65-d01255c6bef5 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:40:01.284077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6cea3cb6-081c-4db8-ab65-d01255c6bef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:40:01.356408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 593/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:40:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:40:01.381970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0f490-2cc6-418c-86b1-e589c7cf34d0 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:01.490788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0f490-2cc6-418c-86b1-e589c7cf34d0 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:01.527520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501e153-ad7c-426a-a6a1-ce2635b5e879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:01.528287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501e153-ad7c-426a-a6a1-ce2635b5e879 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:01.528597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501e153-ad7c-426a-a6a1-ce2635b5e879 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:01.528877 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501e153-ad7c-426a-a6a1-ce2635b5e879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:01.539860 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501e153-ad7c-426a-a6a1-ce2635b5e879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:01.541343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501e153-ad7c-426a-a6a1-ce2635b5e879 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-d501e153-ad7c-426a-a6a1-ce2635b5e879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:01.559827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:01.561086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:01.562184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:01.562184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:01.562184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:01.562184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:01.562184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 610/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:01.567209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea3cb6-081c-4db8-ab65-d01255c6bef5 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:01.675438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea3cb6-081c-4db8-ab65-d01255c6bef5 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:01.706297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:01.712465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dccc8c-942a-4945-b240-f029b594a94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:01.713165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dccc8c-942a-4945-b240-f029b594a94b None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:01.714041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dccc8c-942a-4945-b240-f029b594a94b None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:01.714331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dccc8c-942a-4945-b240-f029b594a94b None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:01.715063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dccc8c-942a-4945-b240-f029b594a94b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:01.715370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dccc8c-942a-4945-b240-f029b594a94b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:01.716862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dccc8c-942a-4945-b240-f029b594a94b None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:01.728773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 594/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:01.734979 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501e153-ad7c-426a-a6a1-ce2635b5e879 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:01.790038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:01.841583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501e153-ad7c-426a-a6a1-ce2635b5e879 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:01.875239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c453c-5089-46a1-a136-0e70de6c2afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:01.875907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c453c-5089-46a1-a136-0e70de6c2afc None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:01.876182 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c453c-5089-46a1-a136-0e70de6c2afc None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:01.876452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c453c-5089-46a1-a136-0e70de6c2afc None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:01.877178 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c453c-5089-46a1-a136-0e70de6c2afc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:01.878599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c453c-5089-46a1-a136-0e70de6c2afc None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:02.018849 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 611/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Jul 20 17:40:01 2022] POST /identity/v3/users => generated 251 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:40:04.121467 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b12d80-119d-44b8-bb44-b914a67b6e89 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:04.122041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b12d80-119d-44b8-bb44-b914a67b6e89 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:04.122041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b12d80-119d-44b8-bb44-b914a67b6e89 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:04.123464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 595/1206] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:40:04.129091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7ef80-a095-4904-998f-3d697f01f897 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:04.132166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7ef80-a095-4904-998f-3d697f01f897 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:04.132166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7ef80-a095-4904-998f-3d697f01f897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:04.147112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-20b7ef80-a095-4904-998f-3d697f01f897 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:40:04.148315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-20b7ef80-a095-4904-998f-3d697f01f897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:40:04.216623 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 612/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:40:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:40:04.240109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b12d80-119d-44b8-bb44-b914a67b6e89 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:04.343989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b12d80-119d-44b8-bb44-b914a67b6e89 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:04.381329 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d9bd1-9e71-4d38-a0e4-28d0e71bf4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:04.382066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d9bd1-9e71-4d38-a0e4-28d0e71bf4b6 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:04.382348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d9bd1-9e71-4d38-a0e4-28d0e71bf4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:04.382622 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d9bd1-9e71-4d38-a0e4-28d0e71bf4b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:04.397963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d9bd1-9e71-4d38-a0e4-28d0e71bf4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-1f4d9bd1-9e71-4d38-a0e4-28d0e71bf4b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:40:04.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:04.407113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:04.408342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 596/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:40:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:04.413590 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7ef80-a095-4904-998f-3d697f01f897 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:04.453377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:04.511942 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7ef80-a095-4904-998f-3d697f01f897 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:04.545343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b663e-3972-4083-882f-e559568c6895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:04.546012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b663e-3972-4083-882f-e559568c6895 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:04.546297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b663e-3972-4083-882f-e559568c6895 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:04.546573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b663e-3972-4083-882f-e559568c6895 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:04.547314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b663e-3972-4083-882f-e559568c6895 None admin] RBAC: Adding query filter params (name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:04.547622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b663e-3972-4083-882f-e559568c6895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:04.549015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b663e-3972-4083-882f-e559568c6895 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:04.556697 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 613/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:40:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:40:04.566917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d9bd1-9e71-4d38-a0e4-28d0e71bf4b6 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:04.615099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:04.664380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d9bd1-9e71-4d38-a0e4-28d0e71bf4b6 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:04.698446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a58cf-badc-4660-a42c-3bd31fb5a28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:04.699335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a58cf-badc-4660-a42c-3bd31fb5a28c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:04.699620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a58cf-badc-4660-a42c-3bd31fb5a28c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:04.699900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a58cf-badc-4660-a42c-3bd31fb5a28c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:04.710684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a58cf-badc-4660-a42c-3bd31fb5a28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:04.712129 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a58cf-badc-4660-a42c-3bd31fb5a28c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-837a58cf-badc-4660-a42c-3bd31fb5a28c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:04.729822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:04.731024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:04.731999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:04.731999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:04.731999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:04.731999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:04.731999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 597/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:04.737014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b663e-3972-4083-882f-e559568c6895 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:04.840294 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b663e-3972-4083-882f-e559568c6895 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:04.875265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5da158-5c2b-450d-acc3-4049e118316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:04.875926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5da158-5c2b-450d-acc3-4049e118316d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:04.876206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5da158-5c2b-450d-acc3-4049e118316d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:04.876515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5da158-5c2b-450d-acc3-4049e118316d None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:04.877224 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5da158-5c2b-450d-acc3-4049e118316d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:04.877531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5da158-5c2b-450d-acc3-4049e118316d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:04.878959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5da158-5c2b-450d-acc3-4049e118316d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:04.890381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 614/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:04.896187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a58cf-badc-4660-a42c-3bd31fb5a28c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:04.929306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:04.999164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a58cf-badc-4660-a42c-3bd31fb5a28c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:05.000707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:05.033510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4f5f-af30-44a1-a2da-62020fe5fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:05.034305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4f5f-af30-44a1-a2da-62020fe5fc1a None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:05.034584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4f5f-af30-44a1-a2da-62020fe5fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:05.034856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a4f5f-af30-44a1-a2da-62020fe5fc1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:05.043209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a4f5f-af30-44a1-a2da-62020fe5fc1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:05.050798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a4f5f-af30-44a1-a2da-62020fe5fc1a None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-a96a4f5f-af30-44a1-a2da-62020fe5fc1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:40:05.060400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:05.061581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:05.062873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:05.062873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:05.062873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:40:05.062873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:40:05.062873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:40:05.062873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:40:05.062873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:40:05.062873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:40:05.062873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 17:40:05.062873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:05.062873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 598/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:05.067658 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5da158-5c2b-450d-acc3-4049e118316d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:05.171262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5da158-5c2b-450d-acc3-4049e118316d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:05.204858 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8a32a-d0ad-4501-ba07-ef8b2fda2cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:05.205453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8a32a-d0ad-4501-ba07-ef8b2fda2cbc None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:05.205730 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8a32a-d0ad-4501-ba07-ef8b2fda2cbc None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:05.205999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8a32a-d0ad-4501-ba07-ef8b2fda2cbc None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:05.206831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8a32a-d0ad-4501-ba07-ef8b2fda2cbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:05.207134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8a32a-d0ad-4501-ba07-ef8b2fda2cbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:05.208638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8a32a-d0ad-4501-ba07-ef8b2fda2cbc None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:05.226634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 615/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jul 20 17:40:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:40:05.233506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4f5f-af30-44a1-a2da-62020fe5fc1a None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:05.344330 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a4f5f-af30-44a1-a2da-62020fe5fc1a None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:05.384066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe65dd-7fb5-4040-bf73-fce80b4ddca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:05.384731 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe65dd-7fb5-4040-bf73-fce80b4ddca2 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:05.385042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe65dd-7fb5-4040-bf73-fce80b4ddca2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:05.385951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe65dd-7fb5-4040-bf73-fce80b4ddca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:05.417460 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:05.454788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe65dd-7fb5-4040-bf73-fce80b4ddca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:05.456347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe65dd-7fb5-4040-bf73-fce80b4ddca2 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:05.556637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 599/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:40:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:40:05.563176 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8a32a-d0ad-4501-ba07-ef8b2fda2cbc None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:05.582460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:05.667054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8a32a-d0ad-4501-ba07-ef8b2fda2cbc None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:05.701774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391678cc-5320-4208-a527-8c477996d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:05.702560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391678cc-5320-4208-a527-8c477996d54f None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:05.702840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391678cc-5320-4208-a527-8c477996d54f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:05.703113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391678cc-5320-4208-a527-8c477996d54f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:05.713777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391678cc-5320-4208-a527-8c477996d54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:05.715132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391678cc-5320-4208-a527-8c477996d54f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-391678cc-5320-4208-a527-8c477996d54f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:05.733314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:05.734422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:05.735540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:05.735540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:05.735540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:05.735540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:05.735540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 616/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:05.740336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe65dd-7fb5-4040-bf73-fce80b4ddca2 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:05.803110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:05.843335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe65dd-7fb5-4040-bf73-fce80b4ddca2 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:05.878058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b967-845a-44f9-b2eb-16c64a1c74e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:05.878789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b967-845a-44f9-b2eb-16c64a1c74e5 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:05.879127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b967-845a-44f9-b2eb-16c64a1c74e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:05.879330 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b967-845a-44f9-b2eb-16c64a1c74e5 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:05.880048 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5b967-845a-44f9-b2eb-16c64a1c74e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:05.880348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5b967-845a-44f9-b2eb-16c64a1c74e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:05.881755 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5b967-845a-44f9-b2eb-16c64a1c74e5 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:05.893581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 600/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:05.899840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391678cc-5320-4208-a527-8c477996d54f None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:05.976960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:06.008340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391678cc-5320-4208-a527-8c477996d54f None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:06.043784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6475d9-f6a2-4a0c-aaf7-9e6b588e1f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:06.044602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6475d9-f6a2-4a0c-aaf7-9e6b588e1f91 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:06.044888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6475d9-f6a2-4a0c-aaf7-9e6b588e1f91 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:06.045164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6475d9-f6a2-4a0c-aaf7-9e6b588e1f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:06.053362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6475d9-f6a2-4a0c-aaf7-9e6b588e1f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:06.054839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6475d9-f6a2-4a0c-aaf7-9e6b588e1f91 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-ab6475d9-f6a2-4a0c-aaf7-9e6b588e1f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:40:06.069674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:06.074135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:06.075287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:40:06.075287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:40:06.075287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:40:06.075287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:40:06.075287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:40:06.075287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:40:06.075287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:40:06.075287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:06.075287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 617/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:06.077264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b967-845a-44f9-b2eb-16c64a1c74e5 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:06.178452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b967-845a-44f9-b2eb-16c64a1c74e5 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:06.201978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:06.216266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf6861-5465-49fb-b109-5b0d49e6f4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:06.217018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6861-5465-49fb-b109-5b0d49e6f4d3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:06.217298 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6861-5465-49fb-b109-5b0d49e6f4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:06.217607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6861-5465-49fb-b109-5b0d49e6f4d3 None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:06.218456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf6861-5465-49fb-b109-5b0d49e6f4d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:06.218808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf6861-5465-49fb-b109-5b0d49e6f4d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:06.220410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf6861-5465-49fb-b109-5b0d49e6f4d3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:06.232598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 601/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:06.238886 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6475d9-f6a2-4a0c-aaf7-9e6b588e1f91 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:06.343012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6475d9-f6a2-4a0c-aaf7-9e6b588e1f91 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:06.373117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:06.379319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb242f7-b011-4f51-bc5a-860d5d209867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:06.379984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb242f7-b011-4f51-bc5a-860d5d209867 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:06.380264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb242f7-b011-4f51-bc5a-860d5d209867 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:06.380564 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb242f7-b011-4f51-bc5a-860d5d209867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:06.381399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb242f7-b011-4f51-bc5a-860d5d209867 None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=b218402abe6540d8b81295676199f6f9) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:06.381707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb242f7-b011-4f51-bc5a-860d5d209867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:06.383128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb242f7-b011-4f51-bc5a-860d5d209867 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:06.389454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 618/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:40:06 2022] GET /identity/v3/role_assignments?user.id=b218402abe6540d8b81295676199f6f9&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:08.463689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7cf28-6098-4398-b8f8-0c3c83659593 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:08.464223 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7cf28-6098-4398-b8f8-0c3c83659593 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:08.464404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7cf28-6098-4398-b8f8-0c3c83659593 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:08.465797 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 602/1220] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:40:08.471196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44e989-8697-4942-ab46-6bab37ac593d None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:08.471622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44e989-8697-4942-ab46-6bab37ac593d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:08.471784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44e989-8697-4942-ab46-6bab37ac593d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:08.489015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-2e44e989-8697-4942-ab46-6bab37ac593d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:40:08.490217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2e44e989-8697-4942-ab46-6bab37ac593d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:40:08.559104 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 619/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:40:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:40:08.582334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7cf28-6098-4398-b8f8-0c3c83659593 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:08.690180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7cf28-6098-4398-b8f8-0c3c83659593 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:08.725285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a116a19-ca4d-47d1-9ee6-488938b5a512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:08.727458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a116a19-ca4d-47d1-9ee6-488938b5a512 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:08.727458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a116a19-ca4d-47d1-9ee6-488938b5a512 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:08.727458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a116a19-ca4d-47d1-9ee6-488938b5a512 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:08.737727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a116a19-ca4d-47d1-9ee6-488938b5a512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-6a116a19-ca4d-47d1-9ee6-488938b5a512 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:40:08.745697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:08.746787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:08.748062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 603/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:40:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:08.753032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44e989-8697-4942-ab46-6bab37ac593d None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:08.854037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44e989-8697-4942-ab46-6bab37ac593d None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:08.879683 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:08.891022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d58261-9d69-4bdc-a5a9-32a61888b231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:08.891719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58261-9d69-4bdc-a5a9-32a61888b231 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:08.892000 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58261-9d69-4bdc-a5a9-32a61888b231 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:08.892271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58261-9d69-4bdc-a5a9-32a61888b231 None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:08.893053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d58261-9d69-4bdc-a5a9-32a61888b231 None admin] RBAC: Adding query filter params (name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:08.893359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d58261-9d69-4bdc-a5a9-32a61888b231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:08.894717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d58261-9d69-4bdc-a5a9-32a61888b231 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:08.903399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 620/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:40:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:08.909372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a116a19-ca4d-47d1-9ee6-488938b5a512 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:08.954140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:09.014851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a116a19-ca4d-47d1-9ee6-488938b5a512 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:09.048881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9c216-7f70-4907-9ec3-9ec22651104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:09.049696 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9c216-7f70-4907-9ec3-9ec22651104f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:09.049983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9c216-7f70-4907-9ec3-9ec22651104f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:09.050266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9c216-7f70-4907-9ec3-9ec22651104f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:09.062144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9c216-7f70-4907-9ec3-9ec22651104f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:09.063641 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9c216-7f70-4907-9ec3-9ec22651104f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-a7d9c216-7f70-4907-9ec3-9ec22651104f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:09.082893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:09.086303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:09.087276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:09.087276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:09.087276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:09.087276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:09.087276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 604/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:09.090388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d58261-9d69-4bdc-a5a9-32a61888b231 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:09.190229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d58261-9d69-4bdc-a5a9-32a61888b231 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:09.223646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84c816-408d-4a97-b227-1020bb6d7a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:09.224241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c816-408d-4a97-b227-1020bb6d7a0d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:09.224560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c816-408d-4a97-b227-1020bb6d7a0d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:09.224826 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c816-408d-4a97-b227-1020bb6d7a0d None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:09.225539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c816-408d-4a97-b227-1020bb6d7a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:09.225845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c816-408d-4a97-b227-1020bb6d7a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:09.227206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c816-408d-4a97-b227-1020bb6d7a0d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:09.240837 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 621/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:09.251790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9c216-7f70-4907-9ec3-9ec22651104f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:09.350755 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:09.358260 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9c216-7f70-4907-9ec3-9ec22651104f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:09.394183 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6943d-662c-43e7-930d-c9eb5d0c372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:09.394183 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6943d-662c-43e7-930d-c9eb5d0c372f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:09.394183 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6943d-662c-43e7-930d-c9eb5d0c372f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:09.395225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6943d-662c-43e7-930d-c9eb5d0c372f None admin] PATH_INFO: `/v3/users/placement` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:09.402379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6943d-662c-43e7-930d-c9eb5d0c372f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:09.403861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6943d-662c-43e7-930d-c9eb5d0c372f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-90c6943d-662c-43e7-930d-c9eb5d0c372f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:40:09.420136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:09.421378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:09.422379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:09.422379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:09.422379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:40:09.422379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:40:09.422379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:40:09.422379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:40:09.422379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:40:09.422379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:40:09.422379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 17:40:09.422379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:09.422379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 605/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:09.427576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84c816-408d-4a97-b227-1020bb6d7a0d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:09.476602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:09.531128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84c816-408d-4a97-b227-1020bb6d7a0d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:09.565076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fc4b9-4948-4dea-811a-497170d7afc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:09.565743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fc4b9-4948-4dea-811a-497170d7afc1 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:09.566150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fc4b9-4948-4dea-811a-497170d7afc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:09.566434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fc4b9-4948-4dea-811a-497170d7afc1 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:09.567265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fc4b9-4948-4dea-811a-497170d7afc1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:09.567573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fc4b9-4948-4dea-811a-497170d7afc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:09.569074 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fc4b9-4948-4dea-811a-497170d7afc1 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:09.586240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 622/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jul 20 17:40:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:09.593202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6943d-662c-43e7-930d-c9eb5d0c372f None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:09.696628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6943d-662c-43e7-930d-c9eb5d0c372f None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:09.732082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fe4d6-7823-4109-b02c-3017f6d14ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:09.732824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fe4d6-7823-4109-b02c-3017f6d14ff3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:09.733102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fe4d6-7823-4109-b02c-3017f6d14ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:09.733422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fe4d6-7823-4109-b02c-3017f6d14ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:09.743520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fe4d6-7823-4109-b02c-3017f6d14ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:09.745305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fe4d6-7823-4109-b02c-3017f6d14ff3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-861fe4d6-7823-4109-b02c-3017f6d14ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:09.763495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:09.764845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:09.765932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:09.765932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:09.765932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:09.765932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:09.765932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 606/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:09.770842 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fc4b9-4948-4dea-811a-497170d7afc1 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:09.879204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fc4b9-4948-4dea-811a-497170d7afc1 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:09.881751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:09.914911 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbd199-8cbd-436f-9bbf-9755a1038090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:09.915565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbd199-8cbd-436f-9bbf-9755a1038090 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:09.915847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbd199-8cbd-436f-9bbf-9755a1038090 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:09.916750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbd199-8cbd-436f-9bbf-9755a1038090 None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:09.917630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbd199-8cbd-436f-9bbf-9755a1038090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:09.917935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbd199-8cbd-436f-9bbf-9755a1038090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:09.919354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbd199-8cbd-436f-9bbf-9755a1038090 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:09.930515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 623/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:40:09.936778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fe4d6-7823-4109-b02c-3017f6d14ff3 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:09.950187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:10.039149 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fe4d6-7823-4109-b02c-3017f6d14ff3 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:10.076348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45938d86-c529-4c17-aa22-13b951828eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:10.077175 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45938d86-c529-4c17-aa22-13b951828eba None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:10.077485 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45938d86-c529-4c17-aa22-13b951828eba None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:10.077764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45938d86-c529-4c17-aa22-13b951828eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:10.084751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45938d86-c529-4c17-aa22-13b951828eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:10.086216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45938d86-c529-4c17-aa22-13b951828eba None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-45938d86-c529-4c17-aa22-13b951828eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:40:10.100561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:10.101564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:10.102550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:40:10.102550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:40:10.102550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:40:10.102550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:40:10.102550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:40:10.102550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:40:10.102550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:40:10.102550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:10.102550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 607/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:40:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:10.109239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbd199-8cbd-436f-9bbf-9755a1038090 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:10.211111 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbd199-8cbd-436f-9bbf-9755a1038090 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:10.246395 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ee3b7-d01b-42a9-80a9-6b6fa67f543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:10.247061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ee3b7-d01b-42a9-80a9-6b6fa67f543a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:10.247346 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ee3b7-d01b-42a9-80a9-6b6fa67f543a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:10.247618 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ee3b7-d01b-42a9-80a9-6b6fa67f543a None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:10.248406 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ee3b7-d01b-42a9-80a9-6b6fa67f543a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:10.255834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ee3b7-d01b-42a9-80a9-6b6fa67f543a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:10.255834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ee3b7-d01b-42a9-80a9-6b6fa67f543a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:10.262798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 624/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:40:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:10.268832 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45938d86-c529-4c17-aa22-13b951828eba None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:10.335582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:10.371030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45938d86-c529-4c17-aa22-13b951828eba None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:10.406313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f845a-a68e-42ae-b7b0-7e4ebbf5d813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:10.407202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f845a-a68e-42ae-b7b0-7e4ebbf5d813 None admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:10.407486 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f845a-a68e-42ae-b7b0-7e4ebbf5d813 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:10.407761 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f845a-a68e-42ae-b7b0-7e4ebbf5d813 None admin] PATH_INFO: `/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/b218402abe6540d8b81295676199f6f9/roles/645163d4e8634094bb7d2a16f75bd1b0` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:10.424412 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f845a-a68e-42ae-b7b0-7e4ebbf5d813 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f0f8db3986541468c474b78a9b3740a, user_id=b218402abe6540d8b81295676199f6f9, role_id=645163d4e8634094bb7d2a16f75bd1b0)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:10.425889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f845a-a68e-42ae-b7b0-7e4ebbf5d813 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:10.529887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 608/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:40:10 2022] PUT /identity/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/b218402abe6540d8b81295676199f6f9/roles/645163d4e8634094bb7d2a16f75bd1b0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:40:12.632548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9563b-67f3-418f-8a19-5cf23294a0a9 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:12.633097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9563b-67f3-418f-8a19-5cf23294a0a9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:12.633204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9563b-67f3-418f-8a19-5cf23294a0a9 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:12.634507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 625/1233] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:40:12.640142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211e284-b339-4079-ac69-629b85115fd6 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:12.640599 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211e284-b339-4079-ac69-629b85115fd6 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:12.640749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211e284-b339-4079-ac69-629b85115fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:12.658184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-0211e284-b339-4079-ac69-629b85115fd6 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:40:12.659317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0211e284-b339-4079-ac69-629b85115fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:40:12.726363 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 609/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:40:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:40:12.750398 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9563b-67f3-418f-8a19-5cf23294a0a9 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:12.776107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:12.850889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9563b-67f3-418f-8a19-5cf23294a0a9 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:12.886503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959c077-c2d9-4387-bd29-ba93c5e83550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:12.887296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959c077-c2d9-4387-bd29-ba93c5e83550 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:12.887574 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959c077-c2d9-4387-bd29-ba93c5e83550 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:12.887846 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959c077-c2d9-4387-bd29-ba93c5e83550 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:12.897798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959c077-c2d9-4387-bd29-ba93c5e83550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-6959c077-c2d9-4387-bd29-ba93c5e83550 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:40:12.906704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:12.907967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:12.909085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 626/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Jul 20 17:40:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:12.914653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211e284-b339-4079-ac69-629b85115fd6 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:12.962520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:13.015470 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211e284-b339-4079-ac69-629b85115fd6 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:13.050392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f65425-625b-4fff-9898-6fe08147db59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:13.051068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f65425-625b-4fff-9898-6fe08147db59 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:13.051354 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f65425-625b-4fff-9898-6fe08147db59 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:13.051629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f65425-625b-4fff-9898-6fe08147db59 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:13.052392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f65425-625b-4fff-9898-6fe08147db59 None admin] RBAC: Adding query filter params (name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:13.052753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f65425-625b-4fff-9898-6fe08147db59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:13.054123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f65425-625b-4fff-9898-6fe08147db59 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:13.062229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 610/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Jul 20 17:40:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:13.068130 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959c077-c2d9-4387-bd29-ba93c5e83550 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:13.154496 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:13.170232 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959c077-c2d9-4387-bd29-ba93c5e83550 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:13.204318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719faaac-44d9-43f4-8d34-6160c4df3e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:13.205139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719faaac-44d9-43f4-8d34-6160c4df3e5e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:13.205415 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719faaac-44d9-43f4-8d34-6160c4df3e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:13.205682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719faaac-44d9-43f4-8d34-6160c4df3e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:13.216657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719faaac-44d9-43f4-8d34-6160c4df3e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:13.218096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719faaac-44d9-43f4-8d34-6160c4df3e5e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-719faaac-44d9-43f4-8d34-6160c4df3e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:13.236147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:13.237319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:13.238425 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:13.238425 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:13.238425 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:13.238425 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:13.238425 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 627/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:13.243553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f65425-625b-4fff-9898-6fe08147db59 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:13.345302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f65425-625b-4fff-9898-6fe08147db59 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:13.354748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:13.381942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4853e-dcbc-4696-a996-5f721ee402d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:13.382608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4853e-dcbc-4696-a996-5f721ee402d2 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:13.382887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4853e-dcbc-4696-a996-5f721ee402d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:13.383162 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4853e-dcbc-4696-a996-5f721ee402d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:13.383880 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4853e-dcbc-4696-a996-5f721ee402d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:13.384211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4853e-dcbc-4696-a996-5f721ee402d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:13.386974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4853e-dcbc-4696-a996-5f721ee402d2 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:13.399259 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 611/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:13.408759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719faaac-44d9-43f4-8d34-6160c4df3e5e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:13.509183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719faaac-44d9-43f4-8d34-6160c4df3e5e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:13.543158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c89667-4864-4362-972b-a370192f2cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:13.543945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c89667-4864-4362-972b-a370192f2cad None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:13.544226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c89667-4864-4362-972b-a370192f2cad None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:13.544525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c89667-4864-4362-972b-a370192f2cad None admin] PATH_INFO: `/v3/users/placement` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:13.547195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:13.551572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c89667-4864-4362-972b-a370192f2cad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:13.553098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c89667-4864-4362-972b-a370192f2cad None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-43c89667-4864-4362-972b-a370192f2cad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:40:13.569370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:13.570569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:13.571580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:13.571580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:13.571580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:40:13.571580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:40:13.571580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:40:13.571580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:40:13.571580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:40:13.571580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:40:13.571580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 17:40:13.571580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:13.571580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 628/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:13.577157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4853e-dcbc-4696-a996-5f721ee402d2 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:13.678579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4853e-dcbc-4696-a996-5f721ee402d2 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:13.712601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931354fc-758b-4033-9f5f-26b55a95d4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:13.713539 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931354fc-758b-4033-9f5f-26b55a95d4b9 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:13.713819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931354fc-758b-4033-9f5f-26b55a95d4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:13.714093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931354fc-758b-4033-9f5f-26b55a95d4b9 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:13.714916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931354fc-758b-4033-9f5f-26b55a95d4b9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:13.715221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931354fc-758b-4033-9f5f-26b55a95d4b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:13.716752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931354fc-758b-4033-9f5f-26b55a95d4b9 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:13.734396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 612/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jul 20 17:40:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:13.740440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c89667-4864-4362-972b-a370192f2cad None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:13.840454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c89667-4864-4362-972b-a370192f2cad None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:13.875812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bba3e-4c10-4e8d-8964-6f0a33eb984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:13.876500 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bba3e-4c10-4e8d-8964-6f0a33eb984e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:13.876778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bba3e-4c10-4e8d-8964-6f0a33eb984e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:13.877094 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bba3e-4c10-4e8d-8964-6f0a33eb984e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:13.938989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:13.945727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bba3e-4c10-4e8d-8964-6f0a33eb984e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:13.947231 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bba3e-4c10-4e8d-8964-6f0a33eb984e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:14.047898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 629/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:40:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:40:14.053831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931354fc-758b-4033-9f5f-26b55a95d4b9 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:14.082475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:14.155730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931354fc-758b-4033-9f5f-26b55a95d4b9 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:14.190595 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387f635-146b-4e4f-a399-d990e10d7c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:14.191406 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387f635-146b-4e4f-a399-d990e10d7c12 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:14.191689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387f635-146b-4e4f-a399-d990e10d7c12 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:14.191963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387f635-146b-4e4f-a399-d990e10d7c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:14.203770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387f635-146b-4e4f-a399-d990e10d7c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:14.205304 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387f635-146b-4e4f-a399-d990e10d7c12 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-1387f635-146b-4e4f-a399-d990e10d7c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:14.225602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:14.226885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:14.228131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:14.228131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:14.228131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:14.228131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:14.228131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 613/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:14.233969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bba3e-4c10-4e8d-8964-6f0a33eb984e None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:14.328428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:14.334340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bba3e-4c10-4e8d-8964-6f0a33eb984e None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:14.370066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c7d0a-99af-4128-8547-9eab38b1909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:14.370756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c7d0a-99af-4128-8547-9eab38b1909b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:14.371040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c7d0a-99af-4128-8547-9eab38b1909b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:14.371314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c7d0a-99af-4128-8547-9eab38b1909b None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:14.372056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c7d0a-99af-4128-8547-9eab38b1909b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:14.372409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c7d0a-99af-4128-8547-9eab38b1909b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:14.373800 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c7d0a-99af-4128-8547-9eab38b1909b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:14.385545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 630/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:14.391392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387f635-146b-4e4f-a399-d990e10d7c12 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:14.473340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:14.494952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387f635-146b-4e4f-a399-d990e10d7c12 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:14.529935 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215f389-570c-429a-b5a0-b109570e697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:14.530728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215f389-570c-429a-b5a0-b109570e697d None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:14.531067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215f389-570c-429a-b5a0-b109570e697d None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:14.531343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215f389-570c-429a-b5a0-b109570e697d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:14.538411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215f389-570c-429a-b5a0-b109570e697d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:14.539849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215f389-570c-429a-b5a0-b109570e697d None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-c215f389-570c-429a-b5a0-b109570e697d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:40:14.553517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:14.554626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:14.561394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:40:14.561394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:40:14.561394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:40:14.561394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:40:14.561394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:40:14.561394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:40:14.561394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:40:14.561394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:14.561394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 614/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:40:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:14.562003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c7d0a-99af-4128-8547-9eab38b1909b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:14.666420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c7d0a-99af-4128-8547-9eab38b1909b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:14.701932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972b704-ace8-4439-9579-b4ebfea50954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:14.703873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972b704-ace8-4439-9579-b4ebfea50954 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:14.703873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972b704-ace8-4439-9579-b4ebfea50954 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:14.703873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972b704-ace8-4439-9579-b4ebfea50954 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:14.704130 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972b704-ace8-4439-9579-b4ebfea50954 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:14.704357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972b704-ace8-4439-9579-b4ebfea50954 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:14.705824 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972b704-ace8-4439-9579-b4ebfea50954 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:14.718342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 631/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:40:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:14.724580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215f389-570c-429a-b5a0-b109570e697d None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:14.826681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215f389-570c-429a-b5a0-b109570e697d None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:14.863788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e1974-afdb-4a53-ab50-2d9179f5b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:14.864449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e1974-afdb-4a53-ab50-2d9179f5b2fd None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:14.864761 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e1974-afdb-4a53-ab50-2d9179f5b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:14.865047 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e1974-afdb-4a53-ab50-2d9179f5b2fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:14.865877 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e1974-afdb-4a53-ab50-2d9179f5b2fd None admin] RBAC: Adding query filter params (role.id=645163d4e8634094bb7d2a16f75bd1b0, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=b218402abe6540d8b81295676199f6f9) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:14.866189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e1974-afdb-4a53-ab50-2d9179f5b2fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:14.867714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e1974-afdb-4a53-ab50-2d9179f5b2fd None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:14.874055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 615/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:40:14 2022] GET /identity/v3/role_assignments?user.id=b218402abe6540d8b81295676199f6f9&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=645163d4e8634094bb7d2a16f75bd1b0 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:17.048461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4c4f9-3984-4b6b-a9ed-e4d70c8a09bc None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:17.049076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4c4f9-3984-4b6b-a9ed-e4d70c8a09bc None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:17.049076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4c4f9-3984-4b6b-a9ed-e4d70c8a09bc None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:17.050504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 632/1247] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:40:17.055724 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c1cbc-4aa5-47cd-918d-f8992db1f9e5 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:17.056135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c1cbc-4aa5-47cd-918d-f8992db1f9e5 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:17.056274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c1cbc-4aa5-47cd-918d-f8992db1f9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:17.061976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:17.074278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-854c1cbc-4aa5-47cd-918d-f8992db1f9e5 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:40:17.075553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-854c1cbc-4aa5-47cd-918d-f8992db1f9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:40:17.145158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 616/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:40:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:40:17.170167 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4c4f9-3984-4b6b-a9ed-e4d70c8a09bc None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:17.188264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:17.273066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4c4f9-3984-4b6b-a9ed-e4d70c8a09bc None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:17.310304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48885d8-ef4a-4ae4-be28-4d1b05b315bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:17.311019 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48885d8-ef4a-4ae4-be28-4d1b05b315bc None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:17.311298 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48885d8-ef4a-4ae4-be28-4d1b05b315bc None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:17.311571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48885d8-ef4a-4ae4-be28-4d1b05b315bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:17.321557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48885d8-ef4a-4ae4-be28-4d1b05b315bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-d48885d8-ef4a-4ae4-be28-4d1b05b315bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:40:17.329188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:17.330375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:17.331617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 633/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:40:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:17.336444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c1cbc-4aa5-47cd-918d-f8992db1f9e5 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:17.439907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c1cbc-4aa5-47cd-918d-f8992db1f9e5 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:17.470245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:17.474981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bac57d-2feb-49e0-ba29-7d3601585377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:17.475687 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bac57d-2feb-49e0-ba29-7d3601585377 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:17.475967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bac57d-2feb-49e0-ba29-7d3601585377 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:17.476239 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bac57d-2feb-49e0-ba29-7d3601585377 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:17.477011 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bac57d-2feb-49e0-ba29-7d3601585377 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:17.477315 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bac57d-2feb-49e0-ba29-7d3601585377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:17.479343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bac57d-2feb-49e0-ba29-7d3601585377 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:17.488339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 617/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:40:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:17.494765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48885d8-ef4a-4ae4-be28-4d1b05b315bc None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:17.575480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:17.597912 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48885d8-ef4a-4ae4-be28-4d1b05b315bc None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:17.630841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21558192-5deb-4394-ac95-03390ac38c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:17.631630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21558192-5deb-4394-ac95-03390ac38c3c None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:17.631954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21558192-5deb-4394-ac95-03390ac38c3c None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:17.632232 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21558192-5deb-4394-ac95-03390ac38c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:17.643389 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21558192-5deb-4394-ac95-03390ac38c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:17.644915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21558192-5deb-4394-ac95-03390ac38c3c None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-21558192-5deb-4394-ac95-03390ac38c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:17.663286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:17.664461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:17.665732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:17.665732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:17.665732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:17.665732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:17.665732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 634/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:17.670485 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bac57d-2feb-49e0-ba29-7d3601585377 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:17.777533 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bac57d-2feb-49e0-ba29-7d3601585377 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:17.811950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d6f6f-2e95-4bb2-8c7b-696dae967175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:17.812635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d6f6f-2e95-4bb2-8c7b-696dae967175 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:17.812922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d6f6f-2e95-4bb2-8c7b-696dae967175 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:17.813203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d6f6f-2e95-4bb2-8c7b-696dae967175 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:17.813939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d6f6f-2e95-4bb2-8c7b-696dae967175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:17.814250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d6f6f-2e95-4bb2-8c7b-696dae967175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:17.815684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d6f6f-2e95-4bb2-8c7b-696dae967175 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:17.828013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 618/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:17.833701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21558192-5deb-4394-ac95-03390ac38c3c None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:17.935158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21558192-5deb-4394-ac95-03390ac38c3c None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:17.961540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:17.969915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc61dd-f682-4621-bc8e-a68846535262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:17.976702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc61dd-f682-4621-bc8e-a68846535262 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:17.976702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc61dd-f682-4621-bc8e-a68846535262 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:17.976702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc61dd-f682-4621-bc8e-a68846535262 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:17.979872 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc61dd-f682-4621-bc8e-a68846535262 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:17.981436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc61dd-f682-4621-bc8e-a68846535262 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-21bc61dd-f682-4621-bc8e-a68846535262 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:40:17.997354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:17.998833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:18.000038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:18.000038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:18.000038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:40:18.000038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:40:18.000038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:40:18.000038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:40:18.000038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:40:18.000038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:40:18.000038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 17:40:18.000038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:18.000038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 635/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:18.004742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d6f6f-2e95-4bb2-8c7b-696dae967175 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:18.061504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:18.109036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d6f6f-2e95-4bb2-8c7b-696dae967175 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:18.141679 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646cd78-e62a-455a-a15e-7ed5cdd832c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:18.142348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646cd78-e62a-455a-a15e-7ed5cdd832c7 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:18.143945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646cd78-e62a-455a-a15e-7ed5cdd832c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:18.143945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646cd78-e62a-455a-a15e-7ed5cdd832c7 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:18.143945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646cd78-e62a-455a-a15e-7ed5cdd832c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:18.144240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646cd78-e62a-455a-a15e-7ed5cdd832c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:18.145492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646cd78-e62a-455a-a15e-7ed5cdd832c7 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:18.164042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 619/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jul 20 17:40:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:18.170631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc61dd-f682-4621-bc8e-a68846535262 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:18.273110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc61dd-f682-4621-bc8e-a68846535262 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:18.307845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942a839-8e7a-4a8e-9fda-f30b70f77e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:18.308519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942a839-8e7a-4a8e-9fda-f30b70f77e94 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:18.308812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942a839-8e7a-4a8e-9fda-f30b70f77e94 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:18.309092 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942a839-8e7a-4a8e-9fda-f30b70f77e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:18.364652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:18.377008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942a839-8e7a-4a8e-9fda-f30b70f77e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:18.379491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942a839-8e7a-4a8e-9fda-f30b70f77e94 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:18.477750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 636/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:40:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:40:18.483807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646cd78-e62a-455a-a15e-7ed5cdd832c7 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:18.584874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646cd78-e62a-455a-a15e-7ed5cdd832c7 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:18.599290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:18.621385 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f71ede-0fe1-43bb-b471-32793a561802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:18.622090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f71ede-0fe1-43bb-b471-32793a561802 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:18.622369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f71ede-0fe1-43bb-b471-32793a561802 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:18.622668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f71ede-0fe1-43bb-b471-32793a561802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:18.632607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f71ede-0fe1-43bb-b471-32793a561802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:18.636905 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f71ede-0fe1-43bb-b471-32793a561802 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-74f71ede-0fe1-43bb-b471-32793a561802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:18.652620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:18.654297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:18.656008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:18.656008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:18.656008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:18.656008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:18.656008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 620/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:18.659653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942a839-8e7a-4a8e-9fda-f30b70f77e94 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:18.749798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:18.762241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942a839-8e7a-4a8e-9fda-f30b70f77e94 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:18.795894 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadadf9c-dfde-4777-bcfc-568b5be44dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:18.796586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadadf9c-dfde-4777-bcfc-568b5be44dce None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:18.796868 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadadf9c-dfde-4777-bcfc-568b5be44dce None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:18.797165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadadf9c-dfde-4777-bcfc-568b5be44dce None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:18.797888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadadf9c-dfde-4777-bcfc-568b5be44dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:18.798392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadadf9c-dfde-4777-bcfc-568b5be44dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:18.800351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadadf9c-dfde-4777-bcfc-568b5be44dce None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:18.812916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 637/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:18.818716 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f71ede-0fe1-43bb-b471-32793a561802 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:18.931132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f71ede-0fe1-43bb-b471-32793a561802 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:18.966238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2274fad-806b-4b9a-b7b7-1d0601740ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:18.967034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274fad-806b-4b9a-b7b7-1d0601740ab8 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:18.967318 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274fad-806b-4b9a-b7b7-1d0601740ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:18.967594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274fad-806b-4b9a-b7b7-1d0601740ab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:18.974502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2274fad-806b-4b9a-b7b7-1d0601740ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:18.975939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2274fad-806b-4b9a-b7b7-1d0601740ab8 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-f2274fad-806b-4b9a-b7b7-1d0601740ab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:40:18.990626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:18.993202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:18.994844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:40:18.994844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:40:18.994844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:40:18.994844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:40:18.994844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:40:18.994844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:40:18.994844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:40:18.994844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:18.994844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 621/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:40:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:18.998630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadadf9c-dfde-4777-bcfc-568b5be44dce None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:19.106147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadadf9c-dfde-4777-bcfc-568b5be44dce None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:19.141331 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475fd64-dfe2-4939-b01b-36605c72d024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:19.141997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475fd64-dfe2-4939-b01b-36605c72d024 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:19.142276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475fd64-dfe2-4939-b01b-36605c72d024 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:19.142548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475fd64-dfe2-4939-b01b-36605c72d024 None admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:19.143337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475fd64-dfe2-4939-b01b-36605c72d024 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:19.143645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475fd64-dfe2-4939-b01b-36605c72d024 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:19.145174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475fd64-dfe2-4939-b01b-36605c72d024 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:19.158472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 638/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:40:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:19.164955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2274fad-806b-4b9a-b7b7-1d0601740ab8 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:19.196426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:19.266594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2274fad-806b-4b9a-b7b7-1d0601740ab8 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:19.301425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cf795-91c9-4b2a-b4d2-a7243bc61bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:19.302081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cf795-91c9-4b2a-b4d2-a7243bc61bd3 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:19.302359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cf795-91c9-4b2a-b4d2-a7243bc61bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:19.302628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cf795-91c9-4b2a-b4d2-a7243bc61bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:19.303452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cf795-91c9-4b2a-b4d2-a7243bc61bd3 None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=b218402abe6540d8b81295676199f6f9) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:19.303757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cf795-91c9-4b2a-b4d2-a7243bc61bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:19.305199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cf795-91c9-4b2a-b4d2-a7243bc61bd3 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:19.311440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 622/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:40:19 2022] GET /identity/v3/role_assignments?user.id=b218402abe6540d8b81295676199f6f9&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:21.405877 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0005a3-4973-4610-be91-ddc55181aaf2 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:21.406415 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0005a3-4973-4610-be91-ddc55181aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:21.406415 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0005a3-4973-4610-be91-ddc55181aaf2 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:21.407774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 639/1261] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:40:21.413502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99be838-31c2-4ed6-9230-769208fdf9d2 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:21.413983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99be838-31c2-4ed6-9230-769208fdf9d2 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:21.414076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99be838-31c2-4ed6-9230-769208fdf9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:21.430920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-b99be838-31c2-4ed6-9230-769208fdf9d2 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:40:21.432162 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b99be838-31c2-4ed6-9230-769208fdf9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:40:21.500166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 623/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:40:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:40:21.523568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0005a3-4973-4610-be91-ddc55181aaf2 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:21.536900 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:21.627907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0005a3-4973-4610-be91-ddc55181aaf2 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:21.663765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274d65a-0b42-489b-93d9-4f466fddaecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:21.664201 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274d65a-0b42-489b-93d9-4f466fddaecb None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:21.664510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274d65a-0b42-489b-93d9-4f466fddaecb None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:21.664784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274d65a-0b42-489b-93d9-4f466fddaecb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:21.675914 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274d65a-0b42-489b-93d9-4f466fddaecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-d274d65a-0b42-489b-93d9-4f466fddaecb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:40:21.684404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:21.685517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:21.686906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 640/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:21.691945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99be838-31c2-4ed6-9230-769208fdf9d2 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:21.711095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:21.792988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99be838-31c2-4ed6-9230-769208fdf9d2 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:21.830200 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9fcca-81a4-459a-bfaa-36993cf14284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:21.830818 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9fcca-81a4-459a-bfaa-36993cf14284 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:21.831100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9fcca-81a4-459a-bfaa-36993cf14284 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:21.831372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9fcca-81a4-459a-bfaa-36993cf14284 None admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:21.832190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9fcca-81a4-459a-bfaa-36993cf14284 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:21.832517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9fcca-81a4-459a-bfaa-36993cf14284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:21.833939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9fcca-81a4-459a-bfaa-36993cf14284 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:21.844415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 624/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:40:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:21.850571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274d65a-0b42-489b-93d9-4f466fddaecb None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:21.919736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:21.953221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274d65a-0b42-489b-93d9-4f466fddaecb None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:21.986871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211c80f-c08e-451b-addf-cffe37467ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:21.987659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211c80f-c08e-451b-addf-cffe37467ae6 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:21.987941 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211c80f-c08e-451b-addf-cffe37467ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:21.988217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211c80f-c08e-451b-addf-cffe37467ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:21.999943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211c80f-c08e-451b-addf-cffe37467ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:22.001401 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211c80f-c08e-451b-addf-cffe37467ae6 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-e211c80f-c08e-451b-addf-cffe37467ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:22.018795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:22.023815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:22.025171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:22.025171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:22.025171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:22.025171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:22.025171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 641/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:22.026244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9fcca-81a4-459a-bfaa-36993cf14284 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:22.109514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:22.128595 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9fcca-81a4-459a-bfaa-36993cf14284 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:22.169245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e133789-b565-41a7-8390-d1ca5dc01905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:22.169958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e133789-b565-41a7-8390-d1ca5dc01905 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:22.170184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e133789-b565-41a7-8390-d1ca5dc01905 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:22.170454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e133789-b565-41a7-8390-d1ca5dc01905 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:22.171169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e133789-b565-41a7-8390-d1ca5dc01905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:22.171472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e133789-b565-41a7-8390-d1ca5dc01905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:22.172856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e133789-b565-41a7-8390-d1ca5dc01905 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:22.185120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 625/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:22.192084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211c80f-c08e-451b-addf-cffe37467ae6 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:22.298233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211c80f-c08e-451b-addf-cffe37467ae6 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:22.321208 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:22.335929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f793-b2e4-498a-a88d-d23771a78b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:22.336822 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f793-b2e4-498a-a88d-d23771a78b1d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:22.337097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f793-b2e4-498a-a88d-d23771a78b1d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:22.337927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f793-b2e4-498a-a88d-d23771a78b1d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:22.347591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5f793-b2e4-498a-a88d-d23771a78b1d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:22.349096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5f793-b2e4-498a-a88d-d23771a78b1d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-88c5f793-b2e4-498a-a88d-d23771a78b1d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:40:22.364726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:22.365756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:22.366774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:22.366774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:22.366774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:40:22.366774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:40:22.366774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:40:22.366774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:40:22.366774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:40:22.366774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:40:22.366774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 17:40:22.366774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:22.366774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 642/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:22.372347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e133789-b565-41a7-8390-d1ca5dc01905 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:22.483996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e133789-b565-41a7-8390-d1ca5dc01905 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:22.517899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd11cc-9019-4947-bd29-5532b9e06e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:22.518566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd11cc-9019-4947-bd29-5532b9e06e23 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:22.518851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd11cc-9019-4947-bd29-5532b9e06e23 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:22.519130 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd11cc-9019-4947-bd29-5532b9e06e23 None admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:22.519966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd11cc-9019-4947-bd29-5532b9e06e23 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:22.520276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd11cc-9019-4947-bd29-5532b9e06e23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:22.521729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd11cc-9019-4947-bd29-5532b9e06e23 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:22.531462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:22.539818 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 626/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jul 20 17:40:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:22.546483 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f793-b2e4-498a-a88d-d23771a78b1d None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:22.653394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f793-b2e4-498a-a88d-d23771a78b1d None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:22.691034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa98f39-231e-4c44-a588-abffcdd8a4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:22.691835 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa98f39-231e-4c44-a588-abffcdd8a4a4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:22.692121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa98f39-231e-4c44-a588-abffcdd8a4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:22.692398 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa98f39-231e-4c44-a588-abffcdd8a4a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:22.704875 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa98f39-231e-4c44-a588-abffcdd8a4a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:22.706350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa98f39-231e-4c44-a588-abffcdd8a4a4 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-7fa98f39-231e-4c44-a588-abffcdd8a4a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:22.725126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:22.726570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:22.727778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:22.727778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:22.727778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:22.727778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:22.727778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 643/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:22.732976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd11cc-9019-4947-bd29-5532b9e06e23 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:22.842054 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd11cc-9019-4947-bd29-5532b9e06e23 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:22.877137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214f951-547d-4d96-b535-aa7b60124275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:22.877830 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214f951-547d-4d96-b535-aa7b60124275 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:22.878116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214f951-547d-4d96-b535-aa7b60124275 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:22.878396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214f951-547d-4d96-b535-aa7b60124275 None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:22.879154 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214f951-547d-4d96-b535-aa7b60124275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:22.879466 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214f951-547d-4d96-b535-aa7b60124275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:22.880864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214f951-547d-4d96-b535-aa7b60124275 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:22.893245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 627/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:22.898906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa98f39-231e-4c44-a588-abffcdd8a4a4 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:22.932105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:23.000451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa98f39-231e-4c44-a588-abffcdd8a4a4 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:23.034319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4f66d-ee10-4d07-be04-92cf12d3db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:23.035116 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4f66d-ee10-4d07-be04-92cf12d3db69 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:23.035399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4f66d-ee10-4d07-be04-92cf12d3db69 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:23.035676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4f66d-ee10-4d07-be04-92cf12d3db69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:23.043241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4f66d-ee10-4d07-be04-92cf12d3db69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:23.045274 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4f66d-ee10-4d07-be04-92cf12d3db69 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-a7f4f66d-ee10-4d07-be04-92cf12d3db69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:40:23.059831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:23.060936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:23.062054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:40:23.062054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:40:23.062054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:40:23.062054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:40:23.062054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:40:23.062054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:40:23.062054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:40:23.062054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:23.062054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 644/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:40:23.067089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214f951-547d-4d96-b535-aa7b60124275 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:23.126134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:23.168306 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214f951-547d-4d96-b535-aa7b60124275 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:23.201100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9518f-a235-44f4-828f-ecd2b009d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:23.201750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9518f-a235-44f4-828f-ecd2b009d7dc None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:23.202029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9518f-a235-44f4-828f-ecd2b009d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:23.202301 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9518f-a235-44f4-828f-ecd2b009d7dc None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:23.203097 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9518f-a235-44f4-828f-ecd2b009d7dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:23.203401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9518f-a235-44f4-828f-ecd2b009d7dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:23.204835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9518f-a235-44f4-828f-ecd2b009d7dc None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:23.217446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 628/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:40:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:23.223886 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4f66d-ee10-4d07-be04-92cf12d3db69 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:23.316581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:23.325329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4f66d-ee10-4d07-be04-92cf12d3db69 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:23.360498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209810a-f9f5-4ec6-8fd1-126189300edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:23.361400 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209810a-f9f5-4ec6-8fd1-126189300edc None admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:23.361677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209810a-f9f5-4ec6-8fd1-126189300edc None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:23.361946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209810a-f9f5-4ec6-8fd1-126189300edc None admin] PATH_INFO: `/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/b218402abe6540d8b81295676199f6f9/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:23.363857 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209810a-f9f5-4ec6-8fd1-126189300edc None admin] RBAC: Authorizing `identity:create_grant(project_id=5f0f8db3986541468c474b78a9b3740a, user_id=b218402abe6540d8b81295676199f6f9, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:23.365297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209810a-f9f5-4ec6-8fd1-126189300edc None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:23.477633 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 645/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Jul 20 17:40:23 2022] PUT /identity/v3/projects/5f0f8db3986541468c474b78a9b3740a/users/b218402abe6540d8b81295676199f6f9/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:40:25.534974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76b34e-21be-4fee-9444-27a0553eaac7 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:25.535541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76b34e-21be-4fee-9444-27a0553eaac7 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:25.535541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76b34e-21be-4fee-9444-27a0553eaac7 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:25.537359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 629/1274] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:40:25.543284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaa935-dc85-48b5-9dd5-070d51fb7387 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:25.543763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaa935-dc85-48b5-9dd5-070d51fb7387 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:25.543892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaa935-dc85-48b5-9dd5-070d51fb7387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:25.560506 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-2eeaa935-dc85-48b5-9dd5-070d51fb7387 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:40:25.561724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2eeaa935-dc85-48b5-9dd5-070d51fb7387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:40:25.631620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 646/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:40:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:40:25.655837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76b34e-21be-4fee-9444-27a0553eaac7 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:25.768041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76b34e-21be-4fee-9444-27a0553eaac7 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:25.788264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:25.806869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee90f33-1604-433c-8a3c-3275d820530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:25.807722 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee90f33-1604-433c-8a3c-3275d820530e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:25.808030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee90f33-1604-433c-8a3c-3275d820530e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:25.808314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee90f33-1604-433c-8a3c-3275d820530e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:25.820422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee90f33-1604-433c-8a3c-3275d820530e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-6ee90f33-1604-433c-8a3c-3275d820530e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 17:40:25.828950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:25.830095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:25.830944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 630/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Jul 20 17:40:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 17:40:25.836620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaa935-dc85-48b5-9dd5-070d51fb7387 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:25.928260 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:25.949656 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaa935-dc85-48b5-9dd5-070d51fb7387 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:25.987866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3105e3-5e76-4744-b72c-530596a6075b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:25.988642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3105e3-5e76-4744-b72c-530596a6075b None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:25.988927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3105e3-5e76-4744-b72c-530596a6075b None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:25.989205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3105e3-5e76-4744-b72c-530596a6075b None admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:25.990036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3105e3-5e76-4744-b72c-530596a6075b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:25.990342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3105e3-5e76-4744-b72c-530596a6075b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:25.991766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3105e3-5e76-4744-b72c-530596a6075b None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:26.002242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 647/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Jul 20 17:40:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:26.008060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee90f33-1604-433c-8a3c-3275d820530e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:26.127081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee90f33-1604-433c-8a3c-3275d820530e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:26.164787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea707d5-030a-4ccb-a2df-3e6287e04647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:26.167117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea707d5-030a-4ccb-a2df-3e6287e04647 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:26.167400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea707d5-030a-4ccb-a2df-3e6287e04647 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:26.167675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea707d5-030a-4ccb-a2df-3e6287e04647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:26.179694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea707d5-030a-4ccb-a2df-3e6287e04647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:26.181141 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea707d5-030a-4ccb-a2df-3e6287e04647 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-cea707d5-030a-4ccb-a2df-3e6287e04647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:26.201468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:26.202650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:26.203757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:26.203757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:26.203757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:26.203757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:26.203757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 631/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:26.209595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3105e3-5e76-4744-b72c-530596a6075b None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:26.317726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3105e3-5e76-4744-b72c-530596a6075b None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:26.356880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc9e75-e4a5-4833-b1b3-5a3482269f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:26.357552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc9e75-e4a5-4833-b1b3-5a3482269f1a None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:26.357835 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc9e75-e4a5-4833-b1b3-5a3482269f1a None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:26.358149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc9e75-e4a5-4833-b1b3-5a3482269f1a None admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:26.358837 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc9e75-e4a5-4833-b1b3-5a3482269f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:26.359146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc9e75-e4a5-4833-b1b3-5a3482269f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:26.360520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc9e75-e4a5-4833-b1b3-5a3482269f1a None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:26.373881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 648/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:26.380376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea707d5-030a-4ccb-a2df-3e6287e04647 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:26.417056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:26.487306 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea707d5-030a-4ccb-a2df-3e6287e04647 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:26.521230 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5790a25-38f0-4d83-b6a0-02b6b68fa71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:26.522028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5790a25-38f0-4d83-b6a0-02b6b68fa71c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:26.522313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5790a25-38f0-4d83-b6a0-02b6b68fa71c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:26.522591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5790a25-38f0-4d83-b6a0-02b6b68fa71c None admin] PATH_INFO: `/v3/users/placement` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:26.531612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5790a25-38f0-4d83-b6a0-02b6b68fa71c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:26.533151 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5790a25-38f0-4d83-b6a0-02b6b68fa71c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-c5790a25-38f0-4d83-b6a0-02b6b68fa71c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 17:40:26.548352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:26.549996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:26.551089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:26.551089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:26.551089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 17:40:26.551089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 17:40:26.551089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 17:40:26.551089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 17:40:26.551089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 17:40:26.551089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 17:40:26.551089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 17:40:26.551089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:26.551089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 632/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:26.555538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc9e75-e4a5-4833-b1b3-5a3482269f1a None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:26.559512 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:26.657835 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc9e75-e4a5-4833-b1b3-5a3482269f1a None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:26.691481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e077e-7176-470f-a19d-06f43d9709c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:26.692146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e077e-7176-470f-a19d-06f43d9709c7 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:26.692423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e077e-7176-470f-a19d-06f43d9709c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:26.692729 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e077e-7176-470f-a19d-06f43d9709c7 None admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:26.693561 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e077e-7176-470f-a19d-06f43d9709c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:26.693865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e077e-7176-470f-a19d-06f43d9709c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:26.695337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e077e-7176-470f-a19d-06f43d9709c7 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:26.714478 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 649/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Jul 20 17:40:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:26.720262 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5790a25-38f0-4d83-b6a0-02b6b68fa71c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:26.811698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:26.820790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5790a25-38f0-4d83-b6a0-02b6b68fa71c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:26.855449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5153ba3-9a48-4e23-8bc0-d4a71704fce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:26.856102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153ba3-9a48-4e23-8bc0-d4a71704fce2 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:26.856388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153ba3-9a48-4e23-8bc0-d4a71704fce2 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:26.856700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5153ba3-9a48-4e23-8bc0-d4a71704fce2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:26.928751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5153ba3-9a48-4e23-8bc0-d4a71704fce2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:26.930270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5153ba3-9a48-4e23-8bc0-d4a71704fce2 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:27.019647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:27.029802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 633/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Jul 20 17:40:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 17:40:27.035584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e077e-7176-470f-a19d-06f43d9709c7 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:27.097878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:27.136780 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e077e-7176-470f-a19d-06f43d9709c7 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:27.171448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec78c78-eac3-4139-8e27-a360daf9c238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:27.172237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec78c78-eac3-4139-8e27-a360daf9c238 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:27.172543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec78c78-eac3-4139-8e27-a360daf9c238 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:27.172867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec78c78-eac3-4139-8e27-a360daf9c238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:27.183847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec78c78-eac3-4139-8e27-a360daf9c238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:27.185435 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec78c78-eac3-4139-8e27-a360daf9c238 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-bec78c78-eac3-4139-8e27-a360daf9c238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 17:40:27.202884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:27.203958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:27.204949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 17:40:27.204949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 17:40:27.204949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 17:40:27.204949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:27.204949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 650/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:27.212402 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5153ba3-9a48-4e23-8bc0-d4a71704fce2 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:27.313243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5153ba3-9a48-4e23-8bc0-d4a71704fce2 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:27.347192 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f087fa-7bd6-45db-9914-a72505e29c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:27.347850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f087fa-7bd6-45db-9914-a72505e29c6c None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:27.348181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f087fa-7bd6-45db-9914-a72505e29c6c None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:27.348450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f087fa-7bd6-45db-9914-a72505e29c6c None admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:27.349335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f087fa-7bd6-45db-9914-a72505e29c6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:27.349667 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f087fa-7bd6-45db-9914-a72505e29c6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:27.351023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f087fa-7bd6-45db-9914-a72505e29c6c None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:27.363415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 634/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Jul 20 17:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:27.370453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec78c78-eac3-4139-8e27-a360daf9c238 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:27.472976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec78c78-eac3-4139-8e27-a360daf9c238 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:27.487747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:27.508129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f892-7bb6-4630-96de-9808eefac8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:27.509059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f892-7bb6-4630-96de-9808eefac8c2 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:27.509878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f892-7bb6-4630-96de-9808eefac8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:27.510159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f892-7bb6-4630-96de-9808eefac8c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:27.517049 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56f892-7bb6-4630-96de-9808eefac8c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:27.518476 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56f892-7bb6-4630-96de-9808eefac8c2 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application [None req-db56f892-7bb6-4630-96de-9808eefac8c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 17:40:27.532716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:27.533817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:27.534963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 17:40:27.534963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 17:40:27.534963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 17:40:27.534963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 17:40:27.534963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 17:40:27.534963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 17:40:27.534963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 17:40:27.534963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: ERROR keystone.server.flask.application Jul 20 17:40:27.534963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 651/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Jul 20 17:40:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:27.540873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f087fa-7bd6-45db-9914-a72505e29c6c None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:27.592442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:27.641993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f087fa-7bd6-45db-9914-a72505e29c6c None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:27.675829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298859a9-f872-46b5-ba92-80c35f8b7638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:27.676502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298859a9-f872-46b5-ba92-80c35f8b7638 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:27.676791 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298859a9-f872-46b5-ba92-80c35f8b7638 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:27.677069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298859a9-f872-46b5-ba92-80c35f8b7638 None admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:27.677946 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298859a9-f872-46b5-ba92-80c35f8b7638 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:27.678255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298859a9-f872-46b5-ba92-80c35f8b7638 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:27.679684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298859a9-f872-46b5-ba92-80c35f8b7638 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:27.692659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 635/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Jul 20 17:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:27.699290 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f892-7bb6-4630-96de-9808eefac8c2 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:27.804131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f892-7bb6-4630-96de-9808eefac8c2 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:27.839077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d603ea9-0179-4f0d-b133-25cd47cf671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:27.839731 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d603ea9-0179-4f0d-b133-25cd47cf671e None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:27.840014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d603ea9-0179-4f0d-b133-25cd47cf671e None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:27.840289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d603ea9-0179-4f0d-b133-25cd47cf671e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:27.841149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d603ea9-0179-4f0d-b133-25cd47cf671e None admin] RBAC: Adding query filter params (role.id=521b4306dc4a467ebe7f9b80ec988a28, scope.project.id=5f0f8db3986541468c474b78a9b3740a, user.id=b218402abe6540d8b81295676199f6f9) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:27.841464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d603ea9-0179-4f0d-b133-25cd47cf671e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:27.842946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d603ea9-0179-4f0d-b133-25cd47cf671e None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:27.848802 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 652/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Jul 20 17:40:27 2022] GET /identity/v3/role_assignments?user.id=b218402abe6540d8b81295676199f6f9&scope.project.id=5f0f8db3986541468c474b78a9b3740a&role.id=521b4306dc4a467ebe7f9b80ec988a28 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:29.951787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49820a84-fdcd-4bff-bcd8-4d62cb73ef83 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:29.952336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49820a84-fdcd-4bff-bcd8-4d62cb73ef83 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:29.952336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49820a84-fdcd-4bff-bcd8-4d62cb73ef83 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:29.953746 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 636/1288] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:40:29.959017 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b9e4c-3fb8-41f4-a2bd-03940a6dbe9b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:29.959460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b9e4c-3fb8-41f4-a2bd-03940a6dbe9b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:29.959598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b9e4c-3fb8-41f4-a2bd-03940a6dbe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:29.976854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-342b9e4c-3fb8-41f4-a2bd-03940a6dbe9b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:40:29.978699 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-342b9e4c-3fb8-41f4-a2bd-03940a6dbe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:40:30.007607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:30.044990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 653/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:40:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 17:40:30.068297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49820a84-fdcd-4bff-bcd8-4d62cb73ef83 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:30.172320 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49820a84-fdcd-4bff-bcd8-4d62cb73ef83 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:30.183548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:30.207313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4c166-a4c5-4895-9ea5-0818f6908b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:30.208058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4c166-a4c5-4895-9ea5-0818f6908b27 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:30.208338 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4c166-a4c5-4895-9ea5-0818f6908b27 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:30.208633 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4c166-a4c5-4895-9ea5-0818f6908b27 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:30.209291 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4c166-a4c5-4895-9ea5-0818f6908b27 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:30.210667 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4c166-a4c5-4895-9ea5-0818f6908b27 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-cba4c166-a4c5-4895-9ea5-0818f6908b27 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:30.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:30.224001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:30.225083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 637/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 20 17:40:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:30.231065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b9e4c-3fb8-41f4-a2bd-03940a6dbe9b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:30.333361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b9e4c-3fb8-41f4-a2bd-03940a6dbe9b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:30.369531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf72f84-42d0-47ad-95a5-caf6bc5c6eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:30.370191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72f84-42d0-47ad-95a5-caf6bc5c6eb4 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:30.370474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72f84-42d0-47ad-95a5-caf6bc5c6eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:30.370749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72f84-42d0-47ad-95a5-caf6bc5c6eb4 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:30.371449 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf72f84-42d0-47ad-95a5-caf6bc5c6eb4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:30.371754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf72f84-42d0-47ad-95a5-caf6bc5c6eb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:30.373158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf72f84-42d0-47ad-95a5-caf6bc5c6eb4 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:30.378346 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 654/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Jul 20 17:40:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:30.384573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4c166-a4c5-4895-9ea5-0818f6908b27 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:30.486428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4c166-a4c5-4895-9ea5-0818f6908b27 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:30.519035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aebedc-2576-4fc2-b7e0-d947d5be524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:30.519693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aebedc-2576-4fc2-b7e0-d947d5be524f None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:30.519971 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aebedc-2576-4fc2-b7e0-d947d5be524f None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:30.520245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aebedc-2576-4fc2-b7e0-d947d5be524f None admin] PATH_INFO: `/v3/services` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:30.520980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aebedc-2576-4fc2-b7e0-d947d5be524f None admin] RBAC: Adding query filter params (type=placement) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:30.521287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aebedc-2576-4fc2-b7e0-d947d5be524f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:30.522712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aebedc-2576-4fc2-b7e0-d947d5be524f None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:30.527276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 638/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Jul 20 17:40:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:32.560049 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff0ee-e1d5-4183-9a5b-876a0f2ddb01 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:32.560716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff0ee-e1d5-4183-9a5b-876a0f2ddb01 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:32.560716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ff0ee-e1d5-4183-9a5b-876a0f2ddb01 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:32.562048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 655/1293] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:40:32.567381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726290c6-cfac-4f36-ae8f-dcae69048abe None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:32.567820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726290c6-cfac-4f36-ae8f-dcae69048abe None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:32.567915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726290c6-cfac-4f36-ae8f-dcae69048abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:32.585043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-726290c6-cfac-4f36-ae8f-dcae69048abe None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:40:32.586223 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-726290c6-cfac-4f36-ae8f-dcae69048abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:40:32.616667 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:32.654155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 639/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:40:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:40:32.677270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ff0ee-e1d5-4183-9a5b-876a0f2ddb01 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:32.708491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:32.780659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ff0ee-e1d5-4183-9a5b-876a0f2ddb01 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:32.814899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4c8c5-c28a-4f4f-b8a8-d11c376896e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:32.815586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4c8c5-c28a-4f4f-b8a8-d11c376896e5 None admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:32.815873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4c8c5-c28a-4f4f-b8a8-d11c376896e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:32.816154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4c8c5-c28a-4f4f-b8a8-d11c376896e5 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:32.816913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4c8c5-c28a-4f4f-b8a8-d11c376896e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:32.818274 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4c8c5-c28a-4f4f-b8a8-d11c376896e5 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:32.978599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 656/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Jul 20 17:40:32 2022] POST /identity/v3/services => generated 246 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:40:35.017619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcedc15-d22e-495e-909a-d35dcb5c2abb None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:35.018178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcedc15-d22e-495e-909a-d35dcb5c2abb None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:35.018178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcedc15-d22e-495e-909a-d35dcb5c2abb None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:35.019527 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 640/1296] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:40:35.024768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07576-0568-40e4-aa08-cd8617396294 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:35.025172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07576-0568-40e4-aa08-cd8617396294 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:35.025341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07576-0568-40e4-aa08-cd8617396294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:35.042853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-8df07576-0568-40e4-aa08-cd8617396294 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:40:35.046119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8df07576-0568-40e4-aa08-cd8617396294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:40:35.116357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 657/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:40:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:40:35.140269 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcedc15-d22e-495e-909a-d35dcb5c2abb None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:35.243428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcedc15-d22e-495e-909a-d35dcb5c2abb None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:35.280360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dd1b8-8579-446d-894a-68ede3d47e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:35.281089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dd1b8-8579-446d-894a-68ede3d47e14 None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:35.281360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dd1b8-8579-446d-894a-68ede3d47e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:35.281632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dd1b8-8579-446d-894a-68ede3d47e14 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:35.282284 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dd1b8-8579-446d-894a-68ede3d47e14 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:35.283649 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dd1b8-8579-446d-894a-68ede3d47e14 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-624dd1b8-8579-446d-894a-68ede3d47e14 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:35.296653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:35.297634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:35.298609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 641/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 20 17:40:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:35.303925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07576-0568-40e4-aa08-cd8617396294 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:35.322441 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:35.406447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07576-0568-40e4-aa08-cd8617396294 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:35.440089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2e5f3-a6ff-4445-9ca4-b9d44ce11256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:35.440771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2e5f3-a6ff-4445-9ca4-b9d44ce11256 None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:35.441049 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2e5f3-a6ff-4445-9ca4-b9d44ce11256 None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:35.441320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2e5f3-a6ff-4445-9ca4-b9d44ce11256 None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:35.442020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2e5f3-a6ff-4445-9ca4-b9d44ce11256 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:35.442321 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2e5f3-a6ff-4445-9ca4-b9d44ce11256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:35.443665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2e5f3-a6ff-4445-9ca4-b9d44ce11256 None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:35.449497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 658/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Jul 20 17:40:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:35.455965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dd1b8-8579-446d-894a-68ede3d47e14 None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:35.488055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:35.556354 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dd1b8-8579-446d-894a-68ede3d47e14 None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:35.590227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f73fe-162a-4aa9-b680-f28f128580cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:35.590874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f73fe-162a-4aa9-b680-f28f128580cd None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:35.591158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f73fe-162a-4aa9-b680-f28f128580cd None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:35.591431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f73fe-162a-4aa9-b680-f28f128580cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:35.592211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f73fe-162a-4aa9-b680-f28f128580cd None admin] RBAC: Adding query filter params (interface=public, service_id=0db6fc9fb5aa4913b0af515f28022361, region_id=RegionOne) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:35.592547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f73fe-162a-4aa9-b680-f28f128580cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:35.593899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f73fe-162a-4aa9-b680-f28f128580cd None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:35.599040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 642/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Jul 20 17:40:35 2022] GET /identity/v3/endpoints?service_id=0db6fc9fb5aa4913b0af515f28022361&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:35.605071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2e5f3-a6ff-4445-9ca4-b9d44ce11256 None admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:35.702708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2e5f3-a6ff-4445-9ca4-b9d44ce11256 None admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:35.735133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6379261-4058-4707-8c98-d13a28d0939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:35.735788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6379261-4058-4707-8c98-d13a28d0939f None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:35.736066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6379261-4058-4707-8c98-d13a28d0939f None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:35.736330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6379261-4058-4707-8c98-d13a28d0939f None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:35.737032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6379261-4058-4707-8c98-d13a28d0939f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:35.738421 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6379261-4058-4707-8c98-d13a28d0939f None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:35.745155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 659/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Jul 20 17:40:35 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:40:35.787736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:37.809341 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73646f43-b5a5-433f-9111-cf3922f704a9 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:37.809872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73646f43-b5a5-433f-9111-cf3922f704a9 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:37.809997 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73646f43-b5a5-433f-9111-cf3922f704a9 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:37.811350 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 643/1302] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:40:37.816735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5544f94-de14-4ed7-9dc5-db203c9aa5b2 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:37.817175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5544f94-de14-4ed7-9dc5-db203c9aa5b2 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:37.817292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5544f94-de14-4ed7-9dc5-db203c9aa5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:37.836015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b5544f94-de14-4ed7-9dc5-db203c9aa5b2 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:40:37.838650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b5544f94-de14-4ed7-9dc5-db203c9aa5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:40:37.918051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 660/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:40:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 17:40:37.943064 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73646f43-b5a5-433f-9111-cf3922f704a9 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:38.047662 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:38.054471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73646f43-b5a5-433f-9111-cf3922f704a9 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:38.097850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee41c65-9d82-4762-a181-1a2cc85e380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:38.098563 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee41c65-9d82-4762-a181-1a2cc85e380e None admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:38.098844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee41c65-9d82-4762-a181-1a2cc85e380e None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:38.099118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee41c65-9d82-4762-a181-1a2cc85e380e None admin] PATH_INFO: `/v3/services/placement` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:38.099773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee41c65-9d82-4762-a181-1a2cc85e380e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:38.101173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee41c65-9d82-4762-a181-1a2cc85e380e None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application [None req-5ee41c65-9d82-4762-a181-1a2cc85e380e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 17:40:38.114963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 17:40:38.116096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application with Lock( Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self._enter() Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application return self.creator() Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application created_value = creator( Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 17:40:38.117153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: ERROR keystone.server.flask.application Jul 20 17:40:38.120660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 644/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Jul 20 17:40:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 17:40:38.123236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5544f94-de14-4ed7-9dc5-db203c9aa5b2 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:38.209806 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:38.232701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5544f94-de14-4ed7-9dc5-db203c9aa5b2 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:38.271916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0636f8-6787-4f22-8ed3-2e4305b7a90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:38.273009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0636f8-6787-4f22-8ed3-2e4305b7a90d None admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:38.273493 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0636f8-6787-4f22-8ed3-2e4305b7a90d None admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:38.274258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0636f8-6787-4f22-8ed3-2e4305b7a90d None admin] PATH_INFO: `/v3/services` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:38.275008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0636f8-6787-4f22-8ed3-2e4305b7a90d None admin] RBAC: Adding query filter params (name=placement) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:40:38.275513 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0636f8-6787-4f22-8ed3-2e4305b7a90d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:38.278584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0636f8-6787-4f22-8ed3-2e4305b7a90d None admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:38.284584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 661/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Jul 20 17:40:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:40:38.291630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee41c65-9d82-4762-a181-1a2cc85e380e None admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:40:38.401744 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee41c65-9d82-4762-a181-1a2cc85e380e None admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:40:38.435484 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa269af9-9c58-4195-8659-aeb1803b72c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:40:38.436166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa269af9-9c58-4195-8659-aeb1803b72c9 None admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:40:38.436449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa269af9-9c58-4195-8659-aeb1803b72c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:40:38.436758 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa269af9-9c58-4195-8659-aeb1803b72c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:40:38.437489 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa269af9-9c58-4195-8659-aeb1803b72c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:40:38.438855 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa269af9-9c58-4195-8659-aeb1803b72c9 None admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:40:38.603330 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 645/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Jul 20 17:40:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:40:48.280649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=30 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:40:48.597159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:28.909054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36b5e-c061-4cd2-a878-bd42b1c30c49 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:28.910103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36b5e-c061-4cd2-a878-bd42b1c30c49 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:28.910547 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36b5e-c061-4cd2-a878-bd42b1c30c49 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:28.917962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92517709-6b7f-467e-8262-3abe66a86a4d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:28.919081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92517709-6b7f-467e-8262-3abe66a86a4d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:28.919512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92517709-6b7f-467e-8262-3abe66a86a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:28.921671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 662/1307] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:48:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:48:29.002177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-92517709-6b7f-467e-8262-3abe66a86a4d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:48:29.003725 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-92517709-6b7f-467e-8262-3abe66a86a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:29.144530 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 646/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:48:29.183180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859cf61-dc44-46c2-9293-67ebf9f004f5 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:29.183973 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859cf61-dc44-46c2-9293-67ebf9f004f5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:29.184413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859cf61-dc44-46c2-9293-67ebf9f004f5 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:29.186308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 663/1309] 10.222.0.27 () {54 vars in 965 bytes} [Wed Jul 20 17:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:48:29.193572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e781039-4caf-4022-ad78-476b67cc62e7 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:29.194272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e781039-4caf-4022-ad78-476b67cc62e7 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:29.194625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e781039-4caf-4022-ad78-476b67cc62e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:29.302535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-4e781039-4caf-4022-ad78-476b67cc62e7 None None] MFA Rules not processed for user `11930f08a1324902a083436649660130`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:48:29.304757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4e781039-4caf-4022-ad78-476b67cc62e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:29.337425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:29.430266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859cf61-dc44-46c2-9293-67ebf9f004f5 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:48:29.432176 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c859cf61-dc44-46c2-9293-67ebf9f004f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:29.436792 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 647/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Jul 20 17:48:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:48:29.566931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859cf61-dc44-46c2-9293-67ebf9f004f5 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:48:29.666486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b8fda-9b0a-4f4d-8c2e-5be8e7b4181d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:48:29.667202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8fda-9b0a-4f4d-8c2e-5be8e7b4181d service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:29.667577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8fda-9b0a-4f4d-8c2e-5be8e7b4181d service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:29.667879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8fda-9b0a-4f4d-8c2e-5be8e7b4181d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:29.669866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a83b8fda-9b0a-4f4d-8c2e-5be8e7b4181d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:29.738723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:29.820234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b8fda-9b0a-4f4d-8c2e-5be8e7b4181d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:48:29.822229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b8fda-9b0a-4f4d-8c2e-5be8e7b4181d service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:48:29.846901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 664/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:48:32.356604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35985ffb-0b46-43d0-bd50-166bdf68db71 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:32.357441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35985ffb-0b46-43d0-bd50-166bdf68db71 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:32.357441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35985ffb-0b46-43d0-bd50-166bdf68db71 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:32.358885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 648/1312] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:48:32.366196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea63eac-f26b-4ce4-9d7c-ac4ca50dd151 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:32.366940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea63eac-f26b-4ce4-9d7c-ac4ca50dd151 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:32.366940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea63eac-f26b-4ce4-9d7c-ac4ca50dd151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:32.485714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-fea63eac-f26b-4ce4-9d7c-ac4ca50dd151 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:48:32.486980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-fea63eac-f26b-4ce4-9d7c-ac4ca50dd151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:32.668123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 665/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:48:32.708384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35985ffb-0b46-43d0-bd50-166bdf68db71 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:48:32.710026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-35985ffb-0b46-43d0-bd50-166bdf68db71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:32.874455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35985ffb-0b46-43d0-bd50-166bdf68db71 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:48:32.982288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:32.985433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74732e8c-bceb-403e-9b52-2843b47cb795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:48:32.986085 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74732e8c-bceb-403e-9b52-2843b47cb795 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:32.986386 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74732e8c-bceb-403e-9b52-2843b47cb795 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:32.986663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74732e8c-bceb-403e-9b52-2843b47cb795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:32.990127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-74732e8c-bceb-403e-9b52-2843b47cb795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:33.134608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74732e8c-bceb-403e-9b52-2843b47cb795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:48:33.136143 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74732e8c-bceb-403e-9b52-2843b47cb795 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:48:33.159428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 649/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:48:36.042416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1c70f-0cc3-499d-92f8-7ecdb48d546e None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:36.043007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1c70f-0cc3-499d-92f8-7ecdb48d546e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:36.043007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1c70f-0cc3-499d-92f8-7ecdb48d546e None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:36.044616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 666/1315] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:48:36.050212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6c7fc-25fb-47da-9977-5119d8988a65 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:36.051352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6c7fc-25fb-47da-9977-5119d8988a65 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:36.051449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6c7fc-25fb-47da-9977-5119d8988a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:36.117206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-9ac6c7fc-25fb-47da-9977-5119d8988a65 None None] MFA Rules not processed for user `bfffc73d00654d0cb9d9f3571a6a926d`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:48:36.118423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9ac6c7fc-25fb-47da-9977-5119d8988a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:36.171706 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:36.219967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 650/1316] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:48:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:48:36.276255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a09598-7159-4a83-b3bb-88ee206a0be5 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:36.276664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a09598-7159-4a83-b3bb-88ee206a0be5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:36.276946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a09598-7159-4a83-b3bb-88ee206a0be5 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:36.278318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 667/1317] 10.222.0.27 () {54 vars in 965 bytes} [Wed Jul 20 17:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:48:36.284341 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187e96-be2c-4047-a6ac-467b180890cc None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:36.284665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187e96-be2c-4047-a6ac-467b180890cc None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:36.285070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80187e96-be2c-4047-a6ac-467b180890cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:36.365570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-80187e96-be2c-4047-a6ac-467b180890cc None None] MFA Rules not processed for user `11930f08a1324902a083436649660130`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:48:36.366719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-80187e96-be2c-4047-a6ac-467b180890cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:36.449315 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 651/1318] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Jul 20 17:48:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:48:36.458766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a09598-7159-4a83-b3bb-88ee206a0be5 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:48:36.460321 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-45a09598-7159-4a83-b3bb-88ee206a0be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:36.470202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:36.582942 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a09598-7159-4a83-b3bb-88ee206a0be5 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:48:36.667303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c3eb0-fa55-43d9-993e-815ccf7abdc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:48:36.667882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c3eb0-fa55-43d9-993e-815ccf7abdc0 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:36.668172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c3eb0-fa55-43d9-993e-815ccf7abdc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:36.668729 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c3eb0-fa55-43d9-993e-815ccf7abdc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:36.670447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-424c3eb0-fa55-43d9-993e-815ccf7abdc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:36.737081 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:36.790168 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c3eb0-fa55-43d9-993e-815ccf7abdc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:48:36.791606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c3eb0-fa55-43d9-993e-815ccf7abdc0 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:48:36.814309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 668/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:48:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:48:40.168251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d7ee6-c7ad-4548-9ade-6666aab1e730 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:40.169083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d7ee6-c7ad-4548-9ade-6666aab1e730 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:40.169223 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d7ee6-c7ad-4548-9ade-6666aab1e730 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:40.170677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 652/1320] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:48:40.177092 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f636436-5159-4855-9243-300aa2e0cb67 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:40.177620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f636436-5159-4855-9243-300aa2e0cb67 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:40.177620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f636436-5159-4855-9243-300aa2e0cb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:40.246403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-7f636436-5159-4855-9243-300aa2e0cb67 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:48:40.247655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7f636436-5159-4855-9243-300aa2e0cb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:40.352300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 669/1321] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:48:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:48:40.392608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d7ee6-c7ad-4548-9ade-6666aab1e730 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:48:40.394870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b72d7ee6-c7ad-4548-9ade-6666aab1e730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:40.451924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:40.510631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d7ee6-c7ad-4548-9ade-6666aab1e730 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:48:40.586996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d5ad9-3680-4b5c-9b81-d461e26cd94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:48:40.587648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d5ad9-3680-4b5c-9b81-d461e26cd94e service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:40.587931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d5ad9-3680-4b5c-9b81-d461e26cd94e service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:40.588206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d5ad9-3680-4b5c-9b81-d461e26cd94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:40.589903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-530d5ad9-3680-4b5c-9b81-d461e26cd94e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:40.689155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:40.705750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d5ad9-3680-4b5c-9b81-d461e26cd94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:48:40.707747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d5ad9-3680-4b5c-9b81-d461e26cd94e service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:48:40.729231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 653/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:48:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:48:43.963517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bd175-a855-43e2-a2d0-570b24012b44 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:43.964070 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bd175-a855-43e2-a2d0-570b24012b44 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:43.964070 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bd175-a855-43e2-a2d0-570b24012b44 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:43.965483 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 670/1323] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:48:43.974711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa37821-f9fd-4c7d-8b9c-1ac2ba333438 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:43.974711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa37821-f9fd-4c7d-8b9c-1ac2ba333438 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:43.974711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa37821-f9fd-4c7d-8b9c-1ac2ba333438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:44.048243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-eaa37821-f9fd-4c7d-8b9c-1ac2ba333438 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:48:44.049543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-eaa37821-f9fd-4c7d-8b9c-1ac2ba333438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:44.152334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 654/1324] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:48:44.190511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bd175-a855-43e2-a2d0-570b24012b44 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:48:44.192253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-259bd175-a855-43e2-a2d0-570b24012b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:44.212001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:44.304469 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bd175-a855-43e2-a2d0-570b24012b44 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:48:44.390724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df2900-e4c4-4205-80b6-8c410c154689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:48:44.391402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df2900-e4c4-4205-80b6-8c410c154689 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:44.391682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df2900-e4c4-4205-80b6-8c410c154689 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:44.391958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df2900-e4c4-4205-80b6-8c410c154689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:44.393800 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f4df2900-e4c4-4205-80b6-8c410c154689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:44.474558 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:44.515117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df2900-e4c4-4205-80b6-8c410c154689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:48:44.516586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df2900-e4c4-4205-80b6-8c410c154689 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:48:44.535952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 671/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:48:46.686283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2edd49-7694-4296-a02e-1b0d0031bf7e None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:46.686819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2edd49-7694-4296-a02e-1b0d0031bf7e None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:46.686819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2edd49-7694-4296-a02e-1b0d0031bf7e None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:46.688324 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 655/1326] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:48:46.693661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d38e-1928-4e0c-b294-9d8be1109f21 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:46.694114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d38e-1928-4e0c-b294-9d8be1109f21 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:46.694366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0d38e-1928-4e0c-b294-9d8be1109f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:46.761481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-0fc0d38e-1928-4e0c-b294-9d8be1109f21 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:48:46.762696 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0fc0d38e-1928-4e0c-b294-9d8be1109f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:46.867900 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 672/1327] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:48:46.908412 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2edd49-7694-4296-a02e-1b0d0031bf7e None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:48:46.910861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8d2edd49-7694-4296-a02e-1b0d0031bf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:46.984300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:47.033421 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2edd49-7694-4296-a02e-1b0d0031bf7e None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:48:47.116178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3cd5f-c24a-43c7-9615-f5d7ea9b0841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:48:47.116859 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3cd5f-c24a-43c7-9615-f5d7ea9b0841 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:47.117231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3cd5f-c24a-43c7-9615-f5d7ea9b0841 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:47.117557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3cd5f-c24a-43c7-9615-f5d7ea9b0841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:47.119203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-eae3cd5f-c24a-43c7-9615-f5d7ea9b0841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:47.242168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:47.245530 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3cd5f-c24a-43c7-9615-f5d7ea9b0841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:48:47.247104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3cd5f-c24a-43c7-9615-f5d7ea9b0841 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:48:47.277545 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 656/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:48:49.431205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e4932-1d0f-4750-9144-3e5027cc1c1a None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:49.431761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e4932-1d0f-4750-9144-3e5027cc1c1a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:49.431761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e4932-1d0f-4750-9144-3e5027cc1c1a None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:49.433225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 673/1329] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:48:49.439064 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b66e3-b49c-46f5-8bb9-0fbd7a8bb300 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:49.439610 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b66e3-b49c-46f5-8bb9-0fbd7a8bb300 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:49.439610 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b66e3-b49c-46f5-8bb9-0fbd7a8bb300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:49.514342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-985b66e3-b49c-46f5-8bb9-0fbd7a8bb300 None None] MFA Rules not processed for user `bfffc73d00654d0cb9d9f3571a6a926d`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:48:49.515574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-985b66e3-b49c-46f5-8bb9-0fbd7a8bb300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:49.647612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 657/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:48:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:48:49.687000 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e4932-1d0f-4750-9144-3e5027cc1c1a None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:48:49.688631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-348e4932-1d0f-4750-9144-3e5027cc1c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:49.723558 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:49.812150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e4932-1d0f-4750-9144-3e5027cc1c1a None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:48:49.889595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a92df-2ef5-4935-b0fc-51bfdcfb8574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:48:49.890252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a92df-2ef5-4935-b0fc-51bfdcfb8574 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:49.890534 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a92df-2ef5-4935-b0fc-51bfdcfb8574 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:49.890811 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a92df-2ef5-4935-b0fc-51bfdcfb8574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:49.892527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-779a92df-2ef5-4935-b0fc-51bfdcfb8574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:50.005258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:50.052206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a92df-2ef5-4935-b0fc-51bfdcfb8574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:48:50.053681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a92df-2ef5-4935-b0fc-51bfdcfb8574 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:48:50.076546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 674/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:48:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:48:52.665583 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121898a8-2589-49c5-bb75-1b06095f7e81 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:52.666108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121898a8-2589-49c5-bb75-1b06095f7e81 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:52.666203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121898a8-2589-49c5-bb75-1b06095f7e81 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:52.667572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 658/1332] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:48:52.673547 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e336a-b1eb-4880-9799-4dad10007183 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:52.674048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e336a-b1eb-4880-9799-4dad10007183 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:52.674154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e336a-b1eb-4880-9799-4dad10007183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:52.742343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-430e336a-b1eb-4880-9799-4dad10007183 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:48:52.743576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-430e336a-b1eb-4880-9799-4dad10007183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:52.849320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 675/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:48:52.885923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121898a8-2589-49c5-bb75-1b06095f7e81 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:48:52.887456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-121898a8-2589-49c5-bb75-1b06095f7e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:52.960203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:53.005797 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121898a8-2589-49c5-bb75-1b06095f7e81 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:48:53.093668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a68f2d-c6fb-4e38-9187-688193af08a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:48:53.094324 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a68f2d-c6fb-4e38-9187-688193af08a0 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:53.094604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a68f2d-c6fb-4e38-9187-688193af08a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:53.094877 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a68f2d-c6fb-4e38-9187-688193af08a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:53.096628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-68a68f2d-c6fb-4e38-9187-688193af08a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:53.218183 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a68f2d-c6fb-4e38-9187-688193af08a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:48:53.219564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a68f2d-c6fb-4e38-9187-688193af08a0 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:48:53.231855 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:53.246562 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 659/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:48:55.386969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cca49-abab-48c0-acc0-ba1953c69c03 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:55.387598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cca49-abab-48c0-acc0-ba1953c69c03 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:55.387598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cca49-abab-48c0-acc0-ba1953c69c03 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:55.388964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 676/1335] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:48:55.396403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89192609-4970-4790-ab86-7b3b337a4d72 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:55.397004 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89192609-4970-4790-ab86-7b3b337a4d72 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:55.397154 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89192609-4970-4790-ab86-7b3b337a4d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:55.466780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-89192609-4970-4790-ab86-7b3b337a4d72 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:48:55.468037 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-89192609-4970-4790-ab86-7b3b337a4d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:55.575088 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 660/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:48:55.628149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cca49-abab-48c0-acc0-ba1953c69c03 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:48:55.630666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8f5cca49-abab-48c0-acc0-ba1953c69c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:55.681800 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:55.762869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cca49-abab-48c0-acc0-ba1953c69c03 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:48:55.851864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170d5b9-98ea-4be3-86a8-20d97001219d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:48:55.852557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170d5b9-98ea-4be3-86a8-20d97001219d service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:55.852846 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170d5b9-98ea-4be3-86a8-20d97001219d service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:55.853182 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170d5b9-98ea-4be3-86a8-20d97001219d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:55.854985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2170d5b9-98ea-4be3-86a8-20d97001219d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:55.958869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:55.989873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170d5b9-98ea-4be3-86a8-20d97001219d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:48:55.991337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170d5b9-98ea-4be3-86a8-20d97001219d service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:48:56.014342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 677/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:48:58.980569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636280b-0682-4832-8b51-c409bbe707d6 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:58.981270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636280b-0682-4832-8b51-c409bbe707d6 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:58.981270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636280b-0682-4832-8b51-c409bbe707d6 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:58.982634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 661/1338] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:48:58.988946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e6bf6-7cec-46b2-8b0a-448a308ad694 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:58.989666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e6bf6-7cec-46b2-8b0a-448a308ad694 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:58.989666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e6bf6-7cec-46b2-8b0a-448a308ad694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:59.058230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-af2e6bf6-7cec-46b2-8b0a-448a308ad694 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:48:59.059522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-af2e6bf6-7cec-46b2-8b0a-448a308ad694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:59.169722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 678/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:48:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:48:59.207382 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636280b-0682-4832-8b51-c409bbe707d6 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:48:59.209142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2636280b-0682-4832-8b51-c409bbe707d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:59.296062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:48:59.326746 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636280b-0682-4832-8b51-c409bbe707d6 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:48:59.412561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585f03f-5ce8-4ba9-bb68-45cf1ad33c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:48:59.413246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585f03f-5ce8-4ba9-bb68-45cf1ad33c07 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:48:59.413519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585f03f-5ce8-4ba9-bb68-45cf1ad33c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:48:59.413796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585f03f-5ce8-4ba9-bb68-45cf1ad33c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:48:59.415521 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5585f03f-5ce8-4ba9-bb68-45cf1ad33c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:48:59.538395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585f03f-5ce8-4ba9-bb68-45cf1ad33c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:48:59.539869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585f03f-5ce8-4ba9-bb68-45cf1ad33c07 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:48:59.560324 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 662/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:48:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:49:04.425405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03c846-d2eb-4a3c-9beb-f76df61c2577 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:04.426265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03c846-d2eb-4a3c-9beb-f76df61c2577 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:04.426427 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03c846-d2eb-4a3c-9beb-f76df61c2577 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:04.435711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 679/1341] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:04 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:04.438389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693592f-36bc-4480-903b-b5893a821746 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:04.439199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693592f-36bc-4480-903b-b5893a821746 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:04.439892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693592f-36bc-4480-903b-b5893a821746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:04.451198 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:04.568444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-6693592f-36bc-4480-903b-b5893a821746 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:04.570601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6693592f-36bc-4480-903b-b5893a821746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:04.762671 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 663/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:04.810721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03c846-d2eb-4a3c-9beb-f76df61c2577 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:04.814115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-de03c846-d2eb-4a3c-9beb-f76df61c2577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:04.907519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:05.015001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03c846-d2eb-4a3c-9beb-f76df61c2577 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:05.155533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1ccd7-60b1-4c81-935b-19a3334a522e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:05.156260 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1ccd7-60b1-4c81-935b-19a3334a522e service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:05.156674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1ccd7-60b1-4c81-935b-19a3334a522e service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:05.157057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1ccd7-60b1-4c81-935b-19a3334a522e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:05.158985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-bee1ccd7-60b1-4c81-935b-19a3334a522e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:05.321779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:05.354283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1ccd7-60b1-4c81-935b-19a3334a522e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:05.357001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1ccd7-60b1-4c81-935b-19a3334a522e service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:05.398666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 680/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:49:08.799290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2193e-9a0a-4ce5-8bf8-6a52f8f02707 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:08.800138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2193e-9a0a-4ce5-8bf8-6a52f8f02707 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:08.800138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2193e-9a0a-4ce5-8bf8-6a52f8f02707 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:08.802309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 664/1344] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:49:08.808705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616f404-7207-4c2b-bdf0-c720fa6f55be None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:08.809298 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616f404-7207-4c2b-bdf0-c720fa6f55be None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:08.809650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616f404-7207-4c2b-bdf0-c720fa6f55be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:08.914930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f616f404-7207-4c2b-bdf0-c720fa6f55be None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:08.916216 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f616f404-7207-4c2b-bdf0-c720fa6f55be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:09.037434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 681/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:09.077036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2193e-9a0a-4ce5-8bf8-6a52f8f02707 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:09.078870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d6e2193e-9a0a-4ce5-8bf8-6a52f8f02707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:09.202213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:09.222753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2193e-9a0a-4ce5-8bf8-6a52f8f02707 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:09.313010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a7078-e8e9-43fd-b0e9-3a37ae3a6865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:09.313581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a7078-e8e9-43fd-b0e9-3a37ae3a6865 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:09.313865 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a7078-e8e9-43fd-b0e9-3a37ae3a6865 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:09.314139 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a7078-e8e9-43fd-b0e9-3a37ae3a6865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:09.316520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6d4a7078-e8e9-43fd-b0e9-3a37ae3a6865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:09.439379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a7078-e8e9-43fd-b0e9-3a37ae3a6865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:09.440978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a7078-e8e9-43fd-b0e9-3a37ae3a6865 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:09.462387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 665/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:49:14.493533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b45a-213a-4397-91c6-d16ce872676f None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:14.494112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b45a-213a-4397-91c6-d16ce872676f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:14.494112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b45a-213a-4397-91c6-d16ce872676f None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:14.495512 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 682/1347] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:14.501587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c0df-eef9-447a-8744-1e5e46df546d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:14.502127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c0df-eef9-447a-8744-1e5e46df546d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:14.502127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c0df-eef9-447a-8744-1e5e46df546d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:14.519553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:14.602517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-9077c0df-eef9-447a-8744-1e5e46df546d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:14.603925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9077c0df-eef9-447a-8744-1e5e46df546d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:14.725012 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 666/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:49:14.764656 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026b45a-213a-4397-91c6-d16ce872676f None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:14.766208 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4026b45a-213a-4397-91c6-d16ce872676f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:14.830261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:14.881294 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026b45a-213a-4397-91c6-d16ce872676f None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:14.961193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d0ce9-58a2-4092-b718-44f14ea4ce2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:14.961853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0ce9-58a2-4092-b718-44f14ea4ce2a service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:14.962134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0ce9-58a2-4092-b718-44f14ea4ce2a service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:14.962407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0ce9-58a2-4092-b718-44f14ea4ce2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:14.964099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c58d0ce9-58a2-4092-b718-44f14ea4ce2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:15.114758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:15.119853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0ce9-58a2-4092-b718-44f14ea4ce2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:15.121326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0ce9-58a2-4092-b718-44f14ea4ce2a service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:15.141112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 683/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:49:20.338609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9c2a2-cfba-4d27-9545-f6dc7ba21f99 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:20.339258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9c2a2-cfba-4d27-9545-f6dc7ba21f99 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:20.339258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9c2a2-cfba-4d27-9545-f6dc7ba21f99 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:20.340841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 667/1350] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 17:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:20.346366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331347a-e25b-49f9-ae13-955174358ffc None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:20.347422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331347a-e25b-49f9-ae13-955174358ffc None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:20.347530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331347a-e25b-49f9-ae13-955174358ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:20.492255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-d331347a-e25b-49f9-ae13-955174358ffc None None] MFA Rules not processed for user `b218402abe6540d8b81295676199f6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:20.494156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d331347a-e25b-49f9-ae13-955174358ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:20.627980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 684/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 17:49:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:24.723086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=59 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:25.931730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b296e-c030-4487-96d8-030bac4a3f94 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:25.932379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b296e-c030-4487-96d8-030bac4a3f94 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:25.933477 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b296e-c030-4487-96d8-030bac4a3f94 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:25.936246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 668/1352] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 17:49:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:25.943570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19340ab0-2c02-46a4-ad30-bd865aed3119 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:25.944175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19340ab0-2c02-46a4-ad30-bd865aed3119 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:25.944951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19340ab0-2c02-46a4-ad30-bd865aed3119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:26.056593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:26.095212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-19340ab0-2c02-46a4-ad30-bd865aed3119 None None] MFA Rules not processed for user `b218402abe6540d8b81295676199f6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:26.098196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-19340ab0-2c02-46a4-ad30-bd865aed3119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:26.228595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 685/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 17:49:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:27.947826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64178cec-d984-4d16-9a44-d4f1a8a8bff0 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:27.948388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64178cec-d984-4d16-9a44-d4f1a8a8bff0 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:27.948388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64178cec-d984-4d16-9a44-d4f1a8a8bff0 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:27.949795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 669/1354] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 17:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:27.955431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743427d-a626-40d1-9987-83e4335bf6f1 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:27.956704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743427d-a626-40d1-9987-83e4335bf6f1 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:27.956704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743427d-a626-40d1-9987-83e4335bf6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:28.048642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-3743427d-a626-40d1-9987-83e4335bf6f1 None None] MFA Rules not processed for user `b218402abe6540d8b81295676199f6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:28.050063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3743427d-a626-40d1-9987-83e4335bf6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:28.103869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:28.320110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 686/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 17:49:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:31.737634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71483548-2b98-43b0-9696-3b4deb435665 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:31.738296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71483548-2b98-43b0-9696-3b4deb435665 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:31.738296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71483548-2b98-43b0-9696-3b4deb435665 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:31.739557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 670/1356] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:31.745400 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb5346-d0cb-4fb4-949a-310ee9650ab4 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:31.746141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb5346-d0cb-4fb4-949a-310ee9650ab4 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:31.746325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb5346-d0cb-4fb4-949a-310ee9650ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:31.824884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-37bb5346-d0cb-4fb4-949a-310ee9650ab4 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:31.826327 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-37bb5346-d0cb-4fb4-949a-310ee9650ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:31.978273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 687/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:32.064347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6fcaa-67b1-410c-aada-6c8cf2c327a4 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:32.064812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6fcaa-67b1-410c-aada-6c8cf2c327a4 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:32.065126 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6fcaa-67b1-410c-aada-6c8cf2c327a4 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:32.067461 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 671/1358] 10.222.0.27 () {54 vars in 962 bytes} [Wed Jul 20 17:49:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:32.098672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0055-6b34-4623-9ce8-a62ad1e32474 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:32.099119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0055-6b34-4623-9ce8-a62ad1e32474 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:32.099665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0055-6b34-4623-9ce8-a62ad1e32474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:32.120011 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:32.226406 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ee8e0055-6b34-4623-9ce8-a62ad1e32474 None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:32.228341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ee8e0055-6b34-4623-9ce8-a62ad1e32474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:32.404696 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 688/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Jul 20 17:49:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:32.407669 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6fcaa-67b1-410c-aada-6c8cf2c327a4 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:32.410603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5ec6fcaa-67b1-410c-aada-6c8cf2c327a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:32.605184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6fcaa-67b1-410c-aada-6c8cf2c327a4 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:32.695075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:32.740670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeaec14-4a55-4072-98fb-9a7612f4b1be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:32.742757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaec14-4a55-4072-98fb-9a7612f4b1be service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:32.743232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaec14-4a55-4072-98fb-9a7612f4b1be service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:32.744332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaec14-4a55-4072-98fb-9a7612f4b1be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:32.746231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5aeaec14-4a55-4072-98fb-9a7612f4b1be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:32.854142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeaec14-4a55-4072-98fb-9a7612f4b1be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:32.857905 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeaec14-4a55-4072-98fb-9a7612f4b1be service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:32.889691 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 672/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:49:35.613128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4fda7-02f5-4ecc-b707-fd9ee6b478f8 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:35.613128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4fda7-02f5-4ecc-b707-fd9ee6b478f8 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:35.613128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4fda7-02f5-4ecc-b707-fd9ee6b478f8 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:35.615089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 689/1361] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:49:35.620017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecdfa1-4975-4797-91ac-874ebc828274 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:35.620514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecdfa1-4975-4797-91ac-874ebc828274 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:35.620619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecdfa1-4975-4797-91ac-874ebc828274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:35.695332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-80ecdfa1-4975-4797-91ac-874ebc828274 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:35.696783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-80ecdfa1-4975-4797-91ac-874ebc828274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:35.744952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:35.838377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 673/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:35.893799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4fda7-02f5-4ecc-b707-fd9ee6b478f8 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:35.895609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-34a4fda7-02f5-4ecc-b707-fd9ee6b478f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:35.974135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:36.067976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4fda7-02f5-4ecc-b707-fd9ee6b478f8 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:36.205151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cd365-098e-4357-908a-0300db559aec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:36.206240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd365-098e-4357-908a-0300db559aec service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:36.206604 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd365-098e-4357-908a-0300db559aec service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:36.206954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd365-098e-4357-908a-0300db559aec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:36.208873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d48cd365-098e-4357-908a-0300db559aec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:36.245616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:36.384891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd365-098e-4357-908a-0300db559aec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:36.387711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd365-098e-4357-908a-0300db559aec service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:36.416440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 690/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:49:39.070427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ef328-7917-4759-b3cc-63213fb0b5e0 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:39.077178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ef328-7917-4759-b3cc-63213fb0b5e0 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:39.077178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ef328-7917-4759-b3cc-63213fb0b5e0 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:39.077178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 674/1364] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:49:39.078698 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c84d78-3475-4d21-8d5f-3d5b14b4e113 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:39.079293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c84d78-3475-4d21-8d5f-3d5b14b4e113 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:39.079293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c84d78-3475-4d21-8d5f-3d5b14b4e113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:39.162760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e0c84d78-3475-4d21-8d5f-3d5b14b4e113 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:39.163986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e0c84d78-3475-4d21-8d5f-3d5b14b4e113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:39.296426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:39.307497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 691/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:39.352108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db305-e0ef-43d5-8d0d-90423314331b None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:39.352700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db305-e0ef-43d5-8d0d-90423314331b None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:39.353150 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db305-e0ef-43d5-8d0d-90423314331b None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:39.354753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 675/1366] 10.222.0.27 () {54 vars in 962 bytes} [Wed Jul 20 17:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:49:39.363754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af46e65-00ab-4f5b-8dac-385fd1659156 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:39.364095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af46e65-00ab-4f5b-8dac-385fd1659156 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:39.364676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af46e65-00ab-4f5b-8dac-385fd1659156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:39.464140 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-3af46e65-00ab-4f5b-8dac-385fd1659156 None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:39.465587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3af46e65-00ab-4f5b-8dac-385fd1659156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:39.614275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 692/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Jul 20 17:49:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:39.627625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db305-e0ef-43d5-8d0d-90423314331b None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:39.629522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-df4db305-e0ef-43d5-8d0d-90423314331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:39.819904 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db305-e0ef-43d5-8d0d-90423314331b None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:39.844886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:39.973191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2903c-2cdb-466c-b2f1-61f8f5d6f8ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:39.974534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2903c-2cdb-466c-b2f1-61f8f5d6f8ac service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:39.974882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2903c-2cdb-466c-b2f1-61f8f5d6f8ac service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:39.975228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2903c-2cdb-466c-b2f1-61f8f5d6f8ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:39.977053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0fb2903c-2cdb-466c-b2f1-61f8f5d6f8ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:40.091153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2903c-2cdb-466c-b2f1-61f8f5d6f8ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:40.093548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2903c-2cdb-466c-b2f1-61f8f5d6f8ac service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:40.116737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 676/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:49:40.986273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b90f7-88f8-4e8c-a543-3c8c4b9d0b36 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:40.987363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b90f7-88f8-4e8c-a543-3c8c4b9d0b36 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:40.987363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b90f7-88f8-4e8c-a543-3c8c4b9d0b36 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:40.989233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 693/1369] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:40.995954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f1316-524b-4b75-9e12-66e70188f072 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:40.996312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f1316-524b-4b75-9e12-66e70188f072 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:40.996582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f1316-524b-4b75-9e12-66e70188f072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:41.035443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:41.079308 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-8c6f1316-524b-4b75-9e12-66e70188f072 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:41.081389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8c6f1316-524b-4b75-9e12-66e70188f072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:41.195110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 677/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:41.516788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40ac4-244c-4563-9cbe-2c02658c2a98 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:41.517415 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40ac4-244c-4563-9cbe-2c02658c2a98 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:41.517728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40ac4-244c-4563-9cbe-2c02658c2a98 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:41.519290 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 694/1371] 10.222.0.27 () {54 vars in 964 bytes} [Wed Jul 20 17:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:41.524661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24403a9-ef77-45a5-bf49-1aa651b4390d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:41.525243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24403a9-ef77-45a5-bf49-1aa651b4390d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:41.525900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24403a9-ef77-45a5-bf49-1aa651b4390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:41.621156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c24403a9-ef77-45a5-bf49-1aa651b4390d None None] MFA Rules not processed for user `4dfd634e889c4b53a1ed6b90cc1a25e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:41.622355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c24403a9-ef77-45a5-bf49-1aa651b4390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:41.680703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:41.715914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 678/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Jul 20 17:49:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:41.724298 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef40ac4-244c-4563-9cbe-2c02658c2a98 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:41.726079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8ef40ac4-244c-4563-9cbe-2c02658c2a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:41.788488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:41.851153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef40ac4-244c-4563-9cbe-2c02658c2a98 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:41.936627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1a374-9604-4b40-92d6-c64f2e5d7e55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:41.937195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1a374-9604-4b40-92d6-c64f2e5d7e55 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:41.937476 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1a374-9604-4b40-92d6-c64f2e5d7e55 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:41.937751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1a374-9604-4b40-92d6-c64f2e5d7e55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:41.939441 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f7b1a374-9604-4b40-92d6-c64f2e5d7e55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:42.061639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:42.078606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1a374-9604-4b40-92d6-c64f2e5d7e55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:42.080059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1a374-9604-4b40-92d6-c64f2e5d7e55 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:42.101980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 695/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:49:42.521523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679d7d-31b1-4ded-95ee-92d3cbd12158 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:42.523645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679d7d-31b1-4ded-95ee-92d3cbd12158 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:42.524512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a679d7d-31b1-4ded-95ee-92d3cbd12158 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:42.527239 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 679/1374] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:42.537230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02feca6-c7b0-4c37-80fd-dd5939c90b49 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:42.537230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02feca6-c7b0-4c37-80fd-dd5939c90b49 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:42.537230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02feca6-c7b0-4c37-80fd-dd5939c90b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:42.639431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-d02feca6-c7b0-4c37-80fd-dd5939c90b49 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:42.641547 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d02feca6-c7b0-4c37-80fd-dd5939c90b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:42.758729 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 696/1375] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:42.806754 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a679d7d-31b1-4ded-95ee-92d3cbd12158 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:42.808471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5a679d7d-31b1-4ded-95ee-92d3cbd12158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:43.008145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a679d7d-31b1-4ded-95ee-92d3cbd12158 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:43.059251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:43.138008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c913b-db57-4d58-825f-6d97efaea36d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:43.138842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c913b-db57-4d58-825f-6d97efaea36d service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:43.139135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c913b-db57-4d58-825f-6d97efaea36d service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:43.139418 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c913b-db57-4d58-825f-6d97efaea36d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:43.141366 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8b5c913b-db57-4d58-825f-6d97efaea36d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:43.251482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c913b-db57-4d58-825f-6d97efaea36d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:43.253987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c913b-db57-4d58-825f-6d97efaea36d service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:43.273840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 680/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:49:45.638154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bdf70-bc80-4cb2-9d0b-4b85f3ec6365 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:45.638787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bdf70-bc80-4cb2-9d0b-4b85f3ec6365 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:45.638787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bdf70-bc80-4cb2-9d0b-4b85f3ec6365 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:45.639995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 697/1377] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:45.645627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305fb95-dc8f-434d-9ee1-31706462ed9f None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:45.646298 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305fb95-dc8f-434d-9ee1-31706462ed9f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:45.646298 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305fb95-dc8f-434d-9ee1-31706462ed9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:45.727360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-4305fb95-dc8f-434d-9ee1-31706462ed9f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:45.728568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4305fb95-dc8f-434d-9ee1-31706462ed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:45.740688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:45.863550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 681/1378] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:45.920710 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bdf70-bc80-4cb2-9d0b-4b85f3ec6365 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:45.922503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a50bdf70-bc80-4cb2-9d0b-4b85f3ec6365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:46.004293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:46.162061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bdf70-bc80-4cb2-9d0b-4b85f3ec6365 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:46.337006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df634b-1dec-4782-b425-79398262cf30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:46.337662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df634b-1dec-4782-b425-79398262cf30 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:46.337941 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df634b-1dec-4782-b425-79398262cf30 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:46.338238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df634b-1dec-4782-b425-79398262cf30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:46.340614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-07df634b-1dec-4782-b425-79398262cf30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:46.362297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:46.460002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df634b-1dec-4782-b425-79398262cf30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:46.461775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df634b-1dec-4782-b425-79398262cf30 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:46.485352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 698/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:49:49.387962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a9268-47e9-413a-a606-caab3b41af4b None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:49.389016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a9268-47e9-413a-a606-caab3b41af4b None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:49.389016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a9268-47e9-413a-a606-caab3b41af4b None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:49.391379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 682/1380] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:49.396805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a245bf6-8fbf-4236-b08c-b5d100a9013f None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:49.398015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a245bf6-8fbf-4236-b08c-b5d100a9013f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:49.399112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a245bf6-8fbf-4236-b08c-b5d100a9013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:49.553259 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-1a245bf6-8fbf-4236-b08c-b5d100a9013f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:49.555294 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-1a245bf6-8fbf-4236-b08c-b5d100a9013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:49.735801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:49.748689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 699/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:49.814772 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a9268-47e9-413a-a606-caab3b41af4b None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:49.818028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6a4a9268-47e9-413a-a606-caab3b41af4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:50.004654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:50.018580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a9268-47e9-413a-a606-caab3b41af4b None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:50.209441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d082e-36fc-4560-97d6-f62edb4e08d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:50.210380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d082e-36fc-4560-97d6-f62edb4e08d7 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:50.210661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d082e-36fc-4560-97d6-f62edb4e08d7 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:50.210935 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d082e-36fc-4560-97d6-f62edb4e08d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:50.212743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b53d082e-36fc-4560-97d6-f62edb4e08d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:50.349677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d082e-36fc-4560-97d6-f62edb4e08d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:50.352126 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d082e-36fc-4560-97d6-f62edb4e08d7 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:50.368246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:50.379044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 683/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:49:52.854722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48490c0e-844e-447e-9d0e-41240dddfb31 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:52.855281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48490c0e-844e-447e-9d0e-41240dddfb31 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:52.855281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48490c0e-844e-447e-9d0e-41240dddfb31 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:52.856675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 700/1383] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:52.863452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71ee5-6c18-46ca-923a-f47216e5e57d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:52.864105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71ee5-6c18-46ca-923a-f47216e5e57d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:52.864105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71ee5-6c18-46ca-923a-f47216e5e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:52.938937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-98a71ee5-6c18-46ca-923a-f47216e5e57d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:52.941056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-98a71ee5-6c18-46ca-923a-f47216e5e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:53.053332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 684/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:53.102769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48490c0e-844e-447e-9d0e-41240dddfb31 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:53.104285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-48490c0e-844e-447e-9d0e-41240dddfb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:53.333721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48490c0e-844e-447e-9d0e-41240dddfb31 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:53.426127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:53.491940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d4eb6-8c83-4187-a31e-c7c8248ca1e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:53.492642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d4eb6-8c83-4187-a31e-c7c8248ca1e4 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:53.492933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d4eb6-8c83-4187-a31e-c7c8248ca1e4 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:53.493217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d4eb6-8c83-4187-a31e-c7c8248ca1e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:53.494938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-152d4eb6-8c83-4187-a31e-c7c8248ca1e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:53.594227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d4eb6-8c83-4187-a31e-c7c8248ca1e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:53.595789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d4eb6-8c83-4187-a31e-c7c8248ca1e4 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:53.617210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 701/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:49:56.106067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d668-7771-4d5a-8007-c6827889ff6f None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:56.106906 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d668-7771-4d5a-8007-c6827889ff6f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:56.106906 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d668-7771-4d5a-8007-c6827889ff6f None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:56.107989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 685/1386] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:56.115072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7610e-72a2-402e-97eb-7c6ea6e9c721 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:56.115635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7610e-72a2-402e-97eb-7c6ea6e9c721 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:56.118047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7610e-72a2-402e-97eb-7c6ea6e9c721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:56.203654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-fbc7610e-72a2-402e-97eb-7c6ea6e9c721 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:56.204975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-fbc7610e-72a2-402e-97eb-7c6ea6e9c721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:56.247774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:56.327613 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 702/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:49:56.395426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d668-7771-4d5a-8007-c6827889ff6f None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:56.400843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8a06d668-7771-4d5a-8007-c6827889ff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:56.509118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:56.596648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d668-7771-4d5a-8007-c6827889ff6f None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:56.755883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5396ad-7173-41b3-96d8-05ce9ef796d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:56.756570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5396ad-7173-41b3-96d8-05ce9ef796d8 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:56.756853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5396ad-7173-41b3-96d8-05ce9ef796d8 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:56.757129 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5396ad-7173-41b3-96d8-05ce9ef796d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:56.758864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0f5396ad-7173-41b3-96d8-05ce9ef796d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:56.807634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:56.868457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5396ad-7173-41b3-96d8-05ce9ef796d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:56.870121 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5396ad-7173-41b3-96d8-05ce9ef796d8 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:56.890810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 686/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:49:58.852687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720900cd-f5e7-43e3-9122-5afd976733e4 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:58.853584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720900cd-f5e7-43e3-9122-5afd976733e4 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:58.853584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720900cd-f5e7-43e3-9122-5afd976733e4 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:58.854618 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 703/1389] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:58.860351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d2aa-a864-4d2b-b3a8-3630805eafaa None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:58.860880 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d2aa-a864-4d2b-b3a8-3630805eafaa None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:58.861223 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d2aa-a864-4d2b-b3a8-3630805eafaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:58.938710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d000d2aa-a864-4d2b-b3a8-3630805eafaa None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:58.939941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d000d2aa-a864-4d2b-b3a8-3630805eafaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:59.081246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 687/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:49:59.161285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f47db1-6a13-4a6b-83ab-b98d04290abb None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:59.161577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f47db1-6a13-4a6b-83ab-b98d04290abb None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:59.161855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f47db1-6a13-4a6b-83ab-b98d04290abb None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:59.163213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 704/1391] 10.222.0.27 () {54 vars in 966 bytes} [Wed Jul 20 17:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:49:59.168791 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13368cd-d8b3-4d5f-a1f3-9fd4eb12fdb8 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:59.169052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13368cd-d8b3-4d5f-a1f3-9fd4eb12fdb8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:59.169265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13368cd-d8b3-4d5f-a1f3-9fd4eb12fdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:59.184709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:59.274949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-f13368cd-d8b3-4d5f-a1f3-9fd4eb12fdb8 None None] MFA Rules not processed for user `259d506eb54e4766a8fe3fa5bb514e89`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:59.276167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f13368cd-d8b3-4d5f-a1f3-9fd4eb12fdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:59.312908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb988afc-bc5d-489e-912c-902a70f3f2fc None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:59.313188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb988afc-bc5d-489e-912c-902a70f3f2fc None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:59.313464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb988afc-bc5d-489e-912c-902a70f3f2fc None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:59.314890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 705/1392] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:49:59.327320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583c27-71fe-4065-8764-4a4c7fa85f42 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:59.327646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583c27-71fe-4065-8764-4a4c7fa85f42 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:59.327924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583c27-71fe-4065-8764-4a4c7fa85f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:59.373282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 688/1393] 10.222.0.27 () {58 vars in 1063 bytes} [Wed Jul 20 17:49:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:49:59.387594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13368cd-d8b3-4d5f-a1f3-9fd4eb12fdb8 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:59.396807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13368cd-d8b3-4d5f-a1f3-9fd4eb12fdb8 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:59.402312 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-8a583c27-71fe-4065-8764-4a4c7fa85f42 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:49:59.404580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8a583c27-71fe-4065-8764-4a4c7fa85f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:59.487889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0182757-67ec-46fb-bef2-ea2985f3292f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '259d506eb54e4766a8fe3fa5bb514e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:59.488584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0182757-67ec-46fb-bef2-ea2985f3292f service glance] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:59.488873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0182757-67ec-46fb-bef2-ea2985f3292f service glance] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:59.489154 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0182757-67ec-46fb-bef2-ea2985f3292f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:59.491065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f0182757-67ec-46fb-bef2-ea2985f3292f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:59.527189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:59.539595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 706/1394] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:49:59.589134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583c27-71fe-4065-8764-4a4c7fa85f42 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:49:59.590357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8a583c27-71fe-4065-8764-4a4c7fa85f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:59.605371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:59.621726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0182757-67ec-46fb-bef2-ea2985f3292f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:59.623253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0182757-67ec-46fb-bef2-ea2985f3292f service glance] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:59.644620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 689/1395] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:49:59.718624 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583c27-71fe-4065-8764-4a4c7fa85f42 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:49:59.847748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2e781-de83-4853-a251-a6276a29e7b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:49:59.848410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2e781-de83-4853-a251-a6276a29e7b4 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:49:59.848747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2e781-de83-4853-a251-a6276a29e7b4 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:49:59.849032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2e781-de83-4853-a251-a6276a29e7b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:49:59.850686 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5ad2e781-de83-4853-a251-a6276a29e7b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:49:59.859914 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:49:59.974889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2e781-de83-4853-a251-a6276a29e7b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:49:59.976437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2e781-de83-4853-a251-a6276a29e7b4 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:49:59.999163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 707/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:00.582345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4888b1-3034-4162-b449-336d989e807e None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:00.582954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4888b1-3034-4162-b449-336d989e807e None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:00.582954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4888b1-3034-4162-b449-336d989e807e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:00.653242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-9c4888b1-3034-4162-b449-336d989e807e None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:00.654726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9c4888b1-3034-4162-b449-336d989e807e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:00.745839 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:00.753169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 690/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 17:50:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:00.798397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b52ad-f096-40cf-8e61-18fa32e77810 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:00.798798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b52ad-f096-40cf-8e61-18fa32e77810 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:00.799603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b52ad-f096-40cf-8e61-18fa32e77810 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:00.800791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 708/1398] 10.222.0.27 () {54 vars in 943 bytes} [Wed Jul 20 17:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:50:00.807516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b4e08-62d7-434c-90fd-6423f337a6ef None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:00.807877 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b4e08-62d7-434c-90fd-6423f337a6ef None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:00.808281 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b4e08-62d7-434c-90fd-6423f337a6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:00.901234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-795b4e08-62d7-434c-90fd-6423f337a6ef None None] MFA Rules not processed for user `9566befd16fc4b0c84d2bed34c4a5d28`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:00.902526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-795b4e08-62d7-434c-90fd-6423f337a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:01.031844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 691/1399] 10.222.0.27 () {58 vars in 1040 bytes} [Wed Jul 20 17:50:00 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:01.042645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b52ad-f096-40cf-8e61-18fa32e77810 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:01.044169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6c5b52ad-f096-40cf-8e61-18fa32e77810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:01.205542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:01.208356 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b52ad-f096-40cf-8e61-18fa32e77810 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:01.334251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9239b0-6ef8-4241-ac80-fd2d5ace77b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:01.334922 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9239b0-6ef8-4241-ac80-fd2d5ace77b0 service swift] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:01.335208 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9239b0-6ef8-4241-ac80-fd2d5ace77b0 service swift] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:01.335489 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9239b0-6ef8-4241-ac80-fd2d5ace77b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:01.337276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5c9239b0-6ef8-4241-ac80-fd2d5ace77b0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:01.444514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9239b0-6ef8-4241-ac80-fd2d5ace77b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:01.446285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9239b0-6ef8-4241-ac80-fd2d5ace77b0 service swift] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:01.454920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 709/1400] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 17:50:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 17:50:02.518030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ce750-974c-4b14-b38b-be3e952dd91d None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:02.518605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ce750-974c-4b14-b38b-be3e952dd91d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:02.519124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ce750-974c-4b14-b38b-be3e952dd91d None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:02.520937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 692/1401] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:50:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:02.526194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33de5a-46df-4985-a002-f4e59846c1f3 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:02.526629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33de5a-46df-4985-a002-f4e59846c1f3 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:02.526809 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33de5a-46df-4985-a002-f4e59846c1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:02.581314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:02.610072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ac33de5a-46df-4985-a002-f4e59846c1f3 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:02.611352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ac33de5a-46df-4985-a002-f4e59846c1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:02.726050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 710/1402] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:02.772821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ce750-974c-4b14-b38b-be3e952dd91d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:02.774704 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a10ce750-974c-4b14-b38b-be3e952dd91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:02.844056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:02.957184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ce750-974c-4b14-b38b-be3e952dd91d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:03.095974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41f087-915e-4dfd-9ea5-67344fcd7738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:03.096703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f087-915e-4dfd-9ea5-67344fcd7738 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:03.097109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f087-915e-4dfd-9ea5-67344fcd7738 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:03.097401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f087-915e-4dfd-9ea5-67344fcd7738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:03.099149 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2a41f087-915e-4dfd-9ea5-67344fcd7738 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:03.117413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:03.208823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41f087-915e-4dfd-9ea5-67344fcd7738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:03.210588 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41f087-915e-4dfd-9ea5-67344fcd7738 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:03.232634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 693/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:05.738541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d7fc6-f246-41bd-8739-35586234706d None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:05.738541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d7fc6-f246-41bd-8739-35586234706d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:05.738541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d7fc6-f246-41bd-8739-35586234706d None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:05.738541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 711/1404] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:05.739340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626dd14-8206-4b5a-a803-b93d5f95beb0 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:05.739340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626dd14-8206-4b5a-a803-b93d5f95beb0 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:05.739340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626dd14-8206-4b5a-a803-b93d5f95beb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:05.739340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-b626dd14-8206-4b5a-a803-b93d5f95beb0 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:05.739340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b626dd14-8206-4b5a-a803-b93d5f95beb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:05.805685 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:05.816077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 694/1405] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:05.868611 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d7fc6-f246-41bd-8739-35586234706d None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:05.870364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5b4d7fc6-f246-41bd-8739-35586234706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:06.015029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:06.085817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d7fc6-f246-41bd-8739-35586234706d None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:06.243412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fc829-a617-46b1-9628-b2cf6bc72dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:06.244402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fc829-a617-46b1-9628-b2cf6bc72dfe service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:06.244891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fc829-a617-46b1-9628-b2cf6bc72dfe service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:06.245335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fc829-a617-46b1-9628-b2cf6bc72dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:06.247213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-fd3fc829-a617-46b1-9628-b2cf6bc72dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:06.379693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fc829-a617-46b1-9628-b2cf6bc72dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:06.379997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fc829-a617-46b1-9628-b2cf6bc72dfe service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:06.412369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 712/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:07.214543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:09.332540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b1a4-4703-4223-be57-6474cec29c4b None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:09.333124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b1a4-4703-4223-be57-6474cec29c4b None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:09.333124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b1a4-4703-4223-be57-6474cec29c4b None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:09.334479 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 695/1407] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:09.339858 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8d539-5321-49e2-9eec-cb3dc1f5712b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:09.340329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8d539-5321-49e2-9eec-cb3dc1f5712b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:09.340417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8d539-5321-49e2-9eec-cb3dc1f5712b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:09.436826 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f1d8d539-5321-49e2-9eec-cb3dc1f5712b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:09.441051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f1d8d539-5321-49e2-9eec-cb3dc1f5712b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:09.574253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 713/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:09.622666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b1a4-4703-4223-be57-6474cec29c4b None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:09.624247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3944b1a4-4703-4223-be57-6474cec29c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:09.803965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b1a4-4703-4223-be57-6474cec29c4b None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:09.885681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:10.081014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04e9bd-f843-473f-9bf8-b0e26ea26cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:10.081784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04e9bd-f843-473f-9bf8-b0e26ea26cc6 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:10.082113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04e9bd-f843-473f-9bf8-b0e26ea26cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:10.082425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04e9bd-f843-473f-9bf8-b0e26ea26cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:10.084653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4c04e9bd-f843-473f-9bf8-b0e26ea26cc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:10.209665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04e9bd-f843-473f-9bf8-b0e26ea26cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:10.211430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04e9bd-f843-473f-9bf8-b0e26ea26cc6 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:10.238791 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 696/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:50:19.571972 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=78 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:20.230730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=65 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:25.363026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7732510-6157-4531-a20c-385ea4ce2818 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:25.363553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7732510-6157-4531-a20c-385ea4ce2818 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:25.363553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7732510-6157-4531-a20c-385ea4ce2818 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:25.364934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 714/1410] 10.222.0.27 () {54 vars in 918 bytes} [Wed Jul 20 17:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:25.370610 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31255876-5198-4982-8e38-33bd1f394a99 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:25.371068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31255876-5198-4982-8e38-33bd1f394a99 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:25.371182 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31255876-5198-4982-8e38-33bd1f394a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:25.448192 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-31255876-5198-4982-8e38-33bd1f394a99 None None] MFA Rules not processed for user `b218402abe6540d8b81295676199f6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:25.449474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-31255876-5198-4982-8e38-33bd1f394a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:25.558293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 697/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Jul 20 17:50:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:25.575514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc09ac3-fdca-4c11-8640-0bcc45ca8039 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:25.575766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc09ac3-fdca-4c11-8640-0bcc45ca8039 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:25.576048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc09ac3-fdca-4c11-8640-0bcc45ca8039 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:25.580999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 715/1412] 10.222.0.27 () {54 vars in 918 bytes} [Wed Jul 20 17:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:25.582757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086b760-f524-4148-9ab8-e78652e400e0 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:25.583051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086b760-f524-4148-9ab8-e78652e400e0 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:25.583327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086b760-f524-4148-9ab8-e78652e400e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:25.659223 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:25.662469 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-0086b760-f524-4148-9ab8-e78652e400e0 None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:25.663708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0086b760-f524-4148-9ab8-e78652e400e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:25.785923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 698/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Jul 20 17:50:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:28.369021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52470364-6db0-49b5-b048-50154def96ea None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:28.369551 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52470364-6db0-49b5-b048-50154def96ea None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:28.369551 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52470364-6db0-49b5-b048-50154def96ea None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:28.371017 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:28.377111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ccbe8-7bb4-49a4-813c-3859a1043794 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:28.377666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ccbe8-7bb4-49a4-813c-3859a1043794 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:28.377666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ccbe8-7bb4-49a4-813c-3859a1043794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:28.445608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-655ccbe8-7bb4-49a4-813c-3859a1043794 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:28.446850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-655ccbe8-7bb4-49a4-813c-3859a1043794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:28.503418 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:28.546848 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:28.590578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52470364-6db0-49b5-b048-50154def96ea None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:28.592110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-52470364-6db0-49b5-b048-50154def96ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:28.751917 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52470364-6db0-49b5-b048-50154def96ea None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:28.825240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:28.867445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d785f-eef8-44ae-812e-6258750539c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:28.868124 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d785f-eef8-44ae-812e-6258750539c5 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:28.868410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d785f-eef8-44ae-812e-6258750539c5 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:28.868725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d785f-eef8-44ae-812e-6258750539c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:28.870386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0a2d785f-eef8-44ae-812e-6258750539c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:28.960934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d785f-eef8-44ae-812e-6258750539c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:28.962515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d785f-eef8-44ae-812e-6258750539c5 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:28.981650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 717/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:29.906782 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129cb4-2fd3-4ecb-aff9-409737c3d170 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:29.907862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129cb4-2fd3-4ecb-aff9-409737c3d170 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:29.907862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129cb4-2fd3-4ecb-aff9-409737c3d170 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:29.909841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 17:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:29.914741 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe47f-efab-466d-bd30-3f7d3a53588a None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:29.915194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe47f-efab-466d-bd30-3f7d3a53588a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:29.915309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe47f-efab-466d-bd30-3f7d3a53588a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:29.991453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-000fe47f-efab-466d-bd30-3f7d3a53588a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:29.992710 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-000fe47f-efab-466d-bd30-3f7d3a53588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:30.018946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:30.089122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 17:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:30.242600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f129cb4-2fd3-4ecb-aff9-409737c3d170 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:30.244123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6f129cb4-2fd3-4ecb-aff9-409737c3d170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:30.393240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f129cb4-2fd3-4ecb-aff9-409737c3d170 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:30.435670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:30.513206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203c4b2-8c22-449e-b423-25141a44c053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:30.513865 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203c4b2-8c22-449e-b423-25141a44c053 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:30.514200 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203c4b2-8c22-449e-b423-25141a44c053 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:30.514416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203c4b2-8c22-449e-b423-25141a44c053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:30.516103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3203c4b2-8c22-449e-b423-25141a44c053 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:30.605510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203c4b2-8c22-449e-b423-25141a44c053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:30.607104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3203c4b2-8c22-449e-b423-25141a44c053 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:30.625193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 701/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:31.521003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc02a9-7acf-4a02-b551-2aec0c4c5ada None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:31.521588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc02a9-7acf-4a02-b551-2aec0c4c5ada None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:31.521588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc02a9-7acf-4a02-b551-2aec0c4c5ada None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:31.522995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 17:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:31.527916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de076c5-c1ce-4676-92a2-430db0d15765 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:31.528338 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de076c5-c1ce-4676-92a2-430db0d15765 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:31.528448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de076c5-c1ce-4676-92a2-430db0d15765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:31.581943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:31.603515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-2de076c5-c1ce-4676-92a2-430db0d15765 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:31.604763 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2de076c5-c1ce-4676-92a2-430db0d15765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:31.704544 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 17:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:31.857239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc02a9-7acf-4a02-b551-2aec0c4c5ada None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:31.858828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f7bc02a9-7acf-4a02-b551-2aec0c4c5ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:32.013484 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc02a9-7acf-4a02-b551-2aec0c4c5ada None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:32.026131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:32.133834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0175e03-16b2-46d8-bec4-7c38cbaff252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:32.134484 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0175e03-16b2-46d8-bec4-7c38cbaff252 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:32.134765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0175e03-16b2-46d8-bec4-7c38cbaff252 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:32.135038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0175e03-16b2-46d8-bec4-7c38cbaff252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:32.136725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c0175e03-16b2-46d8-bec4-7c38cbaff252 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:32.227910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0175e03-16b2-46d8-bec4-7c38cbaff252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:32.229582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0175e03-16b2-46d8-bec4-7c38cbaff252 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:32.247971 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 720/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:33.157875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9967a-cc5e-4a47-8f44-e988dfb821a6 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:33.158437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9967a-cc5e-4a47-8f44-e988dfb821a6 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:33.158437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9967a-cc5e-4a47-8f44-e988dfb821a6 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:33.159826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 17:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:33.164902 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0fdd-97e4-42a4-a499-e3e677d9aacd None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:33.165336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0fdd-97e4-42a4-a499-e3e677d9aacd None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:33.165454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0fdd-97e4-42a4-a499-e3e677d9aacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:33.184921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:33.243880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-080e0fdd-97e4-42a4-a499-e3e677d9aacd None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:33.245126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-080e0fdd-97e4-42a4-a499-e3e677d9aacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:33.355837 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 17:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:33.509059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9967a-cc5e-4a47-8f44-e988dfb821a6 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:33.510600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9fc9967a-cc5e-4a47-8f44-e988dfb821a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:33.621732 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:33.660095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9967a-cc5e-4a47-8f44-e988dfb821a6 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:33.775988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a6295-e5ca-4a86-98fd-980d850d62bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:33.776665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6295-e5ca-4a86-98fd-980d850d62bc service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:33.776952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6295-e5ca-4a86-98fd-980d850d62bc service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:33.777246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6295-e5ca-4a86-98fd-980d850d62bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:33.778906 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-7a8a6295-e5ca-4a86-98fd-980d850d62bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:33.858106 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:33.872073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a6295-e5ca-4a86-98fd-980d850d62bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:33.873703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a6295-e5ca-4a86-98fd-980d850d62bc service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:33.892431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 704/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:34.785969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8ea74-11d8-404b-a67d-65a45dae1101 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:34.786555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8ea74-11d8-404b-a67d-65a45dae1101 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:34.786555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8ea74-11d8-404b-a67d-65a45dae1101 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:34.787893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 17:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:34.793102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fb3e8-0617-4b67-8154-fd946e2fa491 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:34.793515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fb3e8-0617-4b67-8154-fd946e2fa491 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:34.793632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fb3e8-0617-4b67-8154-fd946e2fa491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:34.872012 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-009fb3e8-0617-4b67-8154-fd946e2fa491 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:34.873288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-009fb3e8-0617-4b67-8154-fd946e2fa491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:34.978142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 17:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:35.135009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8ea74-11d8-404b-a67d-65a45dae1101 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:35.137791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-bdc8ea74-11d8-404b-a67d-65a45dae1101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:35.259162 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:35.325293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8ea74-11d8-404b-a67d-65a45dae1101 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:35.444632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1d5b7-8f95-4f09-b33f-fc1218237916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:35.445423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1d5b7-8f95-4f09-b33f-fc1218237916 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:35.445750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1d5b7-8f95-4f09-b33f-fc1218237916 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:35.446032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1d5b7-8f95-4f09-b33f-fc1218237916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:35.447702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-73c1d5b7-8f95-4f09-b33f-fc1218237916 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:35.496154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:35.538310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1d5b7-8f95-4f09-b33f-fc1218237916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:35.539922 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1d5b7-8f95-4f09-b33f-fc1218237916 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:35.558574 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 723/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:36.451127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d94a9f-8899-476f-acb9-c441db1c6236 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:36.451665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d94a9f-8899-476f-acb9-c441db1c6236 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:36.451665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d94a9f-8899-476f-acb9-c441db1c6236 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:36.453168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 17:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:36.458990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6efab-d07a-4502-b802-2ba3d92a7b38 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:36.461736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6efab-d07a-4502-b802-2ba3d92a7b38 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:36.461736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6efab-d07a-4502-b802-2ba3d92a7b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:36.536442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b6e6efab-d07a-4502-b802-2ba3d92a7b38 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:36.537717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b6e6efab-d07a-4502-b802-2ba3d92a7b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:36.639216 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 17:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:36.812899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d94a9f-8899-476f-acb9-c441db1c6236 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:36.815098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e4d94a9f-8899-476f-acb9-c441db1c6236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:36.870441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:36.974124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d94a9f-8899-476f-acb9-c441db1c6236 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:37.092296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191f401-538a-40d6-814e-dbd9e5ad2082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:37.092950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191f401-538a-40d6-814e-dbd9e5ad2082 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:37.093232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191f401-538a-40d6-814e-dbd9e5ad2082 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:37.093512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191f401-538a-40d6-814e-dbd9e5ad2082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:37.095719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9191f401-538a-40d6-814e-dbd9e5ad2082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:37.103196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:37.188978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191f401-538a-40d6-814e-dbd9e5ad2082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:37.190655 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191f401-538a-40d6-814e-dbd9e5ad2082 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:37.210680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 707/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:38.186354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ee58c-5684-42d3-ab4a-35e55207c9e9 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:38.186887 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ee58c-5684-42d3-ab4a-35e55207c9e9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:38.186887 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ee58c-5684-42d3-ab4a-35e55207c9e9 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:38.188374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 17:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:50:38.193439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1e16e-6529-4bd0-a516-911046b63db1 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:38.193943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1e16e-6529-4bd0-a516-911046b63db1 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:38.194043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1e16e-6529-4bd0-a516-911046b63db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:38.272251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-7da1e16e-6529-4bd0-a516-911046b63db1 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:38.273624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-7da1e16e-6529-4bd0-a516-911046b63db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:38.348157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:38.383841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 17:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:38.536302 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ee58c-5684-42d3-ab4a-35e55207c9e9 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:38.537942 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ee4ee58c-5684-42d3-ab4a-35e55207c9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:38.555831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:38.693057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ee58c-5684-42d3-ab4a-35e55207c9e9 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:38.783813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:38.810109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f426563-4a30-459a-ac43-cc98d5595cb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:38.810689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426563-4a30-459a-ac43-cc98d5595cb8 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:38.811003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426563-4a30-459a-ac43-cc98d5595cb8 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:38.811277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426563-4a30-459a-ac43-cc98d5595cb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:38.812992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2f426563-4a30-459a-ac43-cc98d5595cb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:38.902542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f426563-4a30-459a-ac43-cc98d5595cb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:38.904147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f426563-4a30-459a-ac43-cc98d5595cb8 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:38.922812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 726/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:39.802251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7fc87-36cc-42ac-a260-4fb43b3ae603 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:39.802823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7fc87-36cc-42ac-a260-4fb43b3ae603 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:39.802823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7fc87-36cc-42ac-a260-4fb43b3ae603 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:39.804234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 17:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:39.809443 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62393802-9ca9-4b21-86fc-ec718699b1d5 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:39.809912 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62393802-9ca9-4b21-86fc-ec718699b1d5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:39.810023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62393802-9ca9-4b21-86fc-ec718699b1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:39.888569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-62393802-9ca9-4b21-86fc-ec718699b1d5 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:39.889816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-62393802-9ca9-4b21-86fc-ec718699b1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:39.933708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:39.991589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 17:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:40.145435 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7fc87-36cc-42ac-a260-4fb43b3ae603 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:40.146928 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c4c7fc87-36cc-42ac-a260-4fb43b3ae603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:40.305260 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7fc87-36cc-42ac-a260-4fb43b3ae603 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:40.363471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:40.428247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cce66-1208-44e4-ba08-57944ed2a731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:40.428972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cce66-1208-44e4-ba08-57944ed2a731 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:40.429249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cce66-1208-44e4-ba08-57944ed2a731 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:40.429520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cce66-1208-44e4-ba08-57944ed2a731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:40.431177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ed9cce66-1208-44e4-ba08-57944ed2a731 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:40.524303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cce66-1208-44e4-ba08-57944ed2a731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:40.525914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cce66-1208-44e4-ba08-57944ed2a731 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:40.546406 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 710/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:41.495332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f3de-3d5e-40cd-b998-40a6b61306dc None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:41.495905 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f3de-3d5e-40cd-b998-40a6b61306dc None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:41.495905 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f3de-3d5e-40cd-b998-40a6b61306dc None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:41.497376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 17:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:41.503956 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8cba-d92f-4103-add1-47b4a2a1a5f9 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:41.504397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8cba-d92f-4103-add1-47b4a2a1a5f9 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:41.504558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8cba-d92f-4103-add1-47b4a2a1a5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:41.582799 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c0ee8cba-d92f-4103-add1-47b4a2a1a5f9 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:41.584014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c0ee8cba-d92f-4103-add1-47b4a2a1a5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:41.586071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:41.683855 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 17:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:41.837928 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f3de-3d5e-40cd-b998-40a6b61306dc None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:41.839443 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-1e65f3de-3d5e-40cd-b998-40a6b61306dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:41.988725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f3de-3d5e-40cd-b998-40a6b61306dc None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:42.018276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:42.111043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132a18d-5018-4cdd-90db-58dc7c92e084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:42.111688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132a18d-5018-4cdd-90db-58dc7c92e084 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:42.111971 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132a18d-5018-4cdd-90db-58dc7c92e084 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:42.112245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132a18d-5018-4cdd-90db-58dc7c92e084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:42.113927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f132a18d-5018-4cdd-90db-58dc7c92e084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:42.207498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132a18d-5018-4cdd-90db-58dc7c92e084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:42.209142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132a18d-5018-4cdd-90db-58dc7c92e084 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:42.227494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 729/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:44.214427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ab9c3-a583-4499-901d-1ae146259207 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:44.215007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ab9c3-a583-4499-901d-1ae146259207 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:44.215007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ab9c3-a583-4499-901d-1ae146259207 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:44.216270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:44.222234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6104623-8f70-4d9d-9800-286d76ab1e30 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:44.222766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6104623-8f70-4d9d-9800-286d76ab1e30 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:44.222874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6104623-8f70-4d9d-9800-286d76ab1e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:44.262872 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:44.288326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-d6104623-8f70-4d9d-9800-286d76ab1e30 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:44.289587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d6104623-8f70-4d9d-9800-286d76ab1e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:44.389471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:44.429342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ab9c3-a583-4499-901d-1ae146259207 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:44.430883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-076ab9c3-a583-4499-901d-1ae146259207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:44.544600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ab9c3-a583-4499-901d-1ae146259207 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:44.578754 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:44.626360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899e2e8-643d-4e7a-a353-40b9eea79cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:44.627060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899e2e8-643d-4e7a-a353-40b9eea79cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:44.627371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899e2e8-643d-4e7a-a353-40b9eea79cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:44.627649 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899e2e8-643d-4e7a-a353-40b9eea79cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:44.629513 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d899e2e8-643d-4e7a-a353-40b9eea79cc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:44.740074 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899e2e8-643d-4e7a-a353-40b9eea79cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:44.741539 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899e2e8-643d-4e7a-a353-40b9eea79cc7 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:44.760834 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 713/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:47.014055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb454f-6f93-40ef-a7e1-c562fa05629b None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:47.014624 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb454f-6f93-40ef-a7e1-c562fa05629b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:47.014624 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb454f-6f93-40ef-a7e1-c562fa05629b None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:47.015976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:47.021959 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4a4f8-2bf0-47ce-bf69-05b5288d12c4 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:47.022387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4a4f8-2bf0-47ce-bf69-05b5288d12c4 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:47.022503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4a4f8-2bf0-47ce-bf69-05b5288d12c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:47.088631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-aed4a4f8-2bf0-47ce-bf69-05b5288d12c4 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:47.089767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-aed4a4f8-2bf0-47ce-bf69-05b5288d12c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:47.103571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:47.196978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:47.235816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb454f-6f93-40ef-a7e1-c562fa05629b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:47.237412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8fcb454f-6f93-40ef-a7e1-c562fa05629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:47.343934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb454f-6f93-40ef-a7e1-c562fa05629b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:47.356303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:47.423076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96f804-ed1c-4f2a-8067-1061059534b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:47.423723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96f804-ed1c-4f2a-8067-1061059534b8 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:47.423921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96f804-ed1c-4f2a-8067-1061059534b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:47.424191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96f804-ed1c-4f2a-8067-1061059534b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:47.425856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0b96f804-ed1c-4f2a-8067-1061059534b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:47.538430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96f804-ed1c-4f2a-8067-1061059534b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:47.539881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96f804-ed1c-4f2a-8067-1061059534b8 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:47.559162 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 732/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:50.066677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6cb70-9af5-46fc-8a6e-98d3b0ce417a None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:50.067268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6cb70-9af5-46fc-8a6e-98d3b0ce417a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:50.067268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6cb70-9af5-46fc-8a6e-98d3b0ce417a None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:50.068829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:50.074211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab5463-b1d2-4928-bdcc-f5c2fcbedee3 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:50.074631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab5463-b1d2-4928-bdcc-f5c2fcbedee3 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:50.074766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab5463-b1d2-4928-bdcc-f5c2fcbedee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:50.124975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:50.145402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-37ab5463-b1d2-4928-bdcc-f5c2fcbedee3 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:50.146657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-37ab5463-b1d2-4928-bdcc-f5c2fcbedee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:50.248935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:50.291396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6cb70-9af5-46fc-8a6e-98d3b0ce417a None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:50.293122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bdb6cb70-9af5-46fc-8a6e-98d3b0ce417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:50.413789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6cb70-9af5-46fc-8a6e-98d3b0ce417a None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:50.457156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:50.492989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b556cde-fc57-40ec-a432-3e05c9c56f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:50.493642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b556cde-fc57-40ec-a432-3e05c9c56f95 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:50.493921 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b556cde-fc57-40ec-a432-3e05c9c56f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:50.494194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b556cde-fc57-40ec-a432-3e05c9c56f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:50.495858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8b556cde-fc57-40ec-a432-3e05c9c56f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:50.611381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b556cde-fc57-40ec-a432-3e05c9c56f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:50.612868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b556cde-fc57-40ec-a432-3e05c9c56f95 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:50.632221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 716/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:52.920198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c39d-01f0-454f-bb3c-d0a1387ae6c1 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:52.920817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c39d-01f0-454f-bb3c-d0a1387ae6c1 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:52.920817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c39d-01f0-454f-bb3c-d0a1387ae6c1 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:52.922672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:52.928604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6063ba6-5a71-4274-a772-e4196f8e5695 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:52.929118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6063ba6-5a71-4274-a772-e4196f8e5695 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:52.929118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6063ba6-5a71-4274-a772-e4196f8e5695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:53.002132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c6063ba6-5a71-4274-a772-e4196f8e5695 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:53.003385 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c6063ba6-5a71-4274-a772-e4196f8e5695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:53.025831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:53.111377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:53.150311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c39d-01f0-454f-bb3c-d0a1387ae6c1 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:53.151858 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ece7c39d-01f0-454f-bb3c-d0a1387ae6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:53.259004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c39d-01f0-454f-bb3c-d0a1387ae6c1 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:53.279220 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:53.333983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba2cfe-ba84-4973-bd4b-7c75cf1ee180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:53.334632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba2cfe-ba84-4973-bd4b-7c75cf1ee180 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:53.335086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba2cfe-ba84-4973-bd4b-7c75cf1ee180 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:53.335245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba2cfe-ba84-4973-bd4b-7c75cf1ee180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:53.336936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-08ba2cfe-ba84-4973-bd4b-7c75cf1ee180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:53.451014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba2cfe-ba84-4973-bd4b-7c75cf1ee180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:53.452445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba2cfe-ba84-4973-bd4b-7c75cf1ee180 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:53.471714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 735/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:55.618875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff11fe-90ee-4377-9e74-6dc22798aa04 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:55.619439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff11fe-90ee-4377-9e74-6dc22798aa04 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:55.619439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff11fe-90ee-4377-9e74-6dc22798aa04 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:55.620842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:55.626913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c097f8d-2c5f-47c3-a92e-5d841ec57553 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:55.627353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c097f8d-2c5f-47c3-a92e-5d841ec57553 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:55.627470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c097f8d-2c5f-47c3-a92e-5d841ec57553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:55.694664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:55.697616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-7c097f8d-2c5f-47c3-a92e-5d841ec57553 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:55.698876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7c097f8d-2c5f-47c3-a92e-5d841ec57553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:55.798046 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:55.836992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff11fe-90ee-4377-9e74-6dc22798aa04 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:55.838567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c3ff11fe-90ee-4377-9e74-6dc22798aa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:55.943240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff11fe-90ee-4377-9e74-6dc22798aa04 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:55.992055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:56.018501 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f00d05-a251-403e-805f-f8e8a295b4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:56.019152 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f00d05-a251-403e-805f-f8e8a295b4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:56.019431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f00d05-a251-403e-805f-f8e8a295b4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:56.019700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f00d05-a251-403e-805f-f8e8a295b4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:56.021393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-82f00d05-a251-403e-805f-f8e8a295b4c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:56.140691 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f00d05-a251-403e-805f-f8e8a295b4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:56.142946 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f00d05-a251-403e-805f-f8e8a295b4c3 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:56.166264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 719/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:50:58.340948 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c0a3a-df41-4bac-80f6-98c5d610c4f9 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:58.341465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c0a3a-df41-4bac-80f6-98c5d610c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:58.341465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c0a3a-df41-4bac-80f6-98c5d610c4f9 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:58.342797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:50:58.348084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153c9b3-06c4-45df-94f3-edae4a63cdf7 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:58.348505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153c9b3-06c4-45df-94f3-edae4a63cdf7 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:58.348669 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153c9b3-06c4-45df-94f3-edae4a63cdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:58.417561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-7153c9b3-06c4-45df-94f3-edae4a63cdf7 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:50:58.418776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-7153c9b3-06c4-45df-94f3-edae4a63cdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:58.448602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:58.518912 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:50:58.557800 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c0a3a-df41-4bac-80f6-98c5d610c4f9 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:50:58.559342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a89c0a3a-df41-4bac-80f6-98c5d610c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:58.687647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c0a3a-df41-4bac-80f6-98c5d610c4f9 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:50:58.716242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:50:58.762769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28f17d-bd1f-4060-a384-4dab47402384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:50:58.763811 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28f17d-bd1f-4060-a384-4dab47402384 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:50:58.764103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28f17d-bd1f-4060-a384-4dab47402384 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:50:58.764388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28f17d-bd1f-4060-a384-4dab47402384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:50:58.766150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8c28f17d-bd1f-4060-a384-4dab47402384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:50:58.888279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28f17d-bd1f-4060-a384-4dab47402384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:50:58.889757 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28f17d-bd1f-4060-a384-4dab47402384 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:50:58.911272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 738/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:51:01.095381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab16a8-6de8-40fb-85f8-3e09dea32d77 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:01.095952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab16a8-6de8-40fb-85f8-3e09dea32d77 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:01.095952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab16a8-6de8-40fb-85f8-3e09dea32d77 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:01.097362 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:51:01.102798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb17287-abe8-4497-bcff-1dfe44bd8091 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:01.103247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb17287-abe8-4497-bcff-1dfe44bd8091 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:01.103347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb17287-abe8-4497-bcff-1dfe44bd8091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:01.169746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-cbb17287-abe8-4497-bcff-1dfe44bd8091 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:51:01.171224 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-cbb17287-abe8-4497-bcff-1dfe44bd8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:01.180113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:01.267512 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:51:01.305883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab16a8-6de8-40fb-85f8-3e09dea32d77 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:51:01.307486 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8bab16a8-6de8-40fb-85f8-3e09dea32d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:01.423426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab16a8-6de8-40fb-85f8-3e09dea32d77 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:51:01.480677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:01.499615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4be39d-c167-4374-980e-4b054ea678d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:51:01.501628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4be39d-c167-4374-980e-4b054ea678d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:01.501628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4be39d-c167-4374-980e-4b054ea678d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:01.501628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4be39d-c167-4374-980e-4b054ea678d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:01.503111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-aa4be39d-c167-4374-980e-4b054ea678d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:01.619826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4be39d-c167-4374-980e-4b054ea678d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:51:01.621280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4be39d-c167-4374-980e-4b054ea678d4 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:51:01.639005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 722/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:51:03.785418 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e709bfd-520c-4f47-b590-75d6fcb6efe1 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:03.786014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e709bfd-520c-4f47-b590-75d6fcb6efe1 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:03.786014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e709bfd-520c-4f47-b590-75d6fcb6efe1 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:03.787368 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:51:03.792859 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f05ee-f5e6-4712-8178-90d2239ebcda None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:03.793290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f05ee-f5e6-4712-8178-90d2239ebcda None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:03.793419 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f05ee-f5e6-4712-8178-90d2239ebcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:03.862323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-8d4f05ee-f5e6-4712-8178-90d2239ebcda None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:51:03.863616 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8d4f05ee-f5e6-4712-8178-90d2239ebcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:03.904288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:03.965930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:51:04.003959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e709bfd-520c-4f47-b590-75d6fcb6efe1 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:51:04.005591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2e709bfd-520c-4f47-b590-75d6fcb6efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:04.117629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e709bfd-520c-4f47-b590-75d6fcb6efe1 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:51:04.156191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:04.193261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09609531-f52d-460f-8101-05cfa2fdfa1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:51:04.193967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09609531-f52d-460f-8101-05cfa2fdfa1d service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:04.194243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09609531-f52d-460f-8101-05cfa2fdfa1d service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:04.194518 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09609531-f52d-460f-8101-05cfa2fdfa1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:04.196183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-09609531-f52d-460f-8101-05cfa2fdfa1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:04.306815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09609531-f52d-460f-8101-05cfa2fdfa1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:51:04.308292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09609531-f52d-460f-8101-05cfa2fdfa1d service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:51:04.327786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 741/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:51:06.412694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28c9e8-8e1f-488a-9ddb-65f8763f46ab None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:06.413316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28c9e8-8e1f-488a-9ddb-65f8763f46ab None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:06.413316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28c9e8-8e1f-488a-9ddb-65f8763f46ab None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:06.414892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:51:06.420510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af524cc3-5cba-447c-a7a1-55d52eb2aed1 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:06.421141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af524cc3-5cba-447c-a7a1-55d52eb2aed1 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:06.421141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af524cc3-5cba-447c-a7a1-55d52eb2aed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:06.486631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-af524cc3-5cba-447c-a7a1-55d52eb2aed1 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:51:06.487845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-af524cc3-5cba-447c-a7a1-55d52eb2aed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:06.506736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:06.587436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:51:06.626301 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28c9e8-8e1f-488a-9ddb-65f8763f46ab None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:51:06.628014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9a28c9e8-8e1f-488a-9ddb-65f8763f46ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:06.733610 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28c9e8-8e1f-488a-9ddb-65f8763f46ab None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:51:06.801355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:06.808215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc8fc6-15b4-4e52-adda-4c48a12ee1a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:51:06.808900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc8fc6-15b4-4e52-adda-4c48a12ee1a3 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:06.809184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc8fc6-15b4-4e52-adda-4c48a12ee1a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:06.809462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc8fc6-15b4-4e52-adda-4c48a12ee1a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:06.811115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a2bc8fc6-15b4-4e52-adda-4c48a12ee1a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:06.922577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc8fc6-15b4-4e52-adda-4c48a12ee1a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:51:06.924261 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc8fc6-15b4-4e52-adda-4c48a12ee1a3 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:51:06.943844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 725/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:51:09.044160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daa2bc-e2ba-4219-b8fe-1d1103d22cda None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:09.044779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daa2bc-e2ba-4219-b8fe-1d1103d22cda None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:09.044779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daa2bc-e2ba-4219-b8fe-1d1103d22cda None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:09.046455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:51:09.052492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f8e03-dbbf-4c03-a8ad-719c5bb7810c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:09.053048 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f8e03-dbbf-4c03-a8ad-719c5bb7810c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:09.053048 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f8e03-dbbf-4c03-a8ad-719c5bb7810c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:09.122282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-440f8e03-dbbf-4c03-a8ad-719c5bb7810c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:51:09.123503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-440f8e03-dbbf-4c03-a8ad-719c5bb7810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:09.175722 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:09.227983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:51:09.267417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daa2bc-e2ba-4219-b8fe-1d1103d22cda None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:51:09.268986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a3daa2bc-e2ba-4219-b8fe-1d1103d22cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:09.377710 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3daa2bc-e2ba-4219-b8fe-1d1103d22cda None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:51:09.426889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:09.453141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85ddb6-1b79-4fa4-9d11-771dd88437a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:51:09.454013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85ddb6-1b79-4fa4-9d11-771dd88437a0 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:09.454288 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85ddb6-1b79-4fa4-9d11-771dd88437a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:09.454566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85ddb6-1b79-4fa4-9d11-771dd88437a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:09.456209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7c85ddb6-1b79-4fa4-9d11-771dd88437a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:09.567962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85ddb6-1b79-4fa4-9d11-771dd88437a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:51:09.569428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85ddb6-1b79-4fa4-9d11-771dd88437a0 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:51:09.588895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 744/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:51:19.226104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=22 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:19.586575 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=66 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:29.804057 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac7cf2-5ff6-4602-b2b5-e86b2e27ab2b None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:29.804675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac7cf2-5ff6-4602-b2b5-e86b2e27ab2b None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:29.804675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac7cf2-5ff6-4602-b2b5-e86b2e27ab2b None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:29.806044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 727/1471] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:51:29.812453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd79ef-3e03-40ef-8c66-cf9dbd1c9b48 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:29.813073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd79ef-3e03-40ef-8c66-cf9dbd1c9b48 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:29.813073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd79ef-3e03-40ef-8c66-cf9dbd1c9b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:29.881238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-effd79ef-3e03-40ef-8c66-cf9dbd1c9b48 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:51:29.882521 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-effd79ef-3e03-40ef-8c66-cf9dbd1c9b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:30.001406 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 745/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:51:30.096126 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abeca6-6e22-41c9-b928-cdba4afcab8f None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:30.096446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abeca6-6e22-41c9-b928-cdba4afcab8f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:30.096815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abeca6-6e22-41c9-b928-cdba4afcab8f None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:30.098716 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 728/1473] 10.222.0.27 () {54 vars in 966 bytes} [Wed Jul 20 17:51:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:51:30.105008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60e514-dfa4-4345-8dac-3afa144a4196 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:30.105304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60e514-dfa4-4345-8dac-3afa144a4196 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:30.105585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60e514-dfa4-4345-8dac-3afa144a4196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:30.203572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ef60e514-dfa4-4345-8dac-3afa144a4196 None None] MFA Rules not processed for user `259d506eb54e4766a8fe3fa5bb514e89`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:51:30.204922 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ef60e514-dfa4-4345-8dac-3afa144a4196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:30.237076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:30.303372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 746/1474] 10.222.0.27 () {58 vars in 1063 bytes} [Wed Jul 20 17:51:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:51:30.311187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abeca6-6e22-41c9-b928-cdba4afcab8f None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:51:30.313438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-84abeca6-6e22-41c9-b928-cdba4afcab8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:30.433103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abeca6-6e22-41c9-b928-cdba4afcab8f None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:51:30.517173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace7e65-70dc-4362-9220-1f2f2f79b552 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '259d506eb54e4766a8fe3fa5bb514e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:51:30.517844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace7e65-70dc-4362-9220-1f2f2f79b552 service glance] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:30.518128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace7e65-70dc-4362-9220-1f2f2f79b552 service glance] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:30.518400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace7e65-70dc-4362-9220-1f2f2f79b552 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:30.520128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8ace7e65-70dc-4362-9220-1f2f2f79b552 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:30.589673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:30.652194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace7e65-70dc-4362-9220-1f2f2f79b552 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:51:30.653798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace7e65-70dc-4362-9220-1f2f2f79b552 service glance] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:51:30.676984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 729/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:51:32.915874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7017b-b4eb-47cd-a3a8-4598b4d6652a None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:32.916450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7017b-b4eb-47cd-a3a8-4598b4d6652a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:32.916450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7017b-b4eb-47cd-a3a8-4598b4d6652a None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:32.917856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 747/1476] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:51:32.924808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f444531-a474-426f-8162-d4b66b3b3b02 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:32.925287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f444531-a474-426f-8162-d4b66b3b3b02 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:32.925385 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f444531-a474-426f-8162-d4b66b3b3b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:32.993213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-1f444531-a474-426f-8162-d4b66b3b3b02 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:51:32.994470 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-1f444531-a474-426f-8162-d4b66b3b3b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:33.091436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 730/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:51:33.115123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7017b-b4eb-47cd-a3a8-4598b4d6652a None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:51:33.116701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2bc7017b-b4eb-47cd-a3a8-4598b4d6652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:33.244968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7017b-b4eb-47cd-a3a8-4598b4d6652a None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:51:33.294269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:33.340933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d7d56-5848-42d5-ac13-17ceffbaffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:51:33.341608 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d7d56-5848-42d5-ac13-17ceffbaffd9 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:33.341890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d7d56-5848-42d5-ac13-17ceffbaffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:33.342166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d7d56-5848-42d5-ac13-17ceffbaffd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:33.343679 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d7d56-5848-42d5-ac13-17ceffbaffd9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:51:33.345591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: WARNING py.warnings [None req-5d7d7d56-5848-42d5-ac13-17ceffbaffd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:51:33.345591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: warnings.warn(msg) Jul 20 17:51:33.345591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: Jul 20 17:51:33.346727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d7d56-5848-42d5-ac13-17ceffbaffd9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:51:33.366748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 748/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Jul 20 17:51:33 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:51:35.458538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce659b43-8727-4cf8-a425-a5d802dd7517 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:35.459080 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce659b43-8727-4cf8-a425-a5d802dd7517 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:35.459080 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce659b43-8727-4cf8-a425-a5d802dd7517 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:35.460466 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 731/1479] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:51:35.465957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94642038-e2d7-4143-b81e-2b32ea54cf6c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:35.466407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94642038-e2d7-4143-b81e-2b32ea54cf6c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:35.466523 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94642038-e2d7-4143-b81e-2b32ea54cf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:35.537824 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-94642038-e2d7-4143-b81e-2b32ea54cf6c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:51:35.539042 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-94642038-e2d7-4143-b81e-2b32ea54cf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:35.641562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 749/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:51:35.687081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce659b43-8727-4cf8-a425-a5d802dd7517 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:51:35.688821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ce659b43-8727-4cf8-a425-a5d802dd7517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:35.698669 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:35.845293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce659b43-8727-4cf8-a425-a5d802dd7517 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:51:35.931405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:35.967134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8708e-0b7c-4b1a-85b1-2aa51f0334a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:51:35.967882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8708e-0b7c-4b1a-85b1-2aa51f0334a5 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:35.968161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8708e-0b7c-4b1a-85b1-2aa51f0334a5 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:35.968437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8708e-0b7c-4b1a-85b1-2aa51f0334a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:35.970131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2dc8708e-0b7c-4b1a-85b1-2aa51f0334a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:36.063752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8708e-0b7c-4b1a-85b1-2aa51f0334a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:51:36.065396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8708e-0b7c-4b1a-85b1-2aa51f0334a5 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:51:36.084924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 732/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:51:38.351225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098c33-9fe9-4bbb-823c-0c2719d4cbb1 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:38.351791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098c33-9fe9-4bbb-823c-0c2719d4cbb1 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:38.351791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098c33-9fe9-4bbb-823c-0c2719d4cbb1 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:38.353259 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 750/1482] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:51:38.359463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e9dea-1cd3-447e-bbe4-72773be7db94 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:38.359991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e9dea-1cd3-447e-bbe4-72773be7db94 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:38.359991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e9dea-1cd3-447e-bbe4-72773be7db94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:38.428096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-eb8e9dea-1cd3-447e-bbe4-72773be7db94 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:51:38.429345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-eb8e9dea-1cd3-447e-bbe4-72773be7db94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:38.476591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:38.528010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 733/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:51:38.570085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70098c33-9fe9-4bbb-823c-0c2719d4cbb1 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:51:38.571639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-70098c33-9fe9-4bbb-823c-0c2719d4cbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:38.596601 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:38.675425 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70098c33-9fe9-4bbb-823c-0c2719d4cbb1 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:51:38.751993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77879e0-6aa9-4e3d-88fa-7b774ba03a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:51:38.752671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77879e0-6aa9-4e3d-88fa-7b774ba03a03 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:38.752957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77879e0-6aa9-4e3d-88fa-7b774ba03a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:38.753229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77879e0-6aa9-4e3d-88fa-7b774ba03a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:38.754896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b77879e0-6aa9-4e3d-88fa-7b774ba03a03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:38.832032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:38.867870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77879e0-6aa9-4e3d-88fa-7b774ba03a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:51:38.869761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77879e0-6aa9-4e3d-88fa-7b774ba03a03 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:51:38.891256 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 751/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:51:41.051052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398430a2-d55a-45b5-b289-3ebc78ff4ce2 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:41.051644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398430a2-d55a-45b5-b289-3ebc78ff4ce2 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:41.051644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398430a2-d55a-45b5-b289-3ebc78ff4ce2 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:41.053081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 734/1485] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:51:41.058275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc49bb-2820-4dd0-8a1f-739fd50f0c09 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:41.058725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc49bb-2820-4dd0-8a1f-739fd50f0c09 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:41.058838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc49bb-2820-4dd0-8a1f-739fd50f0c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:41.122952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-15bc49bb-2820-4dd0-8a1f-739fd50f0c09 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:51:41.124384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-15bc49bb-2820-4dd0-8a1f-739fd50f0c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:41.223492 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 752/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:51:41.261967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398430a2-d55a-45b5-b289-3ebc78ff4ce2 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:51:41.263509 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-398430a2-d55a-45b5-b289-3ebc78ff4ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:41.372630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398430a2-d55a-45b5-b289-3ebc78ff4ce2 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:51:41.449204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:41.450955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd3a30-9b3e-4c82-a2df-ea72346071b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:51:41.451603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd3a30-9b3e-4c82-a2df-ea72346071b5 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:41.452401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd3a30-9b3e-4c82-a2df-ea72346071b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:41.453235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd3a30-9b3e-4c82-a2df-ea72346071b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:41.454891 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f8cd3a30-9b3e-4c82-a2df-ea72346071b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:41.566153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd3a30-9b3e-4c82-a2df-ea72346071b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:51:41.567657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd3a30-9b3e-4c82-a2df-ea72346071b5 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:51:41.586118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 735/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:51:43.879400 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73913d-62d9-4863-8bfa-674d5efcbef7 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:43.879939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73913d-62d9-4863-8bfa-674d5efcbef7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:43.880062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73913d-62d9-4863-8bfa-674d5efcbef7 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:43.881617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 753/1488] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:51:43.887469 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900102b3-3326-46b1-8d5b-cbd722c8f5e4 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:43.887933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900102b3-3326-46b1-8d5b-cbd722c8f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:43.888046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900102b3-3326-46b1-8d5b-cbd722c8f5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:43.955567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-900102b3-3326-46b1-8d5b-cbd722c8f5e4 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:51:43.957024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-900102b3-3326-46b1-8d5b-cbd722c8f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:44.011395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:44.058010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 736/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:51:44.103610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73913d-62d9-4863-8bfa-674d5efcbef7 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:51:44.105292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ea73913d-62d9-4863-8bfa-674d5efcbef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:44.142770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:44.211851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73913d-62d9-4863-8bfa-674d5efcbef7 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:51:44.285758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d342d-bd07-4521-b1ef-6f07df181b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:51:44.286410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d342d-bd07-4521-b1ef-6f07df181b39 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:44.286687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d342d-bd07-4521-b1ef-6f07df181b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:44.286962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d342d-bd07-4521-b1ef-6f07df181b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:44.288653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-456d342d-bd07-4521-b1ef-6f07df181b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:44.371713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:44.403853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d342d-bd07-4521-b1ef-6f07df181b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:51:44.405433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d342d-bd07-4521-b1ef-6f07df181b39 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:51:44.425984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 754/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:51:47.004295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fbe9a-e803-439e-9d9b-c6e7e2e81fa8 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:47.004965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fbe9a-e803-439e-9d9b-c6e7e2e81fa8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:47.005078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fbe9a-e803-439e-9d9b-c6e7e2e81fa8 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:47.006383 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 737/1491] 10.222.0.27 () {54 vars in 926 bytes} [Wed Jul 20 17:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:51:47.011864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3970e6-c5a1-438b-bebd-65d3a3bdbe79 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:47.012359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3970e6-c5a1-438b-bebd-65d3a3bdbe79 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:47.012467 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3970e6-c5a1-438b-bebd-65d3a3bdbe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:47.079496 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-8e3970e6-c5a1-438b-bebd-65d3a3bdbe79 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:51:47.080824 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8e3970e6-c5a1-438b-bebd-65d3a3bdbe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:47.178760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 755/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Wed Jul 20 17:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:51:47.220393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fbe9a-e803-439e-9d9b-c6e7e2e81fa8 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:51:47.222059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-140fbe9a-e803-439e-9d9b-c6e7e2e81fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:47.329382 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fbe9a-e803-439e-9d9b-c6e7e2e81fa8 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:51:47.412866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2c962-d5d9-4859-8f0d-b47b36a325ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:51:47.413517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2c962-d5d9-4859-8f0d-b47b36a325ea service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:51:47.413791 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2c962-d5d9-4859-8f0d-b47b36a325ea service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:51:47.414063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2c962-d5d9-4859-8f0d-b47b36a325ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:51:47.415706 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-99a2c962-d5d9-4859-8f0d-b47b36a325ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:51:47.425456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:47.526305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2c962-d5d9-4859-8f0d-b47b36a325ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:51:47.527780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2c962-d5d9-4859-8f0d-b47b36a325ea service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:51:47.547646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 738/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:51:57.176921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=82 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:51:57.544411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=50 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:26.818459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f431427-0695-4e97-86d4-a7c463a2ad2e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:26.819053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f431427-0695-4e97-86d4-a7c463a2ad2e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:26.819053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f431427-0695-4e97-86d4-a7c463a2ad2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:26.894286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-9f431427-0695-4e97-86d4-a7c463a2ad2e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:53:26.895487 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9f431427-0695-4e97-86d4-a7c463a2ad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:26.995132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 756/1494] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:53:27.003246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a25ce-0234-432b-aede-1722d9afdd7b None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:27.003778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a25ce-0234-432b-aede-1722d9afdd7b None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:27.003778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a25ce-0234-432b-aede-1722d9afdd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:27.077828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-388a25ce-0234-432b-aede-1722d9afdd7b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:53:27.078950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-388a25ce-0234-432b-aede-1722d9afdd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:27.174424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 739/1495] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:53:27.179280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f431427-0695-4e97-86d4-a7c463a2ad2e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:53:27.180670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9f431427-0695-4e97-86d4-a7c463a2ad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:27.193498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f431427-0695-4e97-86d4-a7c463a2ad2e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:53:27.259817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:27.294309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cfa00-56a1-4092-a99c-6fe915c32cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:53:27.295230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cfa00-56a1-4092-a99c-6fe915c32cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:27.295649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cfa00-56a1-4092-a99c-6fe915c32cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:27.295769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cfa00-56a1-4092-a99c-6fe915c32cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:27.296496 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cfa00-56a1-4092-a99c-6fe915c32cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:53:27.296815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cfa00-56a1-4092-a99c-6fe915c32cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:53:27.297839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: WARNING py.warnings [None req-f94cfa00-56a1-4092-a99c-6fe915c32cd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:53:27.297839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: warnings.warn(msg) Jul 20 17:53:27.297839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: Jul 20 17:53:27.298799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cfa00-56a1-4092-a99c-6fe915c32cd7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:53:27.310628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 757/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:53:27.319310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a25ce-0234-432b-aede-1722d9afdd7b None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:53:27.331120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a25ce-0234-432b-aede-1722d9afdd7b None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:53:27.401287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:27.435557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78c18d-460d-433c-9dd8-a8ed54cda3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:53:27.436281 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78c18d-460d-433c-9dd8-a8ed54cda3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:27.436600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78c18d-460d-433c-9dd8-a8ed54cda3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:27.436882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78c18d-460d-433c-9dd8-a8ed54cda3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:27.437584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78c18d-460d-433c-9dd8-a8ed54cda3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:53:27.439365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: WARNING py.warnings [None req-ad78c18d-460d-433c-9dd8-a8ed54cda3e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:53:27.439365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: warnings.warn(msg) Jul 20 17:53:27.439365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: Jul 20 17:53:27.440617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78c18d-460d-433c-9dd8-a8ed54cda3e1 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:53:27.549649 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 740/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:53:27 2022] POST /identity/v3/projects => generated 379 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:53:27.554012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cfa00-56a1-4092-a99c-6fe915c32cd7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:53:27.555545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f94cfa00-56a1-4092-a99c-6fe915c32cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:27.595608 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cfa00-56a1-4092-a99c-6fe915c32cd7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:53:27.702342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53661a24-2678-454c-b84c-cc545ba332c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:53:27.703013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53661a24-2678-454c-b84c-cc545ba332c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:27.703296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53661a24-2678-454c-b84c-cc545ba332c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:27.703577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53661a24-2678-454c-b84c-cc545ba332c4 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:27.704327 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53661a24-2678-454c-b84c-cc545ba332c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:53:27.705430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: WARNING py.warnings [None req-53661a24-2678-454c-b84c-cc545ba332c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:53:27.705430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: warnings.warn(msg) Jul 20 17:53:27.705430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: Jul 20 17:53:27.706624 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53661a24-2678-454c-b84c-cc545ba332c4 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:53:27.820648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 758/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:53:27 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:53:27.825404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78c18d-460d-433c-9dd8-a8ed54cda3e1 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:53:27.826954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ad78c18d-460d-433c-9dd8-a8ed54cda3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:27.887681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78c18d-460d-433c-9dd8-a8ed54cda3e1 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:53:27.972732 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:27.983549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926e6c6-239c-401e-9cf0-0a235ce0647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:53:27.984230 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926e6c6-239c-401e-9cf0-0a235ce0647a admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:27.984537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926e6c6-239c-401e-9cf0-0a235ce0647a admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:27.984817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926e6c6-239c-401e-9cf0-0a235ce0647a admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:27.985547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926e6c6-239c-401e-9cf0-0a235ce0647a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:53:27.986572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: WARNING py.warnings [None req-a926e6c6-239c-401e-9cf0-0a235ce0647a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:53:27.986572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: warnings.warn(msg) Jul 20 17:53:27.986572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: Jul 20 17:53:27.987460 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926e6c6-239c-401e-9cf0-0a235ce0647a admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:53:28.000784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 741/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:53:28.009491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53661a24-2678-454c-b84c-cc545ba332c4 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:53:28.009491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-53661a24-2678-454c-b84c-cc545ba332c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:28.018583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53661a24-2678-454c-b84c-cc545ba332c4 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:53:28.043839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:28.113261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2303d-78da-4798-9e81-cd2518038094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:53:28.113932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2303d-78da-4798-9e81-cd2518038094 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:28.114217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2303d-78da-4798-9e81-cd2518038094 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:28.114491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2303d-78da-4798-9e81-cd2518038094 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:28.115211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2303d-78da-4798-9e81-cd2518038094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:53:28.116232 dv-cinder-849846-3-smb devstack@keystone.service[87027]: WARNING py.warnings [None req-81b2303d-78da-4798-9e81-cd2518038094 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:53:28.116232 dv-cinder-849846-3-smb devstack@keystone.service[87027]: warnings.warn(msg) Jul 20 17:53:28.116232 dv-cinder-849846-3-smb devstack@keystone.service[87027]: Jul 20 17:53:28.117150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2303d-78da-4798-9e81-cd2518038094 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:53:28.130304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 759/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:53:28.134234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926e6c6-239c-401e-9cf0-0a235ce0647a admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:53:28.139352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a926e6c6-239c-401e-9cf0-0a235ce0647a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:28.171771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926e6c6-239c-401e-9cf0-0a235ce0647a admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:53:28.274585 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde932fc-a6de-4756-a60a-701c7e280afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:53:28.275471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde932fc-a6de-4756-a60a-701c7e280afc admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:28.275804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde932fc-a6de-4756-a60a-701c7e280afc admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:28.276187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde932fc-a6de-4756-a60a-701c7e280afc admin admin] PATH_INFO: `/v3/projects/97f9a0c807fb4151842e91460645c5dc/users/6ec7353a45694be6a4bae9028a6d8196/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:28.299583 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde932fc-a6de-4756-a60a-701c7e280afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f9a0c807fb4151842e91460645c5dc, user_id=6ec7353a45694be6a4bae9028a6d8196, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:53:28.300666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: WARNING py.warnings [None req-dde932fc-a6de-4756-a60a-701c7e280afc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:53:28.300666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: warnings.warn(msg) Jul 20 17:53:28.300666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: Jul 20 17:53:28.302597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde932fc-a6de-4756-a60a-701c7e280afc admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:53:28.374448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 742/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:53:28 2022] PUT /identity/v3/projects/97f9a0c807fb4151842e91460645c5dc/users/6ec7353a45694be6a4bae9028a6d8196/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:53:28.387065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42547da-7e82-434a-9d7a-edc44f30cc0d None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:28.387354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42547da-7e82-434a-9d7a-edc44f30cc0d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:28.387636 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42547da-7e82-434a-9d7a-edc44f30cc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:28.451318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-c42547da-7e82-434a-9d7a-edc44f30cc0d None None] MFA Rules not processed for user `6ec7353a45694be6a4bae9028a6d8196`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:53:28.452461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c42547da-7e82-434a-9d7a-edc44f30cc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:28.537478 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 760/1502] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:53:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:53:28.547495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014835d5-9d16-48d5-96e9-984bbc989f3c None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:28.547495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014835d5-9d16-48d5-96e9-984bbc989f3c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:28.547883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014835d5-9d16-48d5-96e9-984bbc989f3c None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:28.549150 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 743/1503] 10.222.0.27 () {54 vars in 964 bytes} [Wed Jul 20 17:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:53:28.554227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac10d0-06c4-494d-a547-ae988121d5fa None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:28.554516 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac10d0-06c4-494d-a547-ae988121d5fa None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:28.554787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac10d0-06c4-494d-a547-ae988121d5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:28.587700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:28.634788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a0ac10d0-06c4-494d-a547-ae988121d5fa None None] MFA Rules not processed for user `4dfd634e889c4b53a1ed6b90cc1a25e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:53:28.636181 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a0ac10d0-06c4-494d-a547-ae988121d5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:28.711234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 761/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Jul 20 17:53:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:53:28.719956 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014835d5-9d16-48d5-96e9-984bbc989f3c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:53:28.721499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-014835d5-9d16-48d5-96e9-984bbc989f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:28.770986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:28.826521 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014835d5-9d16-48d5-96e9-984bbc989f3c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:53:28.900422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de49877-500d-465e-a802-007a4e804c15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:53:28.901845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de49877-500d-465e-a802-007a4e804c15 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:28.902134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de49877-500d-465e-a802-007a4e804c15 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:28.902430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de49877-500d-465e-a802-007a4e804c15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:28.904096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6de49877-500d-465e-a802-007a4e804c15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:29.005110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de49877-500d-465e-a802-007a4e804c15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:53:29.006550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de49877-500d-465e-a802-007a4e804c15 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:53:29.009996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:29.024690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 744/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:53:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:53:29.068148 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48cae3-ac60-4f70-9ba3-b16d54065c96 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:29.068591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48cae3-ac60-4f70-9ba3-b16d54065c96 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:29.068744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48cae3-ac60-4f70-9ba3-b16d54065c96 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:29.070013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 762/1506] 10.222.0.27 () {52 vars in 829 bytes} [Wed Jul 20 17:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:53:29.074196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de49877-500d-465e-a802-007a4e804c15 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:53:29.075408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6de49877-500d-465e-a802-007a4e804c15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:29.178727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de49877-500d-465e-a802-007a4e804c15 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:53:29.280798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:53:29.281123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:29.281373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:29.281643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] PATH_INFO: `/v3/users/6ec7353a45694be6a4bae9028a6d8196` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:29.294214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec7353a45694be6a4bae9028a6d8196)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:53:29.295535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: WARNING py.warnings [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:53:29.295535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: warnings.warn(msg) Jul 20 17:53:29.295535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: Jul 20 17:53:29.296756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:53:29.306285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:29.552115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec7353a45694be6a4bae9028a6d8196'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:53:29.571110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec7353a45694be6a4bae9028a6d8196'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:53:29.583401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec7353a45694be6a4bae9028a6d8196'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:53:29.671537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec7353a45694be6a4bae9028a6d8196'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:53:29.672251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec7353a45694be6a4bae9028a6d8196'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:53:29.678558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 745/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:53:29 2022] DELETE /identity/v3/users/6ec7353a45694be6a4bae9028a6d8196 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:53:29.683420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3d2b2-f730-4ddf-828f-05a987195a94 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:29.683824 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3d2b2-f730-4ddf-828f-05a987195a94 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:29.684204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3d2b2-f730-4ddf-828f-05a987195a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:29.735010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ddc3d2b2-f730-4ddf-828f-05a987195a94 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:53:29.736215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ddc3d2b2-f730-4ddf-828f-05a987195a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:29.795970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 763/1508] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:53:29.805450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:53:29.806787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:29.902746 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6917a1-f486-452d-9b11-1a3f11dbba57 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:53:29.906395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa931d-e324-46e6-993b-1f050e8dadee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:53:29.907056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa931d-e324-46e6-993b-1f050e8dadee service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:29.907319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa931d-e324-46e6-993b-1f050e8dadee service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:29.907594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa931d-e324-46e6-993b-1f050e8dadee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:29.916779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa931d-e324-46e6-993b-1f050e8dadee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:53:29.918210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa931d-e324-46e6-993b-1f050e8dadee service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:53:29.927790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 746/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:53:30.428070 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3d2b2-f730-4ddf-828f-05a987195a94 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:53:30.429519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ddc3d2b2-f730-4ddf-828f-05a987195a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:53:30.443265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3d2b2-f730-4ddf-828f-05a987195a94 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:53:30.450677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:53:30.452445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:53:30.453652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:53:30.453933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] PATH_INFO: `/v3/projects/97f9a0c807fb4151842e91460645c5dc` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:53:30.467007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f9a0c807fb4151842e91460645c5dc)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:53:30.468058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: WARNING py.warnings [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:53:30.468058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: warnings.warn(msg) Jul 20 17:53:30.468058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: Jul 20 17:53:30.469301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:53:30.490348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:30.596709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f9a0c807fb4151842e91460645c5dc', 'request_id': 'req-b1836a9b-3d6b-4985-807d-4142f762ba87'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:53:30.610605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f9a0c807fb4151842e91460645c5dc', 'request_id': 'req-b1836a9b-3d6b-4985-807d-4142f762ba87'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:53:30.616552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f9a0c807fb4151842e91460645c5dc', 'request_id': 'req-b1836a9b-3d6b-4985-807d-4142f762ba87'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:53:30.735171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] The token cache is being invalidate because project 97f9a0c807fb4151842e91460645c5dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:53:30.735388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:53:30.736130 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b1836a9b-3d6b-4985-807d-4142f762ba87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:53:30.737720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 764/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:53:30 2022] DELETE /identity/v3/projects/97f9a0c807fb4151842e91460645c5dc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:53:39.923661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:DELETE=10,keystone:SELECT=64,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:53:40.731788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:15.864451 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479e1c0-abde-4597-9098-fd68faf86ba0 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:15.865140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479e1c0-abde-4597-9098-fd68faf86ba0 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:15.865140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479e1c0-abde-4597-9098-fd68faf86ba0 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:15.866415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 17:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:55:15.871657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26140768-f12e-4282-a87b-505cc28711f7 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:15.872102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26140768-f12e-4282-a87b-505cc28711f7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:15.872231 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26140768-f12e-4282-a87b-505cc28711f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:15.924794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-26140768-f12e-4282-a87b-505cc28711f7 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:55:15.926005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-26140768-f12e-4282-a87b-505cc28711f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:15.985388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 17:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:55:16.144171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479e1c0-abde-4597-9098-fd68faf86ba0 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:55:16.145902 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8479e1c0-abde-4597-9098-fd68faf86ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:16.253407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479e1c0-abde-4597-9098-fd68faf86ba0 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:55:16.260161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d5379-4368-4699-bec9-44dcf00def72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:55:16.261279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5379-4368-4699-bec9-44dcf00def72 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:16.261279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5379-4368-4699-bec9-44dcf00def72 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:16.261506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5379-4368-4699-bec9-44dcf00def72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:16.271095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d5379-4368-4699-bec9-44dcf00def72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:55:16.272804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d5379-4368-4699-bec9-44dcf00def72 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:55:16.284240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 748/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:55:17.154632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88ad73-69c9-4b09-9b61-1ced269d2d43 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:17.155227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88ad73-69c9-4b09-9b61-1ced269d2d43 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:17.155227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88ad73-69c9-4b09-9b61-1ced269d2d43 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:17.157173 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 17:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:55:17.165382 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdc20b-7cce-4b76-9315-cdd6d8b4d454 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:17.165982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdc20b-7cce-4b76-9315-cdd6d8b4d454 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:17.165982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdc20b-7cce-4b76-9315-cdd6d8b4d454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:17.186026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-48bdc20b-7cce-4b76-9315-cdd6d8b4d454 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:55:17.187359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-48bdc20b-7cce-4b76-9315-cdd6d8b4d454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:17.195998 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 17:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:55:17.348913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88ad73-69c9-4b09-9b61-1ced269d2d43 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:55:17.364283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88ad73-69c9-4b09-9b61-1ced269d2d43 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:55:17.369903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36785a-2524-46ec-8e37-7c5586503a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:55:17.370605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36785a-2524-46ec-8e37-7c5586503a84 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:17.370840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36785a-2524-46ec-8e37-7c5586503a84 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:17.371120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36785a-2524-46ec-8e37-7c5586503a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:17.380255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36785a-2524-46ec-8e37-7c5586503a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:55:17.381908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36785a-2524-46ec-8e37-7c5586503a84 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:55:17.392220 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 767/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:55:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:55:18.299206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d2743-6d3d-422c-9741-086d725fa43e None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:18.299767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d2743-6d3d-422c-9741-086d725fa43e None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:18.299767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d2743-6d3d-422c-9741-086d725fa43e None None] PATH_INFO: `/v3` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:18.301135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 750/1517] 10.222.0.13 () {54 vars in 925 bytes} [Wed Jul 20 17:55:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:55:18.307590 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4088f-6a22-435d-8774-ff15415fdb3c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:18.308025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4088f-6a22-435d-8774-ff15415fdb3c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:18.308129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4088f-6a22-435d-8774-ff15415fdb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:18.368208 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-d2f4088f-6a22-435d-8774-ff15415fdb3c None None] MFA Rules not processed for user `b218402abe6540d8b81295676199f6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:55:18.369453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d2f4088f-6a22-435d-8774-ff15415fdb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:18.444664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 768/1518] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Jul 20 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:55:27.180670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=49 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:28.373435 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf2284-79ce-401b-bd7a-5961902b5bb8 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:28.374109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf2284-79ce-401b-bd7a-5961902b5bb8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:28.374394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf2284-79ce-401b-bd7a-5961902b5bb8 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:28.376922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 751/1519] 10.222.0.27 () {54 vars in 961 bytes} [Wed Jul 20 17:55:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:55:28.382318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11975d-b900-40f4-8ff9-220c98c93fbf None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:28.382830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11975d-b900-40f4-8ff9-220c98c93fbf None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:28.382926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11975d-b900-40f4-8ff9-220c98c93fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:28.402430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-5a11975d-b900-40f4-8ff9-220c98c93fbf None None] MFA Rules not processed for user `b218402abe6540d8b81295676199f6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:55:28.403713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5a11975d-b900-40f4-8ff9-220c98c93fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:28.413619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 769/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Jul 20 17:55:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:55:28.421573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf2284-79ce-401b-bd7a-5961902b5bb8 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:55:28.435732 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf2284-79ce-401b-bd7a-5961902b5bb8 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:55:28.440854 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad1d70-cd73-42af-b5c0-43d16b3c0826 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b218402abe6540d8b81295676199f6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:55:28.441503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad1d70-cd73-42af-b5c0-43d16b3c0826 service placement] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:28.441841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad1d70-cd73-42af-b5c0-43d16b3c0826 service placement] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:28.442121 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad1d70-cd73-42af-b5c0-43d16b3c0826 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:28.450894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad1d70-cd73-42af-b5c0-43d16b3c0826 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:55:28.452496 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad1d70-cd73-42af-b5c0-43d16b3c0826 service placement] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:55:28.462946 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 752/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:55:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:55:28.642355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf374d6-8aa0-4149-aba6-5b4ff8ade5ab None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:28.642787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf374d6-8aa0-4149-aba6-5b4ff8ade5ab None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:28.643013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf374d6-8aa0-4149-aba6-5b4ff8ade5ab None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:28.644433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 17:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:55:28.649693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135d067-480e-4e18-8f25-266d476a4c67 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:28.649986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135d067-480e-4e18-8f25-266d476a4c67 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:28.650267 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135d067-480e-4e18-8f25-266d476a4c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:28.670216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-9135d067-480e-4e18-8f25-266d476a4c67 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:55:28.671402 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9135d067-480e-4e18-8f25-266d476a4c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:28.680270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 17:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:55:28.840362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf374d6-8aa0-4149-aba6-5b4ff8ade5ab None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:55:28.855435 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf374d6-8aa0-4149-aba6-5b4ff8ade5ab None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:55:28.862468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d2d51-beb9-43e4-bad8-69a2ce982466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:55:28.863143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d2d51-beb9-43e4-bad8-69a2ce982466 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:28.863421 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d2d51-beb9-43e4-bad8-69a2ce982466 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:28.863695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d2d51-beb9-43e4-bad8-69a2ce982466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:28.872934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d2d51-beb9-43e4-bad8-69a2ce982466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:55:28.874528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d2d51-beb9-43e4-bad8-69a2ce982466 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:55:28.883253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:28.890120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 771/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:55:29.729892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa86d6d-8c84-4a51-a3eb-261da6587244 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:29.730405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa86d6d-8c84-4a51-a3eb-261da6587244 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:29.730405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa86d6d-8c84-4a51-a3eb-261da6587244 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:29.731741 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 17:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:55:29.736792 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746df0b-c5f8-4a47-84c1-f7aac75f3fca None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:29.737199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746df0b-c5f8-4a47-84c1-f7aac75f3fca None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:29.737337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746df0b-c5f8-4a47-84c1-f7aac75f3fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:29.755426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e746df0b-c5f8-4a47-84c1-f7aac75f3fca None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:55:29.756655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e746df0b-c5f8-4a47-84c1-f7aac75f3fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:29.764486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 17:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:55:29.917919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa86d6d-8c84-4a51-a3eb-261da6587244 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:55:29.932982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa86d6d-8c84-4a51-a3eb-261da6587244 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:55:29.938967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f00c5-6dca-46a5-bf47-533e86403bbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:55:29.939698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f00c5-6dca-46a5-bf47-533e86403bbd service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:29.939979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f00c5-6dca-46a5-bf47-533e86403bbd service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:29.940252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f00c5-6dca-46a5-bf47-533e86403bbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:29.948396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f00c5-6dca-46a5-bf47-533e86403bbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:55:29.950003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f00c5-6dca-46a5-bf47-533e86403bbd service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:55:29.960144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 755/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:55:33.963556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32271a38-13e5-46ac-8ee1-4a8811ce7d5f None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:33.964403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32271a38-13e5-46ac-8ee1-4a8811ce7d5f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:33.964403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32271a38-13e5-46ac-8ee1-4a8811ce7d5f None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:33.965517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:55:33.972440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d105-34ff-49e1-8f37-3213984e181a None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:33.976634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d105-34ff-49e1-8f37-3213984e181a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:33.976634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d105-34ff-49e1-8f37-3213984e181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:33.991677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-cf10d105-34ff-49e1-8f37-3213984e181a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:55:33.992999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-cf10d105-34ff-49e1-8f37-3213984e181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:34.001390 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:55:34.078876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32271a38-13e5-46ac-8ee1-4a8811ce7d5f None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:55:34.080895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-32271a38-13e5-46ac-8ee1-4a8811ce7d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:34.141907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32271a38-13e5-46ac-8ee1-4a8811ce7d5f None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:55:34.146099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dd16f-744b-4b41-b15f-a81f7a75afcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:55:34.146756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dd16f-744b-4b41-b15f-a81f7a75afcb service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:34.147039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dd16f-744b-4b41-b15f-a81f7a75afcb service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:34.147316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dd16f-744b-4b41-b15f-a81f7a75afcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:34.156768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dd16f-744b-4b41-b15f-a81f7a75afcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:55:34.158205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dd16f-744b-4b41-b15f-a81f7a75afcb service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:55:34.167587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 774/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:55:36.405160 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbffc2e-9fd4-4746-a448-7151cf995ce5 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:36.405716 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbffc2e-9fd4-4746-a448-7151cf995ce5 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:36.405888 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbffc2e-9fd4-4746-a448-7151cf995ce5 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:36.408800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:55:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:55:36.414391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d6eed-50db-431b-aef3-45c5cfac81f0 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:36.414867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d6eed-50db-431b-aef3-45c5cfac81f0 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:36.414975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d6eed-50db-431b-aef3-45c5cfac81f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:36.434484 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-9f0d6eed-50db-431b-aef3-45c5cfac81f0 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:55:36.435698 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9f0d6eed-50db-431b-aef3-45c5cfac81f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:36.444075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:55:36.481012 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbffc2e-9fd4-4746-a448-7151cf995ce5 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:55:36.492405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbffc2e-9fd4-4746-a448-7151cf995ce5 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:55:36.495896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0235df-a3b3-4ba7-93dd-527bb860b869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:55:36.496553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0235df-a3b3-4ba7-93dd-527bb860b869 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:36.496835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0235df-a3b3-4ba7-93dd-527bb860b869 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:36.497109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0235df-a3b3-4ba7-93dd-527bb860b869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:36.506196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0235df-a3b3-4ba7-93dd-527bb860b869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:55:36.507631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0235df-a3b3-4ba7-93dd-527bb860b869 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:55:36.517647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 758/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:55:40.151793 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615215be-cc00-4c36-b194-8e65dc0095f7 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:40.152338 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615215be-cc00-4c36-b194-8e65dc0095f7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:40.152338 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615215be-cc00-4c36-b194-8e65dc0095f7 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:40.153756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:55:40.159798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c375d-9228-4fb1-a13f-797ff8afce07 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:40.160550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c375d-9228-4fb1-a13f-797ff8afce07 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:40.160550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c375d-9228-4fb1-a13f-797ff8afce07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:40.180417 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-4e1c375d-9228-4fb1-a13f-797ff8afce07 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:55:40.182200 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4e1c375d-9228-4fb1-a13f-797ff8afce07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:40.190886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:55:40.545671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615215be-cc00-4c36-b194-8e65dc0095f7 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:55:40.547644 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-615215be-cc00-4c36-b194-8e65dc0095f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:40.628552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615215be-cc00-4c36-b194-8e65dc0095f7 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:55:40.632847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c7533-0b2e-4a24-ae81-e613540030f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:55:40.633500 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c7533-0b2e-4a24-ae81-e613540030f8 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:40.634461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c7533-0b2e-4a24-ae81-e613540030f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:40.635913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c7533-0b2e-4a24-ae81-e613540030f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:40.646179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c7533-0b2e-4a24-ae81-e613540030f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:55:40.647619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c7533-0b2e-4a24-ae81-e613540030f8 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:55:40.657397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 777/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:55:42.807004 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c3d0f-12d9-4400-907f-f636bd2f311e None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:42.807576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c3d0f-12d9-4400-907f-f636bd2f311e None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:42.807576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c3d0f-12d9-4400-907f-f636bd2f311e None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:42.809071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 17:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:55:42.814714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed52ae2-5d04-4f8c-8184-f7d2e999234b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:42.815117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed52ae2-5d04-4f8c-8184-f7d2e999234b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:42.815270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed52ae2-5d04-4f8c-8184-f7d2e999234b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:42.833904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-6ed52ae2-5d04-4f8c-8184-f7d2e999234b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:55:42.835093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6ed52ae2-5d04-4f8c-8184-f7d2e999234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:42.843031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 17:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:55:43.151515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c3d0f-12d9-4400-907f-f636bd2f311e None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:55:43.153206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a47c3d0f-12d9-4400-907f-f636bd2f311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:55:43.167342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c3d0f-12d9-4400-907f-f636bd2f311e None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:55:43.171207 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9d62c-5c81-4e0b-b117-998ff3abdb47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:55:43.175866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9d62c-5c81-4e0b-b117-998ff3abdb47 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:55:43.175866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9d62c-5c81-4e0b-b117-998ff3abdb47 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:55:43.175866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9d62c-5c81-4e0b-b117-998ff3abdb47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:55:43.183229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9d62c-5c81-4e0b-b117-998ff3abdb47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:55:43.184796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9d62c-5c81-4e0b-b117-998ff3abdb47 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:55:43.195660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 761/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:55:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:55:52.828048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=71 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:55:53.190743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=33 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:18.523355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de8864-80c1-4800-ac6f-6e4a820dd198 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:18.524032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de8864-80c1-4800-ac6f-6e4a820dd198 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:18.524354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de8864-80c1-4800-ac6f-6e4a820dd198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:18.575993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-15de8864-80c1-4800-ac6f-6e4a820dd198 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:18.578556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-15de8864-80c1-4800-ac6f-6e4a820dd198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:18.596571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 779/1540] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:18.606754 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5090366-b492-4dac-aa07-73b78d5ec799 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:18.607821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5090366-b492-4dac-aa07-73b78d5ec799 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:18.608334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5090366-b492-4dac-aa07-73b78d5ec799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:18.645930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-a5090366-b492-4dac-aa07-73b78d5ec799 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:18.647570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a5090366-b492-4dac-aa07-73b78d5ec799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:18.663581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 762/1541] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:57:18.670938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de8864-80c1-4800-ac6f-6e4a820dd198 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:18.691627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc510b-b732-4aaa-9c96-0af2786732cc None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:18.692299 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc510b-b732-4aaa-9c96-0af2786732cc None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:18.693000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc510b-b732-4aaa-9c96-0af2786732cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:18.694856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de8864-80c1-4800-ac6f-6e4a820dd198 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:18.709884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad3d3b-5b95-461b-9457-fcc30df03c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:18.711102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad3d3b-5b95-461b-9457-fcc30df03c94 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:18.711612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad3d3b-5b95-461b-9457-fcc30df03c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:18.712121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad3d3b-5b95-461b-9457-fcc30df03c94 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:18.713687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad3d3b-5b95-461b-9457-fcc30df03c94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:57:18.715287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad3d3b-5b95-461b-9457-fcc30df03c94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:18.718619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad3d3b-5b95-461b-9457-fcc30df03c94 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:18.727130 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d7dc510b-b732-4aaa-9c96-0af2786732cc None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:18.728965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d7dc510b-b732-4aaa-9c96-0af2786732cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:18.747074 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 763/1542] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:57:18.755600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90509b-7904-4a96-aca7-02f708bf93e9 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:18.755947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90509b-7904-4a96-aca7-02f708bf93e9 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:18.756181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90509b-7904-4a96-aca7-02f708bf93e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:18.757079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 780/1543] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:57:18.767318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad3d3b-5b95-461b-9457-fcc30df03c94 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:18.793675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad3d3b-5b95-461b-9457-fcc30df03c94 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:18.801818 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-1a90509b-7904-4a96-aca7-02f708bf93e9 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:18.803152 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-1a90509b-7904-4a96-aca7-02f708bf93e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:18.810532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac260d-ba62-404f-9610-5b792b51d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:18.811759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac260d-ba62-404f-9610-5b792b51d49f admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:18.812255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac260d-ba62-404f-9610-5b792b51d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:18.812799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac260d-ba62-404f-9610-5b792b51d49f admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:18.814258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac260d-ba62-404f-9610-5b792b51d49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:18.816378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: WARNING py.warnings [None req-15ac260d-ba62-404f-9610-5b792b51d49f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:57:18.816378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: warnings.warn(msg) Jul 20 17:57:18.816378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: Jul 20 17:57:18.819115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac260d-ba62-404f-9610-5b792b51d49f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:18.828945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 764/1544] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:57:18.830406 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7802199-b770-4b32-a6a4-5dc4d0ee3b58 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:18.830700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7802199-b770-4b32-a6a4-5dc4d0ee3b58 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:18.831024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7802199-b770-4b32-a6a4-5dc4d0ee3b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:18.873728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e7802199-b770-4b32-a6a4-5dc4d0ee3b58 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:18.874995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e7802199-b770-4b32-a6a4-5dc4d0ee3b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:18.888856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 765/1545] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:18.889747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7802199-b770-4b32-a6a4-5dc4d0ee3b58 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:18.911256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7802199-b770-4b32-a6a4-5dc4d0ee3b58 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:18.923270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513cef2-cdab-410b-a5fb-be109a4eecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:18.923896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513cef2-cdab-410b-a5fb-be109a4eecbf admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:18.924186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513cef2-cdab-410b-a5fb-be109a4eecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:18.924469 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513cef2-cdab-410b-a5fb-be109a4eecbf admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:18.925260 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513cef2-cdab-410b-a5fb-be109a4eecbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:57:18.925577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513cef2-cdab-410b-a5fb-be109a4eecbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:18.926638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: WARNING py.warnings [None req-0513cef2-cdab-410b-a5fb-be109a4eecbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:57:18.926638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: warnings.warn(msg) Jul 20 17:57:18.926638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: Jul 20 17:57:18.927574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513cef2-cdab-410b-a5fb-be109a4eecbf admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:18.955354 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 766/1546] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:57:18.956768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdca70-a6ac-4418-9a13-616e873fd631 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:18.957060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdca70-a6ac-4418-9a13-616e873fd631 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:18.957336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdca70-a6ac-4418-9a13-616e873fd631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:19.001723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-01bdca70-a6ac-4418-9a13-616e873fd631 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:19.003046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-01bdca70-a6ac-4418-9a13-616e873fd631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:19.015187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 767/1547] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:19.016127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdca70-a6ac-4418-9a13-616e873fd631 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:19.035163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdca70-a6ac-4418-9a13-616e873fd631 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:19.041330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 781/1548] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:18 2022] POST /identity/v3/projects => generated 373 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:57:19.044088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac260d-ba62-404f-9610-5b792b51d49f admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:19.185450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9526033-a442-4ff5-a120-a187676926fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:19.186047 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9526033-a442-4ff5-a120-a187676926fc admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:19.186339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9526033-a442-4ff5-a120-a187676926fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:19.186620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9526033-a442-4ff5-a120-a187676926fc admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:19.187351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9526033-a442-4ff5-a120-a187676926fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:19.189422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9526033-a442-4ff5-a120-a187676926fc admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:19.208592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac260d-ba62-404f-9610-5b792b51d49f admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:19.216336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419d277-e0b9-4e14-b60f-409637c19797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:19.218721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d277-e0b9-4e14-b60f-409637c19797 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:19.219747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d277-e0b9-4e14-b60f-409637c19797 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:19.220253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d277-e0b9-4e14-b60f-409637c19797 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:19.221308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419d277-e0b9-4e14-b60f-409637c19797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:57:19.221903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419d277-e0b9-4e14-b60f-409637c19797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:19.224853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419d277-e0b9-4e14-b60f-409637c19797 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:19.244235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 782/1549] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:57:19.245864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419d277-e0b9-4e14-b60f-409637c19797 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:19.259419 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419d277-e0b9-4e14-b60f-409637c19797 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:19.266805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebc3f0-022b-4847-a432-0f10d776cba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:19.267940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebc3f0-022b-4847-a432-0f10d776cba0 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:19.268779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebc3f0-022b-4847-a432-0f10d776cba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:19.269303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebc3f0-022b-4847-a432-0f10d776cba0 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:19.270764 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebc3f0-022b-4847-a432-0f10d776cba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:19.273583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebc3f0-022b-4847-a432-0f10d776cba0 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:19.382836 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 768/1550] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:19 2022] POST /identity/v3/projects => generated 363 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:19.384297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285af706-c44f-4bbd-8ddd-5895bde27691 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:19.384638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285af706-c44f-4bbd-8ddd-5895bde27691 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:19.384951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285af706-c44f-4bbd-8ddd-5895bde27691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:19.428856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-285af706-c44f-4bbd-8ddd-5895bde27691 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:19.430172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-285af706-c44f-4bbd-8ddd-5895bde27691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:19.462657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 783/1551] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:19 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:19.468433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebc3f0-022b-4847-a432-0f10d776cba0 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:19.494856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebc3f0-022b-4847-a432-0f10d776cba0 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:19.654665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a0e19-571c-4b4f-9455-51d346e5ec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:19.655843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0e19-571c-4b4f-9455-51d346e5ec10 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:19.656353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0e19-571c-4b4f-9455-51d346e5ec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:19.661158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0e19-571c-4b4f-9455-51d346e5ec10 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:19.662821 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a0e19-571c-4b4f-9455-51d346e5ec10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:19.666830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a0e19-571c-4b4f-9455-51d346e5ec10 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:19.678170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 769/1552] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:19.679062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285af706-c44f-4bbd-8ddd-5895bde27691 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:19.695235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285af706-c44f-4bbd-8ddd-5895bde27691 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:19.709711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c8b2a-b2f4-45ea-b182-bf4c8a8e0410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:19.710178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c8b2a-b2f4-45ea-b182-bf4c8a8e0410 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:19.710526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c8b2a-b2f4-45ea-b182-bf4c8a8e0410 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:19.710763 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c8b2a-b2f4-45ea-b182-bf4c8a8e0410 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:19.711538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c8b2a-b2f4-45ea-b182-bf4c8a8e0410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:19.712634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: WARNING py.warnings [None req-b88c8b2a-b2f4-45ea-b182-bf4c8a8e0410 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:57:19.712634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: warnings.warn(msg) Jul 20 17:57:19.712634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: Jul 20 17:57:19.714299 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c8b2a-b2f4-45ea-b182-bf4c8a8e0410 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:19.875817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 770/1553] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:19 2022] POST /identity/v3/users => generated 282 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:19.883060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c8b2a-b2f4-45ea-b182-bf4c8a8e0410 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:19.904526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c8b2a-b2f4-45ea-b182-bf4c8a8e0410 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:19.913414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1ddca-b35d-47c9-b990-773595f92d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:19.914613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ddca-b35d-47c9-b990-773595f92d92 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:19.915119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ddca-b35d-47c9-b990-773595f92d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:19.915617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ddca-b35d-47c9-b990-773595f92d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:19.917986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1ddca-b35d-47c9-b990-773595f92d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:19.921202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1ddca-b35d-47c9-b990-773595f92d92 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:19.953790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 771/1554] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:19.956199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de758-bf3f-49b7-bbb0-56c2c0a18b9e None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:19.956726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de758-bf3f-49b7-bbb0-56c2c0a18b9e None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:19.957212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de758-bf3f-49b7-bbb0-56c2c0a18b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:19.983908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 784/1555] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:19 2022] POST /identity/v3/projects => generated 377 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:19.983908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85612f-ed35-48f1-b63f-86e34f536ba1 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:19.983908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85612f-ed35-48f1-b63f-86e34f536ba1 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:19.983908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85612f-ed35-48f1-b63f-86e34f536ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:19.994404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-231de758-bf3f-49b7-bbb0-56c2c0a18b9e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:19.999794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-231de758-bf3f-49b7-bbb0-56c2c0a18b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:20.010066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:20.015042 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-2b85612f-ed35-48f1-b63f-86e34f536ba1 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:20.016339 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2b85612f-ed35-48f1-b63f-86e34f536ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:20.022362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:20.095590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 772/1556] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:20.097399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac2b61-5b68-48dc-b20b-68f774cce809 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.097807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac2b61-5b68-48dc-b20b-68f774cce809 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.098225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac2b61-5b68-48dc-b20b-68f774cce809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.098684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 785/1557] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:20.100288 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85612f-ed35-48f1-b63f-86e34f536ba1 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.117495 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85612f-ed35-48f1-b63f-86e34f536ba1 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.123631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d7ac2b61-5b68-48dc-b20b-68f774cce809 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:20.124918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d7ac2b61-5b68-48dc-b20b-68f774cce809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:20.125249 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb51bd5-4545-4460-92d7-3dd4d85b9a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.125985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb51bd5-4545-4460-92d7-3dd4d85b9a4e admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.126310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb51bd5-4545-4460-92d7-3dd4d85b9a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.126777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb51bd5-4545-4460-92d7-3dd4d85b9a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.128224 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb51bd5-4545-4460-92d7-3dd4d85b9a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.131422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb51bd5-4545-4460-92d7-3dd4d85b9a4e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.133088 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 773/1558] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:20.134459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d177c-73e7-4276-a863-53701b1fab21 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.134748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d177c-73e7-4276-a863-53701b1fab21 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.135550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d177c-73e7-4276-a863-53701b1fab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.154519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 786/1559] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:20.156379 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb51bd5-4545-4460-92d7-3dd4d85b9a4e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.163270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-094d177c-73e7-4276-a863-53701b1fab21 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:20.164560 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-094d177c-73e7-4276-a863-53701b1fab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:20.174593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 774/1560] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:20.175480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d177c-73e7-4276-a863-53701b1fab21 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.177067 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb51bd5-4545-4460-92d7-3dd4d85b9a4e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.186606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd611f05-d639-4eb0-a1b2-044e7db09682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.187300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd611f05-d639-4eb0-a1b2-044e7db09682 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.187607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd611f05-d639-4eb0-a1b2-044e7db09682 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.189471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd611f05-d639-4eb0-a1b2-044e7db09682 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.189471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd611f05-d639-4eb0-a1b2-044e7db09682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.189927 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d177c-73e7-4276-a863-53701b1fab21 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.190431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd611f05-d639-4eb0-a1b2-044e7db09682 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.195197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95650541-cfa6-46bb-b8c3-82cc2083864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.196035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95650541-cfa6-46bb-b8c3-82cc2083864a admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.196531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95650541-cfa6-46bb-b8c3-82cc2083864a admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.196990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95650541-cfa6-46bb-b8c3-82cc2083864a admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.197794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95650541-cfa6-46bb-b8c3-82cc2083864a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.201727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95650541-cfa6-46bb-b8c3-82cc2083864a admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.203110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 787/1561] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:20.204505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f7f07-0672-4d42-861c-efe1025e34b4 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.204827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f7f07-0672-4d42-861c-efe1025e34b4 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.205086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f7f07-0672-4d42-861c-efe1025e34b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.228556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-3a0f7f07-0672-4d42-861c-efe1025e34b4 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:20.229833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3a0f7f07-0672-4d42-861c-efe1025e34b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:20.240035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 788/1562] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:20.241231 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f7f07-0672-4d42-861c-efe1025e34b4 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.254294 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f7f07-0672-4d42-861c-efe1025e34b4 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.262410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fb659-6f3f-4a1b-817d-d10395e3699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.263299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb659-6f3f-4a1b-817d-d10395e3699e admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.264417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb659-6f3f-4a1b-817d-d10395e3699e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.264417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb659-6f3f-4a1b-817d-d10395e3699e admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.265677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fb659-6f3f-4a1b-817d-d10395e3699e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:57:20.266157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fb659-6f3f-4a1b-817d-d10395e3699e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.267988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fb659-6f3f-4a1b-817d-d10395e3699e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.283568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 789/1563] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:57:20.285498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9c462-a82f-49d3-9826-b859e4d0a341 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.295186 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9c462-a82f-49d3-9826-b859e4d0a341 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.295186 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9c462-a82f-49d3-9826-b859e4d0a341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.316391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-50f9c462-a82f-49d3-9826-b859e4d0a341 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:20.317946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-50f9c462-a82f-49d3-9826-b859e4d0a341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:20.332920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 790/1564] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:20.336071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 775/1565] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:20 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:20.336303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba52d1-8957-4f3f-b544-3f150becfe34 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.336468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95650541-cfa6-46bb-b8c3-82cc2083864a admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.336681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba52d1-8957-4f3f-b544-3f150becfe34 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.336840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba52d1-8957-4f3f-b544-3f150becfe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.354456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95650541-cfa6-46bb-b8c3-82cc2083864a admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.363118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d52ca-9929-45e5-97d8-8d9d5cff6289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.364068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d52ca-9929-45e5-97d8-8d9d5cff6289 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.364444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d52ca-9929-45e5-97d8-8d9d5cff6289 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.364799 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d52ca-9929-45e5-97d8-8d9d5cff6289 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.365741 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d52ca-9929-45e5-97d8-8d9d5cff6289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.365997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-38ba52d1-8957-4f3f-b544-3f150becfe34 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:20.367391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-38ba52d1-8957-4f3f-b544-3f150becfe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:20.367644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d52ca-9929-45e5-97d8-8d9d5cff6289 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.381590 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 791/1566] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:20.384046 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27aca1-63c3-4a45-824e-abd47fdcb24f None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.384661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27aca1-63c3-4a45-824e-abd47fdcb24f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.389874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27aca1-63c3-4a45-824e-abd47fdcb24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.390128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 776/1567] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:20.390128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d52ca-9929-45e5-97d8-8d9d5cff6289 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.406948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d52ca-9929-45e5-97d8-8d9d5cff6289 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.412949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e25ed-df23-4f24-8af8-628450d8bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.414750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e25ed-df23-4f24-8af8-628450d8bd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.415149 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e25ed-df23-4f24-8af8-628450d8bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.415567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e25ed-df23-4f24-8af8-628450d8bd14 admin admin] PATH_INFO: `/v3/projects/dd226b6f240f4eb88ef3d74e62660f95/users/6beabb7911684f308a834972f4d824d3/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.420392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-5e27aca1-63c3-4a45-824e-abd47fdcb24f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:20.422268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5e27aca1-63c3-4a45-824e-abd47fdcb24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:20.432089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 792/1568] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:20.434443 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205f85c-44c5-41af-92e8-ac6c2e1dea41 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.434939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205f85c-44c5-41af-92e8-ac6c2e1dea41 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.435417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205f85c-44c5-41af-92e8-ac6c2e1dea41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.444148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e25ed-df23-4f24-8af8-628450d8bd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd226b6f240f4eb88ef3d74e62660f95, user_id=6beabb7911684f308a834972f4d824d3, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.447443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e25ed-df23-4f24-8af8-628450d8bd14 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.458327 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-4205f85c-44c5-41af-92e8-ac6c2e1dea41 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:20.459572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4205f85c-44c5-41af-92e8-ac6c2e1dea41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:20.468442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 793/1569] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:20.469334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205f85c-44c5-41af-92e8-ac6c2e1dea41 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.479573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205f85c-44c5-41af-92e8-ac6c2e1dea41 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.485093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b2b12-b1b6-45d5-bb22-4fbb4171ff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.485783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b2b12-b1b6-45d5-bb22-4fbb4171ff6c admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.486069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b2b12-b1b6-45d5-bb22-4fbb4171ff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.486347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b2b12-b1b6-45d5-bb22-4fbb4171ff6c admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.487088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b2b12-b1b6-45d5-bb22-4fbb4171ff6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.489096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b2b12-b1b6-45d5-bb22-4fbb4171ff6c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.588455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 777/1570] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:20 2022] PUT /identity/v3/projects/dd226b6f240f4eb88ef3d74e62660f95/users/6beabb7911684f308a834972f4d824d3/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:20.591004 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e25ed-df23-4f24-8af8-628450d8bd14 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.666180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 794/1571] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:20 2022] POST /identity/v3/projects => generated 363 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:20.671240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b2b12-b1b6-45d5-bb22-4fbb4171ff6c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.689482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e25ed-df23-4f24-8af8-628450d8bd14 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.775185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:20.780865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b2b12-b1b6-45d5-bb22-4fbb4171ff6c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.786240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf98be-2b6d-4696-9dcb-2d89215dbf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.787281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf98be-2b6d-4696-9dcb-2d89215dbf85 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.787745 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf98be-2b6d-4696-9dcb-2d89215dbf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.788220 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf98be-2b6d-4696-9dcb-2d89215dbf85 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.789640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf98be-2b6d-4696-9dcb-2d89215dbf85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:57:20.790155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf98be-2b6d-4696-9dcb-2d89215dbf85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.792950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3e9ae-b494-4a40-ae75-a1092a0e8ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.793753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf98be-2b6d-4696-9dcb-2d89215dbf85 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.794212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3e9ae-b494-4a40-ae75-a1092a0e8ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.794689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3e9ae-b494-4a40-ae75-a1092a0e8ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.795152 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3e9ae-b494-4a40-ae75-a1092a0e8ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.796448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3e9ae-b494-4a40-ae75-a1092a0e8ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.799501 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3e9ae-b494-4a40-ae75-a1092a0e8ae5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.827815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 795/1572] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:57:20.827815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf98be-2b6d-4696-9dcb-2d89215dbf85 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.828301 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 778/1573] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:20.828301 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3e9ae-b494-4a40-ae75-a1092a0e8ae5 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.833727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf98be-2b6d-4696-9dcb-2d89215dbf85 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.839022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3e9ae-b494-4a40-ae75-a1092a0e8ae5 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.840222 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662fa7a-c9a4-4b86-8486-53fed4adaa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.841027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662fa7a-c9a4-4b86-8486-53fed4adaa0a admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.841393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662fa7a-c9a4-4b86-8486-53fed4adaa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.841755 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662fa7a-c9a4-4b86-8486-53fed4adaa0a admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.842511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662fa7a-c9a4-4b86-8486-53fed4adaa0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:57:20.842863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662fa7a-c9a4-4b86-8486-53fed4adaa0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.845929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662fa7a-c9a4-4b86-8486-53fed4adaa0a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.847067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd087e-2fc5-4500-ba0e-aadaa0f3b70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.849574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd087e-2fc5-4500-ba0e-aadaa0f3b70b admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.850952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd087e-2fc5-4500-ba0e-aadaa0f3b70b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.851517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd087e-2fc5-4500-ba0e-aadaa0f3b70b admin admin] PATH_INFO: `/v3/projects/d3d54f97f6144109a41c7267dacd77d5/users/20854021a4654028a3acea33e603fe76/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.868984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 796/1574] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:57:20.871114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662fa7a-c9a4-4b86-8486-53fed4adaa0a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.879876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:20.883838 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd087e-2fc5-4500-ba0e-aadaa0f3b70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d54f97f6144109a41c7267dacd77d5, user_id=20854021a4654028a3acea33e603fe76, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.889179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662fa7a-c9a4-4b86-8486-53fed4adaa0a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.889915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd087e-2fc5-4500-ba0e-aadaa0f3b70b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.896521 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede35d3b-287e-4452-aec6-3cd13ff545d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.897296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede35d3b-287e-4452-aec6-3cd13ff545d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.897623 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede35d3b-287e-4452-aec6-3cd13ff545d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.897942 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede35d3b-287e-4452-aec6-3cd13ff545d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.898743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede35d3b-287e-4452-aec6-3cd13ff545d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:57:20.899126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede35d3b-287e-4452-aec6-3cd13ff545d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.901096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede35d3b-287e-4452-aec6-3cd13ff545d7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.915279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 797/1575] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:57:20.916179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede35d3b-287e-4452-aec6-3cd13ff545d7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:20.928049 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede35d3b-287e-4452-aec6-3cd13ff545d7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:20.934437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe8f3d-78c4-42e3-a8e3-7c30cf5d5acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:20.935204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe8f3d-78c4-42e3-a8e3-7c30cf5d5acd admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.935592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe8f3d-78c4-42e3-a8e3-7c30cf5d5acd admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.935915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe8f3d-78c4-42e3-a8e3-7c30cf5d5acd admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.936768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe8f3d-78c4-42e3-a8e3-7c30cf5d5acd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:57:20.937125 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe8f3d-78c4-42e3-a8e3-7c30cf5d5acd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:20.938857 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe8f3d-78c4-42e3-a8e3-7c30cf5d5acd admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:20.953806 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 798/1576] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:57:20.955269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4635e-5f7a-4b79-9e78-22e38fe4ca79 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:20.955554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4635e-5f7a-4b79-9e78-22e38fe4ca79 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:20.955829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4635e-5f7a-4b79-9e78-22e38fe4ca79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:20.986268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a7f4635e-5f7a-4b79-9e78-22e38fe4ca79 None None] MFA Rules not processed for user `6beabb7911684f308a834972f4d824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:20.987538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a7f4635e-5f7a-4b79-9e78-22e38fe4ca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:21.023535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 779/1577] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:20 2022] PUT /identity/v3/projects/d3d54f97f6144109a41c7267dacd77d5/users/20854021a4654028a3acea33e603fe76/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:21.025300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd087e-2fc5-4500-ba0e-aadaa0f3b70b admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:21.101075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 799/1578] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:21.101075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4635e-5f7a-4b79-9e78-22e38fe4ca79 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:21.112268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd087e-2fc5-4500-ba0e-aadaa0f3b70b admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:21.118629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57908fbe-7bad-4a79-b9ff-9bc9df20a1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:21.118933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4635e-5f7a-4b79-9e78-22e38fe4ca79 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:21.119682 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57908fbe-7bad-4a79-b9ff-9bc9df20a1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:21.120110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57908fbe-7bad-4a79-b9ff-9bc9df20a1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:21.120110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57908fbe-7bad-4a79-b9ff-9bc9df20a1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:21.122312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57908fbe-7bad-4a79-b9ff-9bc9df20a1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:21.124920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57908fbe-7bad-4a79-b9ff-9bc9df20a1a6 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:21.128312 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754d402-ffcd-4854-9c53-12db2bf8e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:21.129432 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754d402-ffcd-4854-9c53-12db2bf8e6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:21.129820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754d402-ffcd-4854-9c53-12db2bf8e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:21.130198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754d402-ffcd-4854-9c53-12db2bf8e6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:21.131367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754d402-ffcd-4854-9c53-12db2bf8e6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:21.134175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754d402-ffcd-4854-9c53-12db2bf8e6d2 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:21.154565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 800/1579] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:21.159759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754d402-ffcd-4854-9c53-12db2bf8e6d2 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:21.174364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754d402-ffcd-4854-9c53-12db2bf8e6d2 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:21.182572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed955c6c-42b3-4cfb-a771-093626d917fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:21.184404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955c6c-42b3-4cfb-a771-093626d917fb admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:21.185000 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955c6c-42b3-4cfb-a771-093626d917fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:21.185863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955c6c-42b3-4cfb-a771-093626d917fb admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:21.187129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed955c6c-42b3-4cfb-a771-093626d917fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:21.189740 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed955c6c-42b3-4cfb-a771-093626d917fb admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:21.317482 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 801/1580] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:21 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:21.318210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed955c6c-42b3-4cfb-a771-093626d917fb admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:21.349203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 780/1581] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:21 2022] POST /identity/v3/users => generated 282 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:21.351055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57908fbe-7bad-4a79-b9ff-9bc9df20a1a6 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:21.364830 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57908fbe-7bad-4a79-b9ff-9bc9df20a1a6 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:21.416175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed955c6c-42b3-4cfb-a771-093626d917fb admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:21.425651 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fa739-86ad-4c97-a05e-7d38e5a67a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:21.426707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fa739-86ad-4c97-a05e-7d38e5a67a19 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:21.427161 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fa739-86ad-4c97-a05e-7d38e5a67a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:21.427615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fa739-86ad-4c97-a05e-7d38e5a67a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:21.428659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fa739-86ad-4c97-a05e-7d38e5a67a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:21.432062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fa739-86ad-4c97-a05e-7d38e5a67a19 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:21.457890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8b6a5-a0e5-4e65-a6bf-09a96a11ed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:21.458602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8b6a5-a0e5-4e65-a6bf-09a96a11ed90 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:21.458885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8b6a5-a0e5-4e65-a6bf-09a96a11ed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:21.459161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8b6a5-a0e5-4e65-a6bf-09a96a11ed90 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:21.459930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8b6a5-a0e5-4e65-a6bf-09a96a11ed90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:21.462149 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8b6a5-a0e5-4e65-a6bf-09a96a11ed90 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:21.600795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 802/1582] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:21 2022] POST /identity/v3/projects => generated 383 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:21.601878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fa739-86ad-4c97-a05e-7d38e5a67a19 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:21.616579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 781/1583] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:21 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:21.618851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179b4e-cba3-4c46-a07e-91af75966bba None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:21.619408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179b4e-cba3-4c46-a07e-91af75966bba None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:21.619787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179b4e-cba3-4c46-a07e-91af75966bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:21.633331 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:21.655952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-6c179b4e-cba3-4c46-a07e-91af75966bba None None] MFA Rules not processed for user `20854021a4654028a3acea33e603fe76`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:21.657267 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6c179b4e-cba3-4c46-a07e-91af75966bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:21.696434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fa739-86ad-4c97-a05e-7d38e5a67a19 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:21.708867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:21.757501 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 782/1584] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:21.758777 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179b4e-cba3-4c46-a07e-91af75966bba None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:21.775147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d7283-7925-4666-8abe-4463a64b07cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:21.778670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d7283-7925-4666-8abe-4463a64b07cc admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:21.778670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d7283-7925-4666-8abe-4463a64b07cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:21.778670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d7283-7925-4666-8abe-4463a64b07cc admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:21.778670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d7283-7925-4666-8abe-4463a64b07cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:21.780952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d7283-7925-4666-8abe-4463a64b07cc admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:21.837061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179b4e-cba3-4c46-a07e-91af75966bba None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:21.844113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48177cd4-c196-4524-baa2-b05e4d79a3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:21.844893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48177cd4-c196-4524-baa2-b05e4d79a3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:21.845217 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48177cd4-c196-4524-baa2-b05e4d79a3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:21.845538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48177cd4-c196-4524-baa2-b05e4d79a3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:21.846342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48177cd4-c196-4524-baa2-b05e4d79a3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:21.848548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48177cd4-c196-4524-baa2-b05e4d79a3e5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:21.922718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 803/1585] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:21 2022] POST /identity/v3/projects => generated 393 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:21.923476 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d7283-7925-4666-8abe-4463a64b07cc admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:21.980726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 783/1586] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:21 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:21.982852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48177cd4-c196-4524-baa2-b05e4d79a3e5 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:22.001517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d7283-7925-4666-8abe-4463a64b07cc admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:22.071792 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:22.083264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e0d27-a445-4e21-ba22-c10e707ffe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:22.083804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48177cd4-c196-4524-baa2-b05e4d79a3e5 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:22.084831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e0d27-a445-4e21-ba22-c10e707ffe11 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:22.085237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e0d27-a445-4e21-ba22-c10e707ffe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:22.085642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e0d27-a445-4e21-ba22-c10e707ffe11 admin admin] PATH_INFO: `/v3/projects/61b7362c35c349308550f613cf8fcc39/users/2b14df3870114a00bd98291eb17d64ce/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:22.088831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae3109-eccb-49f1-bedc-f314363deb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:22.090388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae3109-eccb-49f1-bedc-f314363deb50 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:22.090645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae3109-eccb-49f1-bedc-f314363deb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:22.091025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae3109-eccb-49f1-bedc-f314363deb50 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:22.091743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae3109-eccb-49f1-bedc-f314363deb50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:22.093855 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae3109-eccb-49f1-bedc-f314363deb50 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:22.114179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e0d27-a445-4e21-ba22-c10e707ffe11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b7362c35c349308550f613cf8fcc39, user_id=2b14df3870114a00bd98291eb17d64ce, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:22.116152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: WARNING py.warnings [None req-1d7e0d27-a445-4e21-ba22-c10e707ffe11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:57:22.116152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: warnings.warn(msg) Jul 20 17:57:22.116152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: Jul 20 17:57:22.121243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e0d27-a445-4e21-ba22-c10e707ffe11 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:22.265562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 804/1587] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:21 2022] PUT /identity/v3/projects/61b7362c35c349308550f613cf8fcc39/users/2b14df3870114a00bd98291eb17d64ce/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:22.266506 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e0d27-a445-4e21-ba22-c10e707ffe11 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:22.289395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 784/1588] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:21 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:22.290840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae3109-eccb-49f1-bedc-f314363deb50 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:22.304661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae3109-eccb-49f1-bedc-f314363deb50 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:22.356385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e0d27-a445-4e21-ba22-c10e707ffe11 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:22.363931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cf26a-fc95-4d88-bdd0-e8c7b61391c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:22.365056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cf26a-fc95-4d88-bdd0-e8c7b61391c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:22.365510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cf26a-fc95-4d88-bdd0-e8c7b61391c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:22.365950 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cf26a-fc95-4d88-bdd0-e8c7b61391c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:22.366839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cf26a-fc95-4d88-bdd0-e8c7b61391c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:22.369804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cf26a-fc95-4d88-bdd0-e8c7b61391c6 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:22.373963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:22.386519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 805/1589] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:22.387889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cf26a-fc95-4d88-bdd0-e8c7b61391c6 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:22.403352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cf26a-fc95-4d88-bdd0-e8c7b61391c6 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:22.411155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee7ddd-1428-4e61-a1d4-edaf9e9ad3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:22.411581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0dc63-541a-4e7c-9bf0-e7a21b5439ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:22.412316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0dc63-541a-4e7c-9bf0-e7a21b5439ca admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:22.412467 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee7ddd-1428-4e61-a1d4-edaf9e9ad3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:22.412821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0dc63-541a-4e7c-9bf0-e7a21b5439ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:22.413135 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee7ddd-1428-4e61-a1d4-edaf9e9ad3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:22.413352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0dc63-541a-4e7c-9bf0-e7a21b5439ca admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:22.413663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee7ddd-1428-4e61-a1d4-edaf9e9ad3c7 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:22.414564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0dc63-541a-4e7c-9bf0-e7a21b5439ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:22.415527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee7ddd-1428-4e61-a1d4-edaf9e9ad3c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:22.418835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0dc63-541a-4e7c-9bf0-e7a21b5439ca admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:22.420602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee7ddd-1428-4e61-a1d4-edaf9e9ad3c7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:22.601433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 806/1590] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:22 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:22.602929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee7ddd-1428-4e61-a1d4-edaf9e9ad3c7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:22.607507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 785/1591] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:22 2022] POST /identity/v3/users => generated 292 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:22.607507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0dc63-541a-4e7c-9bf0-e7a21b5439ca admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:22.618271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee7ddd-1428-4e61-a1d4-edaf9e9ad3c7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:22.623369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0dc63-541a-4e7c-9bf0-e7a21b5439ca admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:22.625187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d5d96-5761-444e-96af-1f60128600f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:22.626134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5d96-5761-444e-96af-1f60128600f1 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:22.626530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5d96-5761-444e-96af-1f60128600f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:22.626929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d5d96-5761-444e-96af-1f60128600f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:22.628031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d5d96-5761-444e-96af-1f60128600f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:22.628807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34dc2e-9449-4710-916e-7e5f3664fe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:22.629518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34dc2e-9449-4710-916e-7e5f3664fe40 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:22.629968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34dc2e-9449-4710-916e-7e5f3664fe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:22.630254 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34dc2e-9449-4710-916e-7e5f3664fe40 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:22.630979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34dc2e-9449-4710-916e-7e5f3664fe40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:22.631161 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d5d96-5761-444e-96af-1f60128600f1 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:22.633060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34dc2e-9449-4710-916e-7e5f3664fe40 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:22.771369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 786/1592] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:22 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:22.772869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34dc2e-9449-4710-916e-7e5f3664fe40 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:22.785736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34dc2e-9449-4710-916e-7e5f3664fe40 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:22.790844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c0c79-0d76-41b6-9584-edc43273b6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:22.791635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c0c79-0d76-41b6-9584-edc43273b6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:22.792770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c0c79-0d76-41b6-9584-edc43273b6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:22.793107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c0c79-0d76-41b6-9584-edc43273b6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:22.793996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c0c79-0d76-41b6-9584-edc43273b6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:22.796063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c0c79-0d76-41b6-9584-edc43273b6b4 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:22.816383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 807/1593] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:22 2022] POST /identity/v3/projects => generated 365 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:22.820096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a6b24-3004-470e-9bda-ba81f9d71dd0 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:22.821434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a6b24-3004-470e-9bda-ba81f9d71dd0 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:22.821924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a6b24-3004-470e-9bda-ba81f9d71dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:22.852169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-345a6b24-3004-470e-9bda-ba81f9d71dd0 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:22.854400 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-345a6b24-3004-470e-9bda-ba81f9d71dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:22.935264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 787/1594] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:22 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:22.937504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c0c79-0d76-41b6-9584-edc43273b6b4 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:22.952695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c0c79-0d76-41b6-9584-edc43273b6b4 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:22.968934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 808/1595] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:22.968934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a6b24-3004-470e-9bda-ba81f9d71dd0 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:22.984248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a6b24-3004-470e-9bda-ba81f9d71dd0 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:22.990836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73067d4-3ff1-43b2-a167-bab9c4b215ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:22.991551 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73067d4-3ff1-43b2-a167-bab9c4b215ea admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:22.991830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73067d4-3ff1-43b2-a167-bab9c4b215ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:22.992121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73067d4-3ff1-43b2-a167-bab9c4b215ea admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:22.993329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73067d4-3ff1-43b2-a167-bab9c4b215ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:22.997252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73067d4-3ff1-43b2-a167-bab9c4b215ea admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.012622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 809/1596] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:23.012622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73067d4-3ff1-43b2-a167-bab9c4b215ea admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.020221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73067d4-3ff1-43b2-a167-bab9c4b215ea admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.025996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67ceee-f5a8-4ae2-a412-dcdca34803a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.027227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ceee-f5a8-4ae2-a412-dcdca34803a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.027561 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ceee-f5a8-4ae2-a412-dcdca34803a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.027893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ceee-f5a8-4ae2-a412-dcdca34803a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.028694 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67ceee-f5a8-4ae2-a412-dcdca34803a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.030422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67ceee-f5a8-4ae2-a412-dcdca34803a5 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.038703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4858d83-9d6a-4096-8fce-d3f1b0881a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.039401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4858d83-9d6a-4096-8fce-d3f1b0881a4f admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.039687 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4858d83-9d6a-4096-8fce-d3f1b0881a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.039967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4858d83-9d6a-4096-8fce-d3f1b0881a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.040761 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4858d83-9d6a-4096-8fce-d3f1b0881a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.046134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 810/1597] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:23.046360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4858d83-9d6a-4096-8fce-d3f1b0881a4f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.046487 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67ceee-f5a8-4ae2-a412-dcdca34803a5 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.054798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67ceee-f5a8-4ae2-a412-dcdca34803a5 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.056372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 788/1598] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:23.057020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4858d83-9d6a-4096-8fce-d3f1b0881a4f admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.061082 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69c1c5-a1ef-4772-9c5d-10ca2ce6adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.061879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69c1c5-a1ef-4772-9c5d-10ca2ce6adff admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.062171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69c1c5-a1ef-4772-9c5d-10ca2ce6adff admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.062468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69c1c5-a1ef-4772-9c5d-10ca2ce6adff admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.063203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69c1c5-a1ef-4772-9c5d-10ca2ce6adff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.065025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69c1c5-a1ef-4772-9c5d-10ca2ce6adff admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.071932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4858d83-9d6a-4096-8fce-d3f1b0881a4f admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.079060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b7378-7a8e-423d-b6c5-93506cafba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.080115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7378-7a8e-423d-b6c5-93506cafba35 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.080679 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 811/1599] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:23.080796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7378-7a8e-423d-b6c5-93506cafba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.081133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b7378-7a8e-423d-b6c5-93506cafba35 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.081965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69c1c5-a1ef-4772-9c5d-10ca2ce6adff admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.082372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b7378-7a8e-423d-b6c5-93506cafba35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.084630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b7378-7a8e-423d-b6c5-93506cafba35 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.090854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:23.095068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69c1c5-a1ef-4772-9c5d-10ca2ce6adff admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.096989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 789/1600] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:23.100282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b7378-7a8e-423d-b6c5-93506cafba35 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.102573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ff8a8-51dd-48cd-876d-ee8363e46501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.103579 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ff8a8-51dd-48cd-876d-ee8363e46501 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.103967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ff8a8-51dd-48cd-876d-ee8363e46501 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.104353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ff8a8-51dd-48cd-876d-ee8363e46501 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.106084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ff8a8-51dd-48cd-876d-ee8363e46501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.108230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ff8a8-51dd-48cd-876d-ee8363e46501 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.108894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b7378-7a8e-423d-b6c5-93506cafba35 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.117492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f6e2d-593a-4434-b21a-d2d3e277c77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.118254 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f6e2d-593a-4434-b21a-d2d3e277c77b admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.118605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f6e2d-593a-4434-b21a-d2d3e277c77b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.119013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f6e2d-593a-4434-b21a-d2d3e277c77b admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.120736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f6e2d-593a-4434-b21a-d2d3e277c77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.122691 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f6e2d-593a-4434-b21a-d2d3e277c77b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.140049 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 790/1601] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:23.140049 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f6e2d-593a-4434-b21a-d2d3e277c77b admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.198282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f6e2d-593a-4434-b21a-d2d3e277c77b admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.202699 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333b60-7591-4b57-8f40-f0cdbe6fb71d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.203363 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333b60-7591-4b57-8f40-f0cdbe6fb71d service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.203643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333b60-7591-4b57-8f40-f0cdbe6fb71d service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.203914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333b60-7591-4b57-8f40-f0cdbe6fb71d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.216834 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333b60-7591-4b57-8f40-f0cdbe6fb71d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.219422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333b60-7591-4b57-8f40-f0cdbe6fb71d service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.224314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 812/1602] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:23 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:23.225583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ff8a8-51dd-48cd-876d-ee8363e46501 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.238223 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 791/1603] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:23.239427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333b60-7591-4b57-8f40-f0cdbe6fb71d service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.246654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ff8a8-51dd-48cd-876d-ee8363e46501 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.255340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab2081-76b8-46b6-8579-eef6c08f4e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.256842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333b60-7591-4b57-8f40-f0cdbe6fb71d service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.256998 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab2081-76b8-46b6-8579-eef6c08f4e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.257299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab2081-76b8-46b6-8579-eef6c08f4e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.257756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab2081-76b8-46b6-8579-eef6c08f4e99 admin admin] PATH_INFO: `/v3/projects/d0e903cb32f846bea5e2f1d520c902a1/users/e115aae2b417449381b67dad00bca6d5/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.266913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c6bf6-0892-4562-b8e0-7116a7427655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.268024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c6bf6-0892-4562-b8e0-7116a7427655 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.269021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c6bf6-0892-4562-b8e0-7116a7427655 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.269485 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c6bf6-0892-4562-b8e0-7116a7427655 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.271031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c6bf6-0892-4562-b8e0-7116a7427655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.274003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c6bf6-0892-4562-b8e0-7116a7427655 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.286748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab2081-76b8-46b6-8579-eef6c08f4e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e903cb32f846bea5e2f1d520c902a1, user_id=e115aae2b417449381b67dad00bca6d5, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.289687 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 792/1604] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:23.289888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab2081-76b8-46b6-8579-eef6c08f4e99 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.291146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c6bf6-0892-4562-b8e0-7116a7427655 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.301264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:23.306657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c6bf6-0892-4562-b8e0-7116a7427655 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.312844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e21ba-9fd1-4822-850c-f5bd141f1aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.316557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e21ba-9fd1-4822-850c-f5bd141f1aee admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.316557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e21ba-9fd1-4822-850c-f5bd141f1aee admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.316557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e21ba-9fd1-4822-850c-f5bd141f1aee admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.316557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e21ba-9fd1-4822-850c-f5bd141f1aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.318067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e21ba-9fd1-4822-850c-f5bd141f1aee admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.334673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 793/1605] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:23.334673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e21ba-9fd1-4822-850c-f5bd141f1aee admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.343398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e21ba-9fd1-4822-850c-f5bd141f1aee admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.348364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592800b-41d4-4efc-a20f-5d2693f02c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.349150 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592800b-41d4-4efc-a20f-5d2693f02c92 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.349434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592800b-41d4-4efc-a20f-5d2693f02c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.349714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592800b-41d4-4efc-a20f-5d2693f02c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.350648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592800b-41d4-4efc-a20f-5d2693f02c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.352185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592800b-41d4-4efc-a20f-5d2693f02c92 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.366033 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 794/1606] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:23.367491 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592800b-41d4-4efc-a20f-5d2693f02c92 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.381395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592800b-41d4-4efc-a20f-5d2693f02c92 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.387082 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31c90c-d298-4a1a-a7ce-7750ed15db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.387872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31c90c-d298-4a1a-a7ce-7750ed15db6a admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.388197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31c90c-d298-4a1a-a7ce-7750ed15db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.388578 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31c90c-d298-4a1a-a7ce-7750ed15db6a admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.390840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31c90c-d298-4a1a-a7ce-7750ed15db6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.394415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31c90c-d298-4a1a-a7ce-7750ed15db6a admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.414097 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 795/1607] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:23.419887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31c90c-d298-4a1a-a7ce-7750ed15db6a admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.425381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 813/1608] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:23 2022] PUT /identity/v3/projects/d0e903cb32f846bea5e2f1d520c902a1/users/e115aae2b417449381b67dad00bca6d5/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:23.427569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab2081-76b8-46b6-8579-eef6c08f4e99 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.444709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31c90c-d298-4a1a-a7ce-7750ed15db6a admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.517652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab2081-76b8-46b6-8579-eef6c08f4e99 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.523362 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b40e59-58f1-4347-82f8-bb830b9fe0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.523620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b3442-6374-4c36-80cc-4fb797fd21de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.524245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b3442-6374-4c36-80cc-4fb797fd21de admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.524374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b40e59-58f1-4347-82f8-bb830b9fe0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.524591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b40e59-58f1-4347-82f8-bb830b9fe0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.524695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b3442-6374-4c36-80cc-4fb797fd21de admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.524870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b40e59-58f1-4347-82f8-bb830b9fe0e2 admin admin] PATH_INFO: `/v3/projects/bd3d8da529e54573a2ebd899472e8478/users/10b683e2bfe442829a24b84172ba93ab/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.524992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b3442-6374-4c36-80cc-4fb797fd21de admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.525801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b3442-6374-4c36-80cc-4fb797fd21de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.528017 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b3442-6374-4c36-80cc-4fb797fd21de admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.545924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 814/1609] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:23.545924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b3442-6374-4c36-80cc-4fb797fd21de admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.546357 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b40e59-58f1-4347-82f8-bb830b9fe0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3d8da529e54573a2ebd899472e8478, user_id=10b683e2bfe442829a24b84172ba93ab, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.549329 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b40e59-58f1-4347-82f8-bb830b9fe0e2 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.554121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b3442-6374-4c36-80cc-4fb797fd21de admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.560052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25c1a8-8062-4afc-9984-9343651b7ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.561016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25c1a8-8062-4afc-9984-9343651b7ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.561276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25c1a8-8062-4afc-9984-9343651b7ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.561547 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25c1a8-8062-4afc-9984-9343651b7ca8 admin admin] PATH_INFO: `/v3/projects/42a3ef9ead804c5483de2cc4ac8855b3/users/fed263f071864582ba96d79f75fbfb36/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.579932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25c1a8-8062-4afc-9984-9343651b7ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a3ef9ead804c5483de2cc4ac8855b3, user_id=fed263f071864582ba96d79f75fbfb36, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.582750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25c1a8-8062-4afc-9984-9343651b7ca8 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.645895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 796/1610] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:23 2022] PUT /identity/v3/projects/bd3d8da529e54573a2ebd899472e8478/users/10b683e2bfe442829a24b84172ba93ab/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:23.645895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b40e59-58f1-4347-82f8-bb830b9fe0e2 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.689398 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 815/1611] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:23 2022] PUT /identity/v3/projects/42a3ef9ead804c5483de2cc4ac8855b3/users/fed263f071864582ba96d79f75fbfb36/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:23.691579 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25c1a8-8062-4afc-9984-9343651b7ca8 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.733768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b40e59-58f1-4347-82f8-bb830b9fe0e2 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.778791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25c1a8-8062-4afc-9984-9343651b7ca8 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:23.784546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f821569-1bca-4aa4-adc5-11af60851f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.785471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f821569-1bca-4aa4-adc5-11af60851f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.785757 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f821569-1bca-4aa4-adc5-11af60851f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.786032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f821569-1bca-4aa4-adc5-11af60851f45 admin admin] PATH_INFO: `/v3/projects/a04430115d5d4fb784d6b53543d48f9e/users/5250c5699e4844359e205dc17cbb14a3/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.802709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e71a3-bea0-40af-9f24-652b32318717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:23.803623 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e71a3-bea0-40af-9f24-652b32318717 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.803899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e71a3-bea0-40af-9f24-652b32318717 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.804172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e71a3-bea0-40af-9f24-652b32318717 admin admin] PATH_INFO: `/v3/projects/4f09278bfb3248eab00d7061b248f6c3/users/f1d5e5f7ad994b8481b8c5e885db1739/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.808095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:23.815585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f821569-1bca-4aa4-adc5-11af60851f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04430115d5d4fb784d6b53543d48f9e, user_id=5250c5699e4844359e205dc17cbb14a3, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.820240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f821569-1bca-4aa4-adc5-11af60851f45 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.823070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e71a3-bea0-40af-9f24-652b32318717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f09278bfb3248eab00d7061b248f6c3, user_id=f1d5e5f7ad994b8481b8c5e885db1739, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:23.827244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e71a3-bea0-40af-9f24-652b32318717 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:23.932800 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 816/1612] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:23 2022] PUT /identity/v3/projects/a04430115d5d4fb784d6b53543d48f9e/users/5250c5699e4844359e205dc17cbb14a3/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:23.934252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f821569-1bca-4aa4-adc5-11af60851f45 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:23.940007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 797/1613] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:23 2022] PUT /identity/v3/projects/4f09278bfb3248eab00d7061b248f6c3/users/f1d5e5f7ad994b8481b8c5e885db1739/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:23.940867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3fdc0-8271-4cfa-8013-db4546e1c5af None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:23.941462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3fdc0-8271-4cfa-8013-db4546e1c5af None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:23.941959 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3fdc0-8271-4cfa-8013-db4546e1c5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:23.992108 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:23.996945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-74b3fdc0-8271-4cfa-8013-db4546e1c5af None None] MFA Rules not processed for user `e115aae2b417449381b67dad00bca6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:23.998251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-74b3fdc0-8271-4cfa-8013-db4546e1c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:24.053978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f821569-1bca-4aa4-adc5-11af60851f45 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:24.061116 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6e07-aed4-48f1-8917-36f6256980a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:24.062330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6e07-aed4-48f1-8917-36f6256980a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.062789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6e07-aed4-48f1-8917-36f6256980a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.063036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6e07-aed4-48f1-8917-36f6256980a7 admin admin] PATH_INFO: `/v3/projects/23d7e15987bd4fb7a54a43002b44c1fc/users/de47dd54e8fc48ca9411ce4c7906b80b/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.088907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de6e07-aed4-48f1-8917-36f6256980a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d7e15987bd4fb7a54a43002b44c1fc, user_id=de47dd54e8fc48ca9411ce4c7906b80b, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:24.089131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 798/1614] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:24.089288 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de6e07-aed4-48f1-8917-36f6256980a7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:24.089473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3fdc0-8271-4cfa-8013-db4546e1c5af None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:24.106851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3fdc0-8271-4cfa-8013-db4546e1c5af None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:24.115171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e0c6f-3b74-4dce-95bf-5f889a5d545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:24.116810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0c6f-3b74-4dce-95bf-5f889a5d545b admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.117319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0c6f-3b74-4dce-95bf-5f889a5d545b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.117808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0c6f-3b74-4dce-95bf-5f889a5d545b admin admin] PATH_INFO: `/v3/projects/fd2e1258583d4f2485dcb8a246bc0a16/users/fdf6b34fae16405ab423e60b0e17712c/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.146501 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e0c6f-3b74-4dce-95bf-5f889a5d545b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2e1258583d4f2485dcb8a246bc0a16, user_id=fdf6b34fae16405ab423e60b0e17712c, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:24.149245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e0c6f-3b74-4dce-95bf-5f889a5d545b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:24.195211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 817/1615] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:23 2022] PUT /identity/v3/projects/23d7e15987bd4fb7a54a43002b44c1fc/users/de47dd54e8fc48ca9411ce4c7906b80b/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:24.196571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6e07-aed4-48f1-8917-36f6256980a7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:24.278417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6e07-aed4-48f1-8917-36f6256980a7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:24.283364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e731082-b4b3-4fb1-aeac-fa2359f5bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:24.284088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e731082-b4b3-4fb1-aeac-fa2359f5bd4d admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.284365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e731082-b4b3-4fb1-aeac-fa2359f5bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.284677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e731082-b4b3-4fb1-aeac-fa2359f5bd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.286139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e731082-b4b3-4fb1-aeac-fa2359f5bd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:24.287224 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e731082-b4b3-4fb1-aeac-fa2359f5bd4d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:24.303966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 818/1616] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:24.303966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521ed9e-ad16-467a-ae1d-8749e2189a37 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.303966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521ed9e-ad16-467a-ae1d-8749e2189a37 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.303966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521ed9e-ad16-467a-ae1d-8749e2189a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.317510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 799/1617] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:24 2022] PUT /identity/v3/projects/fd2e1258583d4f2485dcb8a246bc0a16/users/fdf6b34fae16405ab423e60b0e17712c/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:24.324974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9e8eb-6274-4e69-bc1b-ca72ccdb3f81 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.324974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9e8eb-6274-4e69-bc1b-ca72ccdb3f81 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.324974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9e8eb-6274-4e69-bc1b-ca72ccdb3f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.325471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b521ed9e-ad16-467a-ae1d-8749e2189a37 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:24.325901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b521ed9e-ad16-467a-ae1d-8749e2189a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:24.341900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-4ba9e8eb-6274-4e69-bc1b-ca72ccdb3f81 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:24.343588 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4ba9e8eb-6274-4e69-bc1b-ca72ccdb3f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:24.412823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 819/1618] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:24.417892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fb27a-d890-4e21-965b-fffc25eb2bcd None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.417892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fb27a-d890-4e21-965b-fffc25eb2bcd None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.417892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fb27a-d890-4e21-965b-fffc25eb2bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.443181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 800/1619] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:24.443181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9e8eb-6274-4e69-bc1b-ca72ccdb3f81 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:24.465098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-4c3fb27a-d890-4e21-965b-fffc25eb2bcd None None] MFA Rules not processed for user `5250c5699e4844359e205dc17cbb14a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:24.467515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4c3fb27a-d890-4e21-965b-fffc25eb2bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:24.522978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:24.538708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9e8eb-6274-4e69-bc1b-ca72ccdb3f81 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:24.544383 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cc041-a1e0-45d3-8e5a-6b86c1644dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:24.545099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cc041-a1e0-45d3-8e5a-6b86c1644dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.545381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cc041-a1e0-45d3-8e5a-6b86c1644dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.545663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cc041-a1e0-45d3-8e5a-6b86c1644dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.550885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:24.588265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 820/1620] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:24.592102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947b1ec-31b6-4f35-aa56-28f9d4abdb27 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.592470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947b1ec-31b6-4f35-aa56-28f9d4abdb27 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.592891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947b1ec-31b6-4f35-aa56-28f9d4abdb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.622769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-1947b1ec-31b6-4f35-aa56-28f9d4abdb27 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:24.624899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-1947b1ec-31b6-4f35-aa56-28f9d4abdb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:24.637394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 821/1621] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:24.638659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947b1ec-31b6-4f35-aa56-28f9d4abdb27 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:24.648739 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82cc041-a1e0-45d3-8e5a-6b86c1644dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:24.650547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82cc041-a1e0-45d3-8e5a-6b86c1644dc5 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:24.654493 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947b1ec-31b6-4f35-aa56-28f9d4abdb27 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:24.659797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134526f1-89e8-4075-ad8a-ca1cb4c2536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:24.660759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134526f1-89e8-4075-ad8a-ca1cb4c2536b admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.661075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134526f1-89e8-4075-ad8a-ca1cb4c2536b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.661365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134526f1-89e8-4075-ad8a-ca1cb4c2536b admin admin] PATH_INFO: `/v3/projects/bd3d8da529e54573a2ebd899472e8478/users/10b683e2bfe442829a24b84172ba93ab/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.663124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 801/1622] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:24.663528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134526f1-89e8-4075-ad8a-ca1cb4c2536b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3d8da529e54573a2ebd899472e8478, user_id=10b683e2bfe442829a24b84172ba93ab, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:24.663800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cc041-a1e0-45d3-8e5a-6b86c1644dc5 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:24.666344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134526f1-89e8-4075-ad8a-ca1cb4c2536b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:24.678944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cc041-a1e0-45d3-8e5a-6b86c1644dc5 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:24.683856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 822/1623] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:24 2022] PUT /identity/v3/projects/bd3d8da529e54573a2ebd899472e8478/users/10b683e2bfe442829a24b84172ba93ab/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:24.688449 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134526f1-89e8-4075-ad8a-ca1cb4c2536b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:24.788514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145cc9d-bdca-4859-9cad-a8238a986dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:24.789125 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134526f1-89e8-4075-ad8a-ca1cb4c2536b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:24.789589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145cc9d-bdca-4859-9cad-a8238a986dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.790043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145cc9d-bdca-4859-9cad-a8238a986dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.790499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145cc9d-bdca-4859-9cad-a8238a986dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.792674 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145cc9d-bdca-4859-9cad-a8238a986dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:24.795971 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145cc9d-bdca-4859-9cad-a8238a986dc2 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:24.797032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a94c0-22bd-429b-ac13-0c1bd971a88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:24.798065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a94c0-22bd-429b-ac13-0c1bd971a88f service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.798560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a94c0-22bd-429b-ac13-0c1bd971a88f service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.799012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a94c0-22bd-429b-ac13-0c1bd971a88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.818764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 802/1624] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:24.818764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145cc9d-bdca-4859-9cad-a8238a986dc2 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:24.827900 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a94c0-22bd-429b-ac13-0c1bd971a88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:24.830784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a94c0-22bd-429b-ac13-0c1bd971a88f service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:24.832945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145cc9d-bdca-4859-9cad-a8238a986dc2 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:24.839787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cabff-5354-4f13-8e94-b32698b7876c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:24.841445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cabff-5354-4f13-8e94-b32698b7876c service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.857313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cabff-5354-4f13-8e94-b32698b7876c service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.858016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cabff-5354-4f13-8e94-b32698b7876c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.873780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cabff-5354-4f13-8e94-b32698b7876c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:24.875986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cabff-5354-4f13-8e94-b32698b7876c service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:24.889878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 803/1626] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:24.890139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 823/1626] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:24.891783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082adcb4-84df-45ab-893a-ed4b936fc34f None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.892154 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082adcb4-84df-45ab-893a-ed4b936fc34f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.892660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082adcb4-84df-45ab-893a-ed4b936fc34f None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.895435 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 804/1627] 10.222.0.27 () {54 vars in 962 bytes} [Wed Jul 20 17:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:57:24.897245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddbcaa-75ce-4a5a-b6d5-f1d4ac136abc None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.897576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddbcaa-75ce-4a5a-b6d5-f1d4ac136abc None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:24.897865 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddbcaa-75ce-4a5a-b6d5-f1d4ac136abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:24.910768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a94c0-22bd-429b-ac13-0c1bd971a88f service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:24.916075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d04a94c0-22bd-429b-ac13-0c1bd971a88f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:24.937238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-f6ddbcaa-75ce-4a5a-b6d5-f1d4ac136abc None None] MFA Rules not processed for user `10b683e2bfe442829a24b84172ba93ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:24.938679 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f6ddbcaa-75ce-4a5a-b6d5-f1d4ac136abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:24.977623 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a94c0-22bd-429b-ac13-0c1bd971a88f service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:24.997617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f1448-a9e7-4f7f-a7de-9009eface70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:24.998986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f1448-a9e7-4f7f-a7de-9009eface70b service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:24.999589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f1448-a9e7-4f7f-a7de-9009eface70b service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:25.000073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f1448-a9e7-4f7f-a7de-9009eface70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:25.036815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f1448-a9e7-4f7f-a7de-9009eface70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:25.051132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f1448-a9e7-4f7f-a7de-9009eface70b service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:25.079479 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 805/1628] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:25.081378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddbcaa-75ce-4a5a-b6d5-f1d4ac136abc None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:25.084428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 824/1629] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:25.095936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0ca86-648b-4f19-9221-b29b3bb2c5ce None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:25.096685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0ca86-648b-4f19-9221-b29b3bb2c5ce None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:25.097371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0ca86-648b-4f19-9221-b29b3bb2c5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:25.098369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddbcaa-75ce-4a5a-b6d5-f1d4ac136abc None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:25.118897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3670f10-600d-4ce6-80c2-df0ff9c7418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:25.122584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3670f10-600d-4ce6-80c2-df0ff9c7418e admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:25.123054 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3670f10-600d-4ce6-80c2-df0ff9c7418e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:25.123555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3670f10-600d-4ce6-80c2-df0ff9c7418e admin admin] PATH_INFO: `/v3/projects/fd2e1258583d4f2485dcb8a246bc0a16/users/fdf6b34fae16405ab423e60b0e17712c/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:25.127493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3670f10-600d-4ce6-80c2-df0ff9c7418e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2e1258583d4f2485dcb8a246bc0a16, user_id=fdf6b34fae16405ab423e60b0e17712c, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:25.131853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3670f10-600d-4ce6-80c2-df0ff9c7418e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:25.154320 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 806/1630] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:25 2022] PUT /identity/v3/projects/fd2e1258583d4f2485dcb8a246bc0a16/users/fdf6b34fae16405ab423e60b0e17712c/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:25.156139 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3670f10-600d-4ce6-80c2-df0ff9c7418e admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:25.177168 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-66a0ca86-648b-4f19-9221-b29b3bb2c5ce None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:25.179819 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-66a0ca86-648b-4f19-9221-b29b3bb2c5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:25.261984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3670f10-600d-4ce6-80c2-df0ff9c7418e admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:25.268845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d40e1-159a-4b45-b8e8-6692553aea24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:25.269766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d40e1-159a-4b45-b8e8-6692553aea24 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:25.270142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d40e1-159a-4b45-b8e8-6692553aea24 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:25.270544 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d40e1-159a-4b45-b8e8-6692553aea24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:25.372855 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:25.394308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 825/1631] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Jul 20 17:57:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:25.401958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411870f0-c6a1-4865-a07c-02904abb50eb None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:25.402685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411870f0-c6a1-4865-a07c-02904abb50eb None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:25.403050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411870f0-c6a1-4865-a07c-02904abb50eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:25.508890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-411870f0-c6a1-4865-a07c-02904abb50eb None None] MFA Rules not processed for user `fdf6b34fae16405ab423e60b0e17712c`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:25.512842 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-411870f0-c6a1-4865-a07c-02904abb50eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:25.523990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d40e1-159a-4b45-b8e8-6692553aea24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:25.525868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d40e1-159a-4b45-b8e8-6692553aea24 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:25.534918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:25.557496 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 807/1632] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:25.559477 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d40e1-159a-4b45-b8e8-6692553aea24 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:25.574288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d40e1-159a-4b45-b8e8-6692553aea24 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:25.584118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f1647-0413-4b4d-b43a-cf588e32888f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:25.584992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f1647-0413-4b4d-b43a-cf588e32888f service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:25.585525 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f1647-0413-4b4d-b43a-cf588e32888f service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:25.585910 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f1647-0413-4b4d-b43a-cf588e32888f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:25.684000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f1647-0413-4b4d-b43a-cf588e32888f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:25.686061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f1647-0413-4b4d-b43a-cf588e32888f service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:25.710292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 808/1633] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:25.737404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 826/1634] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:25.794397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f1647-0413-4b4d-b43a-cf588e32888f service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:25.817435 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f1647-0413-4b4d-b43a-cf588e32888f service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:25.836909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b2217-4d44-4d0b-b8d3-583a7e346ece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:25.838015 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b2217-4d44-4d0b-b8d3-583a7e346ece service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:25.838529 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b2217-4d44-4d0b-b8d3-583a7e346ece service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:25.845099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b2217-4d44-4d0b-b8d3-583a7e346ece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:25.885334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b2217-4d44-4d0b-b8d3-583a7e346ece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:25.894703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b2217-4d44-4d0b-b8d3-583a7e346ece service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:25.922382 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 809/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:26.173489 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d661e-701c-4460-a970-a3186f5b44b7 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:26.173948 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d661e-701c-4460-a970-a3186f5b44b7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:26.174491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d661e-701c-4460-a970-a3186f5b44b7 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:26.176641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 827/1636] 10.222.0.27 () {54 vars in 912 bytes} [Wed Jul 20 17:57:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:57:26.193919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49589788-712f-418a-9c58-1bd2bcb4c35c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:26.194606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49589788-712f-418a-9c58-1bd2bcb4c35c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:26.195125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49589788-712f-418a-9c58-1bd2bcb4c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:26.222018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-49589788-712f-418a-9c58-1bd2bcb4c35c None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:26.223461 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-49589788-712f-418a-9c58-1bd2bcb4c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:26.243983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 810/1637] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 17:57:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:26.799223 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d661e-701c-4460-a970-a3186f5b44b7 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:26.799223 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d661e-701c-4460-a970-a3186f5b44b7 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:26.856351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49589788-712f-418a-9c58-1bd2bcb4c35c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:26.860430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1384d3e-5392-4c8d-8663-0508612d12ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:26.860430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384d3e-5392-4c8d-8663-0508612d12ab service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:26.860430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384d3e-5392-4c8d-8663-0508612d12ab service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:26.860430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1384d3e-5392-4c8d-8663-0508612d12ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:26.865424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49589788-712f-418a-9c58-1bd2bcb4c35c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:26.865424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26e225-a628-4f91-a848-de3d7774ce22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:26.865424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26e225-a628-4f91-a848-de3d7774ce22 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:26.865424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26e225-a628-4f91-a848-de3d7774ce22 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:26.869309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26e225-a628-4f91-a848-de3d7774ce22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:26.873151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1384d3e-5392-4c8d-8663-0508612d12ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:26.873151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1384d3e-5392-4c8d-8663-0508612d12ab service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:26.874150 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:26.874551 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 828/1638] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:26.874943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26e225-a628-4f91-a848-de3d7774ce22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:26.874943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26e225-a628-4f91-a848-de3d7774ce22 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:26.874943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 811/1639] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:29.149084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8056-8bd4-4ae8-8c3c-5a0fbf5f4b82 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:29.150087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8056-8bd4-4ae8-8c3c-5a0fbf5f4b82 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:29.150564 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f8056-8bd4-4ae8-8c3c-5a0fbf5f4b82 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:29.154097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 829/1640] 10.222.0.27 () {54 vars in 962 bytes} [Wed Jul 20 17:57:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:57:29.169924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7a28d-a057-4be7-8000-39040b2ebcfc None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:29.172950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7a28d-a057-4be7-8000-39040b2ebcfc None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:29.173584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7a28d-a057-4be7-8000-39040b2ebcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:29.249109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-75c7a28d-a057-4be7-8000-39040b2ebcfc None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:29.251990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-75c7a28d-a057-4be7-8000-39040b2ebcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:29.311171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 812/1641] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Jul 20 17:57:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:57:29.328433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bfa76-43ee-4c60-80f5-629c963683c1 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:29.328752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bfa76-43ee-4c60-80f5-629c963683c1 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:29.329225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bfa76-43ee-4c60-80f5-629c963683c1 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:29.330927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 830/1642] 10.222.0.27 () {54 vars in 912 bytes} [Wed Jul 20 17:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:57:29.367997 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba50da-61f3-4ed2-adf0-5731365390f0 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:29.368424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba50da-61f3-4ed2-adf0-5731365390f0 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:29.368911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba50da-61f3-4ed2-adf0-5731365390f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:29.554967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-10ba50da-61f3-4ed2-adf0-5731365390f0 None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:29.554967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-10ba50da-61f3-4ed2-adf0-5731365390f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:29.610061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 813/1643] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 17:57:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:29.789885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bfa76-43ee-4c60-80f5-629c963683c1 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:29.986766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bfa76-43ee-4c60-80f5-629c963683c1 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:30.020378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:30.022210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:30.022693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:30.023168 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] PATH_INFO: `/v3/users/20854021a4654028a3acea33e603fe76` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:30.034267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=20854021a4654028a3acea33e603fe76)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:30.036177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: WARNING py.warnings [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:57:30.036177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: warnings.warn(msg) Jul 20 17:57:30.036177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: Jul 20 17:57:30.040067 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:30.071430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba50da-61f3-4ed2-adf0-5731365390f0 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:30.078804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba50da-61f3-4ed2-adf0-5731365390f0 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:30.095085 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d6b21-540e-41c4-9ded-d56519e13e3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:30.096536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d6b21-540e-41c4-9ded-d56519e13e3f service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:30.100119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d6b21-540e-41c4-9ded-d56519e13e3f service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:30.101208 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d6b21-540e-41c4-9ded-d56519e13e3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:30.115749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d6b21-540e-41c4-9ded-d56519e13e3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:30.117869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d6b21-540e-41c4-9ded-d56519e13e3f service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:30.131771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 814/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:30.491850 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20854021a4654028a3acea33e603fe76'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:30.579384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20854021a4654028a3acea33e603fe76'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:30.606758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20854021a4654028a3acea33e603fe76'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:30.758132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20854021a4654028a3acea33e603fe76'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:30.758774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20854021a4654028a3acea33e603fe76'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:30.773052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 831/1645] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:57:29 2022] DELETE /identity/v3/users/20854021a4654028a3acea33e603fe76 => generated 0 bytes in 981 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:30.775244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b349-f46e-435e-ad22-7295490c701c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:30.775751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b349-f46e-435e-ad22-7295490c701c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:30.776523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b349-f46e-435e-ad22-7295490c701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:30.809158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-5df6b349-f46e-435e-ad22-7295490c701c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:30.811730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5df6b349-f46e-435e-ad22-7295490c701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:31.033801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 815/1646] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:57:31.088022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:31.096446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:31.135670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:31.348600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681b93-f029-4c1e-b7b3-f4f1b3eb6a1f admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:31.358164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ebe62-a541-4e44-aa90-6420c73c0fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:31.359303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ebe62-a541-4e44-aa90-6420c73c0fec service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:31.359813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ebe62-a541-4e44-aa90-6420c73c0fec service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:31.360309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ebe62-a541-4e44-aa90-6420c73c0fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:31.403636 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ebe62-a541-4e44-aa90-6420c73c0fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:31.425758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ebe62-a541-4e44-aa90-6420c73c0fec service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:31.445052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 832/1647] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:57:33.150058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b349-f46e-435e-ad22-7295490c701c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:33.154669 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5df6b349-f46e-435e-ad22-7295490c701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:33.195565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b349-f46e-435e-ad22-7295490c701c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:33.210028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:33.214955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:33.215683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:33.216378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] PATH_INFO: `/v3/projects/d3d54f97f6144109a41c7267dacd77d5` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:33.221372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d54f97f6144109a41c7267dacd77d5)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:33.223849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: WARNING py.warnings [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 17:57:33.223849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: warnings.warn(msg) Jul 20 17:57:33.223849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: Jul 20 17:57:33.242938 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:33.618608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d54f97f6144109a41c7267dacd77d5', 'request_id': 'req-4173657c-2dff-469f-a3d9-69eb64c65431'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:33.656104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d54f97f6144109a41c7267dacd77d5', 'request_id': 'req-4173657c-2dff-469f-a3d9-69eb64c65431'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:33.869415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d54f97f6144109a41c7267dacd77d5', 'request_id': 'req-4173657c-2dff-469f-a3d9-69eb64c65431'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:33.964294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] The token cache is being invalidate because project d3d54f97f6144109a41c7267dacd77d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:57:33.972992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:33.983376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:33.986018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 816/1648] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:57:33 2022] DELETE /identity/v3/projects/d3d54f97f6144109a41c7267dacd77d5 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:33.994253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ebe62-a541-4e44-aa90-6420c73c0fec service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:34.063498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ebe62-a541-4e44-aa90-6420c73c0fec service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:34.310467 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebef21-a2af-4925-a49d-c453d668434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:34.314066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebef21-a2af-4925-a49d-c453d668434a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:34.315004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebef21-a2af-4925-a49d-c453d668434a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:34.316086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebef21-a2af-4925-a49d-c453d668434a admin admin] PATH_INFO: `/v3/users/fdf6b34fae16405ab423e60b0e17712c` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:34.320616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebef21-a2af-4925-a49d-c453d668434a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf6b34fae16405ab423e60b0e17712c)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:34.326978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebef21-a2af-4925-a49d-c453d668434a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:34.731266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-30ebef21-a2af-4925-a49d-c453d668434a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf6b34fae16405ab423e60b0e17712c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:34.785301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-30ebef21-a2af-4925-a49d-c453d668434a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf6b34fae16405ab423e60b0e17712c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:34.813654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-30ebef21-a2af-4925-a49d-c453d668434a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf6b34fae16405ab423e60b0e17712c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:34.912677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-30ebef21-a2af-4925-a49d-c453d668434a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf6b34fae16405ab423e60b0e17712c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:34.917646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-30ebef21-a2af-4925-a49d-c453d668434a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf6b34fae16405ab423e60b0e17712c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:34.933774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 833/1649] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:57:33 2022] DELETE /identity/v3/users/fdf6b34fae16405ab423e60b0e17712c => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:37.252946 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:37.255359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:37.279727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173657c-2dff-469f-a3d9-69eb64c65431 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:37.335522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:37.447248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:37.447248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:37.447248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:37.447248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] PATH_INFO: `/v3/users/5250c5699e4844359e205dc17cbb14a3` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:37.450254 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5250c5699e4844359e205dc17cbb14a3)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:37.455376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:37.802699 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5250c5699e4844359e205dc17cbb14a3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:37.855226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5250c5699e4844359e205dc17cbb14a3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:37.878720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5250c5699e4844359e205dc17cbb14a3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:37.958756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5250c5699e4844359e205dc17cbb14a3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:37.959597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5250c5699e4844359e205dc17cbb14a3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:37.975475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 817/1650] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:57:37 2022] DELETE /identity/v3/users/5250c5699e4844359e205dc17cbb14a3 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:37.983255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeedce3-ea8d-486c-a9f8-af04ab402741 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:37.983830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeedce3-ea8d-486c-a9f8-af04ab402741 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:37.983830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeedce3-ea8d-486c-a9f8-af04ab402741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:38.040320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-bdeedce3-ea8d-486c-a9f8-af04ab402741 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:38.043095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-bdeedce3-ea8d-486c-a9f8-af04ab402741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:38.083128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:38.140109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:38.142604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:38.175695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 834/1651] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:57:38.213325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeedce3-ea8d-486c-a9f8-af04ab402741 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:38.215008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-bdeedce3-ea8d-486c-a9f8-af04ab402741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:38.365328 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84063ec8-a23c-4d2a-aef1-c25094a57fcb admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:38.380921 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1b50d-2709-4215-a95c-c0f39a69e35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:38.382244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1b50d-2709-4215-a95c-c0f39a69e35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:38.382711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1b50d-2709-4215-a95c-c0f39a69e35a admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:38.383549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1b50d-2709-4215-a95c-c0f39a69e35a admin admin] PATH_INFO: `/v3/projects/fd2e1258583d4f2485dcb8a246bc0a16` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:38.386420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1b50d-2709-4215-a95c-c0f39a69e35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2e1258583d4f2485dcb8a246bc0a16)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:38.403553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1b50d-2709-4215-a95c-c0f39a69e35a admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:38.489204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeedce3-ea8d-486c-a9f8-af04ab402741 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:38.519802 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ced2b-8a91-4926-9dca-b99752c3224b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:38.521008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ced2b-8a91-4926-9dca-b99752c3224b service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:38.521527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ced2b-8a91-4926-9dca-b99752c3224b service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:38.522044 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ced2b-8a91-4926-9dca-b99752c3224b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:38.571385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ced2b-8a91-4926-9dca-b99752c3224b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:38.573600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ced2b-8a91-4926-9dca-b99752c3224b service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:38.600632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 835/1652] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:57:38.643761 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-02e1b50d-2709-4215-a95c-c0f39a69e35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2e1258583d4f2485dcb8a246bc0a16', 'request_id': 'req-02e1b50d-2709-4215-a95c-c0f39a69e35a'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:38.669443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-02e1b50d-2709-4215-a95c-c0f39a69e35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2e1258583d4f2485dcb8a246bc0a16', 'request_id': 'req-02e1b50d-2709-4215-a95c-c0f39a69e35a'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:38.817932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-02e1b50d-2709-4215-a95c-c0f39a69e35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2e1258583d4f2485dcb8a246bc0a16', 'request_id': 'req-02e1b50d-2709-4215-a95c-c0f39a69e35a'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:38.841864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-02e1b50d-2709-4215-a95c-c0f39a69e35a admin admin] The token cache is being invalidate because project fd2e1258583d4f2485dcb8a246bc0a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:57:38.842837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-02e1b50d-2709-4215-a95c-c0f39a69e35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:38.847407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-02e1b50d-2709-4215-a95c-c0f39a69e35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:38.853128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 818/1653] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:57:38 2022] DELETE /identity/v3/projects/fd2e1258583d4f2485dcb8a246bc0a16 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:57:38.856937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd73dd4-7250-41d1-854e-d3c625621c97 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:38.856937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd73dd4-7250-41d1-854e-d3c625621c97 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:38.856937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd73dd4-7250-41d1-854e-d3c625621c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:38.914763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-abd73dd4-7250-41d1-854e-d3c625621c97 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:38.923223 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-abd73dd4-7250-41d1-854e-d3c625621c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:39.132830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 836/1654] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:39.140597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4d3ce-5bda-4b15-aa1a-51a32ee87194 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:39.140893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4d3ce-5bda-4b15-aa1a-51a32ee87194 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:39.141584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4d3ce-5bda-4b15-aa1a-51a32ee87194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:39.194005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-15d4d3ce-5bda-4b15-aa1a-51a32ee87194 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:39.201453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-15d4d3ce-5bda-4b15-aa1a-51a32ee87194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:39.224250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 819/1655] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:39.230065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd73dd4-7250-41d1-854e-d3c625621c97 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:39.259958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd73dd4-7250-41d1-854e-d3c625621c97 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:39.268611 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbb6be-3f1a-4ce5-b8dd-dac1d809aa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:39.269194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbb6be-3f1a-4ce5-b8dd-dac1d809aa7f admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:39.269645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbb6be-3f1a-4ce5-b8dd-dac1d809aa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:39.270202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbb6be-3f1a-4ce5-b8dd-dac1d809aa7f admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:39.271364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbb6be-3f1a-4ce5-b8dd-dac1d809aa7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:57:39.271874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbb6be-3f1a-4ce5-b8dd-dac1d809aa7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:39.274395 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbb6be-3f1a-4ce5-b8dd-dac1d809aa7f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:39.308700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 837/1656] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:57:39.313075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4d3ce-5bda-4b15-aa1a-51a32ee87194 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:39.330643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4d3ce-5bda-4b15-aa1a-51a32ee87194 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:39.342774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9b157-ed3c-46b3-8664-66e2f201cf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:39.343739 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9b157-ed3c-46b3-8664-66e2f201cf8b admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:39.344265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9b157-ed3c-46b3-8664-66e2f201cf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:39.344941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9b157-ed3c-46b3-8664-66e2f201cf8b admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:39.345863 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9b157-ed3c-46b3-8664-66e2f201cf8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:39.348076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9b157-ed3c-46b3-8664-66e2f201cf8b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:39.539457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbb6be-3f1a-4ce5-b8dd-dac1d809aa7f admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:39.546861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 820/1657] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:39 2022] POST /identity/v3/projects => generated 367 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:39.567747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbb6be-3f1a-4ce5-b8dd-dac1d809aa7f admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:39.738588 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9b157-ed3c-46b3-8664-66e2f201cf8b admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:39.740998 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-54d9b157-ed3c-46b3-8664-66e2f201cf8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:39.844539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b5645-734f-4e23-b09c-6633da76d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:39.844539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b5645-734f-4e23-b09c-6633da76d48a admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:39.844539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b5645-734f-4e23-b09c-6633da76d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:39.844539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b5645-734f-4e23-b09c-6633da76d48a admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:39.844990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b5645-734f-4e23-b09c-6633da76d48a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:39.848962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b5645-734f-4e23-b09c-6633da76d48a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:39.935700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9b157-ed3c-46b3-8664-66e2f201cf8b admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:39.956251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f8dc2-3580-40cf-81af-d0b3db326eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:39.957630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8dc2-3580-40cf-81af-d0b3db326eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:39.957994 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8dc2-3580-40cf-81af-d0b3db326eff admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:39.958383 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f8dc2-3580-40cf-81af-d0b3db326eff admin admin] PATH_INFO: `/v3/projects/a04430115d5d4fb784d6b53543d48f9e` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:39.962803 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f8dc2-3580-40cf-81af-d0b3db326eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04430115d5d4fb784d6b53543d48f9e)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:39.965967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f8dc2-3580-40cf-81af-d0b3db326eff admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:40.035983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:40.048999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 838/1658] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:39 2022] POST /identity/v3/users => generated 284 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:40.050314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b5645-734f-4e23-b09c-6633da76d48a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:40.066508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b5645-734f-4e23-b09c-6633da76d48a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:40.074509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536f69-edc8-4495-ab60-31f7281073d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:40.075643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536f69-edc8-4495-ab60-31f7281073d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:40.076112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536f69-edc8-4495-ab60-31f7281073d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:40.076714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536f69-edc8-4495-ab60-31f7281073d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:40.077880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02536f69-edc8-4495-ab60-31f7281073d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:40.081375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02536f69-edc8-4495-ab60-31f7281073d6 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:40.099692 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 839/1659] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:40.106165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536f69-edc8-4495-ab60-31f7281073d6 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:40.117898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536f69-edc8-4495-ab60-31f7281073d6 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:40.124652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734c9e3-2130-49d4-acac-5c6b222c2c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:40.125648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734c9e3-2130-49d4-acac-5c6b222c2c8c admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:40.126154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734c9e3-2130-49d4-acac-5c6b222c2c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:40.126617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734c9e3-2130-49d4-acac-5c6b222c2c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:40.127569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734c9e3-2130-49d4-acac-5c6b222c2c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:40.129563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734c9e3-2130-49d4-acac-5c6b222c2c8c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:40.148108 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 840/1660] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:57:40.149862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734c9e3-2130-49d4-acac-5c6b222c2c8c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:40.163573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734c9e3-2130-49d4-acac-5c6b222c2c8c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:40.170325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf463-784e-4f22-86af-f731b43eda59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:40.171516 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf463-784e-4f22-86af-f731b43eda59 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:40.171943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf463-784e-4f22-86af-f731b43eda59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:40.172394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf463-784e-4f22-86af-f731b43eda59 admin admin] PATH_INFO: `/v3/projects/8efc9c83db3047cfa90f94674f01b179/users/20abbff633f74157ae014e1589ee06d9/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:40.217195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf463-784e-4f22-86af-f731b43eda59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efc9c83db3047cfa90f94674f01b179, user_id=20abbff633f74157ae014e1589ee06d9, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:40.219513 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f92f8dc2-3580-40cf-81af-d0b3db326eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04430115d5d4fb784d6b53543d48f9e', 'request_id': 'req-f92f8dc2-3580-40cf-81af-d0b3db326eff'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:40.224033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf463-784e-4f22-86af-f731b43eda59 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:40.250186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f92f8dc2-3580-40cf-81af-d0b3db326eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04430115d5d4fb784d6b53543d48f9e', 'request_id': 'req-f92f8dc2-3580-40cf-81af-d0b3db326eff'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:40.347998 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 841/1661] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:40 2022] PUT /identity/v3/projects/8efc9c83db3047cfa90f94674f01b179/users/20abbff633f74157ae014e1589ee06d9/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:40.354314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fc7c6-bbba-42c3-89df-42ad4656db73 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:40.355925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fc7c6-bbba-42c3-89df-42ad4656db73 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:40.357688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fc7c6-bbba-42c3-89df-42ad4656db73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:40.420534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f92f8dc2-3580-40cf-81af-d0b3db326eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04430115d5d4fb784d6b53543d48f9e', 'request_id': 'req-f92f8dc2-3580-40cf-81af-d0b3db326eff'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:40.429499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-121fc7c6-bbba-42c3-89df-42ad4656db73 None None] MFA Rules not processed for user `20abbff633f74157ae014e1589ee06d9`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:40.432517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-121fc7c6-bbba-42c3-89df-42ad4656db73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:40.471229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f92f8dc2-3580-40cf-81af-d0b3db326eff admin admin] The token cache is being invalidate because project a04430115d5d4fb784d6b53543d48f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:57:40.472654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f92f8dc2-3580-40cf-81af-d0b3db326eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:40.475027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f92f8dc2-3580-40cf-81af-d0b3db326eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:40.486911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 821/1662] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:57:39 2022] DELETE /identity/v3/projects/a04430115d5d4fb784d6b53543d48f9e => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:40.490630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc78ed-73bb-4544-9450-9867235d4bd2 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:40.491645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc78ed-73bb-4544-9450-9867235d4bd2 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:40.492344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc78ed-73bb-4544-9450-9867235d4bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:40.569050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-3ddc78ed-73bb-4544-9450-9867235d4bd2 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:40.574164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3ddc78ed-73bb-4544-9450-9867235d4bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:40.633164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 842/1663] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:40.640371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fc7c6-bbba-42c3-89df-42ad4656db73 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:40.643713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-121fc7c6-bbba-42c3-89df-42ad4656db73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:40.761237 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 822/1664] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:40.763110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabce43-d90d-426c-8c75-233f09f2aeb8 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:40.763642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabce43-d90d-426c-8c75-233f09f2aeb8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:40.764073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabce43-d90d-426c-8c75-233f09f2aeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:40.814748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-1eabce43-d90d-426c-8c75-233f09f2aeb8 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:40.815983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-1eabce43-d90d-426c-8c75-233f09f2aeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:40.841371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 823/1665] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:40.841371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ee259-f1b3-4376-bffd-7064bf5b67bd None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:40.841371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ee259-f1b3-4376-bffd-7064bf5b67bd None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:40.841371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ee259-f1b3-4376-bffd-7064bf5b67bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:40.939584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e41ee259-f1b3-4376-bffd-7064bf5b67bd None None] MFA Rules not processed for user `2b14df3870114a00bd98291eb17d64ce`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:40.956517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e41ee259-f1b3-4376-bffd-7064bf5b67bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:40.962677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:41.032462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fc7c6-bbba-42c3-89df-42ad4656db73 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:41.050587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ce53-5af1-4ce7-9fbe-c7197c79a89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:41.053333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ce53-5af1-4ce7-9fbe-c7197c79a89a admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:41.053761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ce53-5af1-4ce7-9fbe-c7197c79a89a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:41.055301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ce53-5af1-4ce7-9fbe-c7197c79a89a admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:41.060407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244ce53-5af1-4ce7-9fbe-c7197c79a89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:41.083078 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244ce53-5af1-4ce7-9fbe-c7197c79a89a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:41.204346 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 824/1666] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:41.217405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ee259-f1b3-4376-bffd-7064bf5b67bd None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:41.245017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ee259-f1b3-4376-bffd-7064bf5b67bd None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:41.251247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9959891-6732-4db5-ba42-f31c20e94aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:41.252387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9959891-6732-4db5-ba42-f31c20e94aaf admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:41.252800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9959891-6732-4db5-ba42-f31c20e94aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:41.253539 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9959891-6732-4db5-ba42-f31c20e94aaf admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:41.254512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9959891-6732-4db5-ba42-f31c20e94aaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:57:41.256001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9959891-6732-4db5-ba42-f31c20e94aaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:41.257886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9959891-6732-4db5-ba42-f31c20e94aaf admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:41.281009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 825/1667] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:57:41.282767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa929245-4d8e-4cf4-b669-6d40e38439ed None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:41.283303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa929245-4d8e-4cf4-b669-6d40e38439ed None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:41.284559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa929245-4d8e-4cf4-b669-6d40e38439ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:41.314346 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-fa929245-4d8e-4cf4-b669-6d40e38439ed None None] MFA Rules not processed for user `2b14df3870114a00bd98291eb17d64ce`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:41.317429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-fa929245-4d8e-4cf4-b669-6d40e38439ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:41.323871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 843/1668] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:40 2022] POST /identity/v3/projects => generated 369 bytes in 684 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:57:41.324909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ce53-5af1-4ce7-9fbe-c7197c79a89a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:41.331002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 826/1669] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:41.331941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa929245-4d8e-4cf4-b669-6d40e38439ed None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:41.375604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa929245-4d8e-4cf4-b669-6d40e38439ed None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:41.551093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a948b1a-2aa5-4312-bb41-a38a384bdb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:41.552258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a948b1a-2aa5-4312-bb41-a38a384bdb99 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:41.554493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a948b1a-2aa5-4312-bb41-a38a384bdb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:41.555058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a948b1a-2aa5-4312-bb41-a38a384bdb99 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:41.558846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a948b1a-2aa5-4312-bb41-a38a384bdb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:41.564843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a948b1a-2aa5-4312-bb41-a38a384bdb99 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:41.600410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ce53-5af1-4ce7-9fbe-c7197c79a89a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:41.612615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbe68f-b38a-412e-b735-5901c725192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:41.613726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbe68f-b38a-412e-b735-5901c725192c admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:41.614319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbe68f-b38a-412e-b735-5901c725192c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:41.614674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbe68f-b38a-412e-b735-5901c725192c admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:41.615413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbe68f-b38a-412e-b735-5901c725192c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:41.617459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbe68f-b38a-412e-b735-5901c725192c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:41.740847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 827/1670] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:41 2022] POST /identity/v3/users => generated 291 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:41.740847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a948b1a-2aa5-4312-bb41-a38a384bdb99 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:41.741978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2a948b1a-2aa5-4312-bb41-a38a384bdb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:41.783834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 844/1671] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:41 2022] POST /identity/v3/projects => generated 369 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:41.783834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbe68f-b38a-412e-b735-5901c725192c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:41.963895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbe68f-b38a-412e-b735-5901c725192c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:41.980125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a948b1a-2aa5-4312-bb41-a38a384bdb99 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:41.987880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194d5db-3ba6-4d73-9789-6ceb910b18c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:41.988780 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194d5db-3ba6-4d73-9789-6ceb910b18c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:41.989340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194d5db-3ba6-4d73-9789-6ceb910b18c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:41.989839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194d5db-3ba6-4d73-9789-6ceb910b18c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:41.991512 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194d5db-3ba6-4d73-9789-6ceb910b18c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:41.995415 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194d5db-3ba6-4d73-9789-6ceb910b18c6 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:42.032163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 845/1672] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:42.032163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194d5db-3ba6-4d73-9789-6ceb910b18c6 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:42.062855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194d5db-3ba6-4d73-9789-6ceb910b18c6 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:42.078804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:42.080820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef793c09-9df4-4a87-99bc-adf98a37b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:42.081535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef793c09-9df4-4a87-99bc-adf98a37b2ef admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:42.082010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef793c09-9df4-4a87-99bc-adf98a37b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:42.082295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef793c09-9df4-4a87-99bc-adf98a37b2ef admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:42.083243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef793c09-9df4-4a87-99bc-adf98a37b2ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:42.087957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef793c09-9df4-4a87-99bc-adf98a37b2ef admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:42.183031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 846/1673] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:42 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:42.183031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61048337-0611-4eac-97ac-f81f324a24b4 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:42.184338 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61048337-0611-4eac-97ac-f81f324a24b4 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:42.184909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61048337-0611-4eac-97ac-f81f324a24b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:42.271263 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-61048337-0611-4eac-97ac-f81f324a24b4 None None] MFA Rules not processed for user `fed263f071864582ba96d79f75fbfb36`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:42.275025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-61048337-0611-4eac-97ac-f81f324a24b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:42.279760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ebc72-95cc-401a-898e-7b7f6a9699d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:42.281210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ebc72-95cc-401a-898e-7b7f6a9699d4 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:42.281488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ebc72-95cc-401a-898e-7b7f6a9699d4 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:42.281764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ebc72-95cc-401a-898e-7b7f6a9699d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:42.426216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ebc72-95cc-401a-898e-7b7f6a9699d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:42.428224 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ebc72-95cc-401a-898e-7b7f6a9699d4 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:42.449248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 828/1674] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:42.452918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ebc72-95cc-401a-898e-7b7f6a9699d4 service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:42.466779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 847/1675] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:42.467457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61048337-0611-4eac-97ac-f81f324a24b4 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:42.515794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ebc72-95cc-401a-898e-7b7f6a9699d4 service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:42.535917 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61048337-0611-4eac-97ac-f81f324a24b4 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:42.542607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d549e6-db9c-42bc-890e-9d4be5ea72a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:42.543904 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d549e6-db9c-42bc-890e-9d4be5ea72a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:42.544409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d549e6-db9c-42bc-890e-9d4be5ea72a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:42.547787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d549e6-db9c-42bc-890e-9d4be5ea72a6 admin admin] PATH_INFO: `/v3/projects/2fb2dcb8a3ab4ddc94889c315970b163/users/9a2285e6e31c4c2b8ffc58055dde556b/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:42.562274 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94135a-4509-4509-a9d3-4a70023c9b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:42.563032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94135a-4509-4509-a9d3-4a70023c9b9a admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:42.563333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94135a-4509-4509-a9d3-4a70023c9b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:42.563602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94135a-4509-4509-a9d3-4a70023c9b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:42.564556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94135a-4509-4509-a9d3-4a70023c9b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:42.573688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94135a-4509-4509-a9d3-4a70023c9b9a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:42.605891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 848/1676] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:42.609457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94135a-4509-4509-a9d3-4a70023c9b9a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:42.613996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3d94135a-4509-4509-a9d3-4a70023c9b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:42.615204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d549e6-db9c-42bc-890e-9d4be5ea72a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb2dcb8a3ab4ddc94889c315970b163, user_id=9a2285e6e31c4c2b8ffc58055dde556b, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:42.621148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d549e6-db9c-42bc-890e-9d4be5ea72a6 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:42.673051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94135a-4509-4509-a9d3-4a70023c9b9a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:42.692326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf141350-811f-40c5-892c-a82f90d94b51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:42.693369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf141350-811f-40c5-892c-a82f90d94b51 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:42.693659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf141350-811f-40c5-892c-a82f90d94b51 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:42.693940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf141350-811f-40c5-892c-a82f90d94b51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:42.708882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf141350-811f-40c5-892c-a82f90d94b51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:42.711462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf141350-811f-40c5-892c-a82f90d94b51 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:42.751904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 849/1677] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:42.752848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf141350-811f-40c5-892c-a82f90d94b51 service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:42.782099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf141350-811f-40c5-892c-a82f90d94b51 service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:42.792664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f96348-b841-4ebb-9c3b-ba1ed53a3bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:42.793453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f96348-b841-4ebb-9c3b-ba1ed53a3bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:42.793829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f96348-b841-4ebb-9c3b-ba1ed53a3bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:42.794112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f96348-b841-4ebb-9c3b-ba1ed53a3bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:42.796059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f96348-b841-4ebb-9c3b-ba1ed53a3bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:42.800726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f96348-b841-4ebb-9c3b-ba1ed53a3bc0 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:42.813263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 829/1678] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:42 2022] PUT /identity/v3/projects/2fb2dcb8a3ab4ddc94889c315970b163/users/9a2285e6e31c4c2b8ffc58055dde556b/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:42.818778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d549e6-db9c-42bc-890e-9d4be5ea72a6 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:42.852127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 850/1679] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:42.853149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f96348-b841-4ebb-9c3b-ba1ed53a3bc0 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:42.898902 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f96348-b841-4ebb-9c3b-ba1ed53a3bc0 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:43.111822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d549e6-db9c-42bc-890e-9d4be5ea72a6 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:43.130946 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865890b-febc-4caa-ac3d-97179b74da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:43.131654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865890b-febc-4caa-ac3d-97179b74da40 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:43.131936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865890b-febc-4caa-ac3d-97179b74da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:43.132215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865890b-febc-4caa-ac3d-97179b74da40 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:43.133138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865890b-febc-4caa-ac3d-97179b74da40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:43.135413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865890b-febc-4caa-ac3d-97179b74da40 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:43.218287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 830/1680] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:43.225175 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865890b-febc-4caa-ac3d-97179b74da40 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:43.276061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865890b-febc-4caa-ac3d-97179b74da40 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:43.315352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b53e1-6bd5-4823-a423-385066bcb09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:43.315575 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b53e1-6bd5-4823-a423-385066bcb09b admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:43.315852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b53e1-6bd5-4823-a423-385066bcb09b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:43.316075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b53e1-6bd5-4823-a423-385066bcb09b admin admin] PATH_INFO: `/v3/projects/2fb2dcb8a3ab4ddc94889c315970b163/users/9a2285e6e31c4c2b8ffc58055dde556b/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:43.321124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b53e1-6bd5-4823-a423-385066bcb09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb2dcb8a3ab4ddc94889c315970b163, user_id=9a2285e6e31c4c2b8ffc58055dde556b, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:43.339701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b53e1-6bd5-4823-a423-385066bcb09b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:43.368231 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50dfd7-a06b-40ca-a943-ea04fbcbab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:43.373165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 831/1681] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:43 2022] PUT /identity/v3/projects/2fb2dcb8a3ab4ddc94889c315970b163/users/9a2285e6e31c4c2b8ffc58055dde556b/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:43.400728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc667f-0de8-4972-9b60-0d88ad992845 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:43.401163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc667f-0de8-4972-9b60-0d88ad992845 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:43.401543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc667f-0de8-4972-9b60-0d88ad992845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:43.401700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50dfd7-a06b-40ca-a943-ea04fbcbab81 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:43.402325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50dfd7-a06b-40ca-a943-ea04fbcbab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:43.402827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50dfd7-a06b-40ca-a943-ea04fbcbab81 admin admin] PATH_INFO: `/v3/projects/73ddf54699e24150bd73086d56aab221/users/77bdbd31da9441c39b33f5e00a27ff73/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:43.445119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:43.484888 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-cfcc667f-0de8-4972-9b60-0d88ad992845 None None] MFA Rules not processed for user `9a2285e6e31c4c2b8ffc58055dde556b`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:43.488782 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-cfcc667f-0de8-4972-9b60-0d88ad992845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:43.517261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50dfd7-a06b-40ca-a943-ea04fbcbab81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ddf54699e24150bd73086d56aab221, user_id=77bdbd31da9441c39b33f5e00a27ff73, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:43.535459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50dfd7-a06b-40ca-a943-ea04fbcbab81 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:43.697629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 851/1682] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:42 2022] PUT /identity/v3/projects/73ddf54699e24150bd73086d56aab221/users/77bdbd31da9441c39b33f5e00a27ff73/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:43.719181 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d73ea2-6a67-41be-8648-0d3bfdd233ab None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:43.722385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d73ea2-6a67-41be-8648-0d3bfdd233ab None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:43.723557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d73ea2-6a67-41be-8648-0d3bfdd233ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:43.810999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 832/1683] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:43.824729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc667f-0de8-4972-9b60-0d88ad992845 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:43.828693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-cfcc667f-0de8-4972-9b60-0d88ad992845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:43.885678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-39d73ea2-6a67-41be-8648-0d3bfdd233ab None None] MFA Rules not processed for user `77bdbd31da9441c39b33f5e00a27ff73`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:43.893430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-39d73ea2-6a67-41be-8648-0d3bfdd233ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:44.089281 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc667f-0de8-4972-9b60-0d88ad992845 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:44.193898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:44.206822 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 852/1684] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:44.208828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af85331-10c2-40ba-812c-2e8bc68d56a6 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:44.209612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af85331-10c2-40ba-812c-2e8bc68d56a6 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:44.210283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af85331-10c2-40ba-812c-2e8bc68d56a6 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:44.213646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 853/1685] 10.222.0.27 () {54 vars in 912 bytes} [Wed Jul 20 17:57:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:57:44.226505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5a432-d1f7-4f12-8ccc-788294118b68 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:44.228029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5a432-d1f7-4f12-8ccc-788294118b68 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:44.230214 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5a432-d1f7-4f12-8ccc-788294118b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:44.277538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e0196-671f-44f2-97f5-0e24bd1a5690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:44.278229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e0196-671f-44f2-97f5-0e24bd1a5690 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:44.278514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e0196-671f-44f2-97f5-0e24bd1a5690 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:44.278817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e0196-671f-44f2-97f5-0e24bd1a5690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:44.319985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b5f5a432-d1f7-4f12-8ccc-788294118b68 None None] MFA Rules not processed for user `11930f08a1324902a083436649660130`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:44.321503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b5f5a432-d1f7-4f12-8ccc-788294118b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:44.405052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e0196-671f-44f2-97f5-0e24bd1a5690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:44.406580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e0196-671f-44f2-97f5-0e24bd1a5690 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:44.413600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 854/1686] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 17:57:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:44.415128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5a432-d1f7-4f12-8ccc-788294118b68 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:44.439682 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 833/1687] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:44.440541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e0196-671f-44f2-97f5-0e24bd1a5690 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:44.445509 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5e0e0196-671f-44f2-97f5-0e24bd1a5690 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:44.472644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e0196-671f-44f2-97f5-0e24bd1a5690 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:44.483480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aea376-b463-4e4f-a173-5aa439e537c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:44.484291 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea376-b463-4e4f-a173-5aa439e537c3 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:44.484604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea376-b463-4e4f-a173-5aa439e537c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:44.484886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea376-b463-4e4f-a173-5aa439e537c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:44.505400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aea376-b463-4e4f-a173-5aa439e537c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:44.506920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aea376-b463-4e4f-a173-5aa439e537c3 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:44.523429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 834/1688] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:44.550327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9112c2-9b8c-4387-9a5d-80397d021ca2 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:44.550618 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9112c2-9b8c-4387-9a5d-80397d021ca2 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:44.550900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9112c2-9b8c-4387-9a5d-80397d021ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:44.600352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5a432-d1f7-4f12-8ccc-788294118b68 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:44.622019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-8f9112c2-9b8c-4387-9a5d-80397d021ca2 None None] MFA Rules not processed for user `f1d5e5f7ad994b8481b8c5e885db1739`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:44.622641 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8f9112c2-9b8c-4387-9a5d-80397d021ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:44.623962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b85a9-57e6-4c60-9337-87ce3fcd5109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:44.624749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b85a9-57e6-4c60-9337-87ce3fcd5109 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:44.625053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b85a9-57e6-4c60-9337-87ce3fcd5109 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:44.625328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b85a9-57e6-4c60-9337-87ce3fcd5109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:44.655816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b85a9-57e6-4c60-9337-87ce3fcd5109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:44.658991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b85a9-57e6-4c60-9337-87ce3fcd5109 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:44.689295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 855/1689] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:44.691322 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b85a9-57e6-4c60-9337-87ce3fcd5109 service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:44.693352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b44b85a9-57e6-4c60-9337-87ce3fcd5109 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:44.831282 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b85a9-57e6-4c60-9337-87ce3fcd5109 service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:44.836894 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:44.837631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:44.838519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:44.839770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] PATH_INFO: `/v3/users/e115aae2b417449381b67dad00bca6d5` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:44.840337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e115aae2b417449381b67dad00bca6d5)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:44.842628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:44.889523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 835/1690] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:57:44.890619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9112c2-9b8c-4387-9a5d-80397d021ca2 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:44.915299 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9112c2-9b8c-4387-9a5d-80397d021ca2 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:44.925028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b735d08-d0c7-46f8-9214-4a306278f59d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:44.930463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b735d08-d0c7-46f8-9214-4a306278f59d service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:44.930463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b735d08-d0c7-46f8-9214-4a306278f59d service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:44.930463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b735d08-d0c7-46f8-9214-4a306278f59d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:45.139687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e115aae2b417449381b67dad00bca6d5'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:45.215344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b735d08-d0c7-46f8-9214-4a306278f59d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:45.215869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e115aae2b417449381b67dad00bca6d5'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:45.222698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b735d08-d0c7-46f8-9214-4a306278f59d service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:45.253050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e115aae2b417449381b67dad00bca6d5'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:45.264131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 836/1691] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:45.362916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e115aae2b417449381b67dad00bca6d5'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:45.363647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e115aae2b417449381b67dad00bca6d5'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:45.379860 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 856/1692] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:57:44 2022] DELETE /identity/v3/users/e115aae2b417449381b67dad00bca6d5 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:45.388946 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0057f-de1f-41d9-8804-fd78969254dd None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:45.402403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0057f-de1f-41d9-8804-fd78969254dd None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:45.402684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0057f-de1f-41d9-8804-fd78969254dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:45.472197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c9c0057f-de1f-41d9-8804-fd78969254dd None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:45.474436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c9c0057f-de1f-41d9-8804-fd78969254dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:45.817316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 837/1693] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:45.872982 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:45.875610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:45.957630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf089e-8aa7-4692-9db2-a10ca876235b None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:45.958431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf089e-8aa7-4692-9db2-a10ca876235b None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:45.959007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf089e-8aa7-4692-9db2-a10ca876235b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:46.120596 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81809f66-689b-41d4-8e07-13eee1f6a505 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:46.122375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-ecbf089e-8aa7-4692-9db2-a10ca876235b None None] MFA Rules not processed for user `de47dd54e8fc48ca9411ce4c7906b80b`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:46.124990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ecbf089e-8aa7-4692-9db2-a10ca876235b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:46.130524 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c560a42-0f3e-42e0-b4a4-72a14ef2982c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:46.131217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560a42-0f3e-42e0-b4a4-72a14ef2982c service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:46.134471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560a42-0f3e-42e0-b4a4-72a14ef2982c service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:46.134998 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560a42-0f3e-42e0-b4a4-72a14ef2982c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:46.155307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c560a42-0f3e-42e0-b4a4-72a14ef2982c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:46.157215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c560a42-0f3e-42e0-b4a4-72a14ef2982c service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:46.227896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 857/1694] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:46.292629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:46.316783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c560a42-0f3e-42e0-b4a4-72a14ef2982c service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:46.319924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5c560a42-0f3e-42e0-b4a4-72a14ef2982c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:46.548790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 838/1695] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 586 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:46.548790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa5619-a41a-44c6-8629-b2820711f65c None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:46.548790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa5619-a41a-44c6-8629-b2820711f65c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:46.548790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa5619-a41a-44c6-8629-b2820711f65c None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:46.548790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 839/1696] 10.222.0.27 () {54 vars in 961 bytes} [Wed Jul 20 17:57:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:57:46.553369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37024e7b-9018-4c2c-ab1e-e2a2065e06f1 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:46.568535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37024e7b-9018-4c2c-ab1e-e2a2065e06f1 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:46.572795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37024e7b-9018-4c2c-ab1e-e2a2065e06f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:46.598184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:46.635165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-37024e7b-9018-4c2c-ab1e-e2a2065e06f1 None None] MFA Rules not processed for user `de47dd54e8fc48ca9411ce4c7906b80b`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:46.639075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-37024e7b-9018-4c2c-ab1e-e2a2065e06f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:46.668410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c560a42-0f3e-42e0-b4a4-72a14ef2982c service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:46.671153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 840/1697] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:46.677362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15722258-1004-4251-8560-de389af9ba90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:46.678332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15722258-1004-4251-8560-de389af9ba90 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:46.678768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15722258-1004-4251-8560-de389af9ba90 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:46.678895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d790b4-e40b-436b-923e-a6b1dac8c941 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:46.679433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15722258-1004-4251-8560-de389af9ba90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:46.679725 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d790b4-e40b-436b-923e-a6b1dac8c941 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:46.682434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d790b4-e40b-436b-923e-a6b1dac8c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:46.683432 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-15722258-1004-4251-8560-de389af9ba90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:46.750015 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-24d790b4-e40b-436b-923e-a6b1dac8c941 None None] MFA Rules not processed for user `b218402abe6540d8b81295676199f6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:46.752095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-24d790b4-e40b-436b-923e-a6b1dac8c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:46.998045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15722258-1004-4251-8560-de389af9ba90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:47.008095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15722258-1004-4251-8560-de389af9ba90 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:47.047376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 858/1698] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:47.096159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 841/1699] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Jul 20 17:57:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:47.119659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15722258-1004-4251-8560-de389af9ba90 service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:47.147423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15722258-1004-4251-8560-de389af9ba90 service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:47.180365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8532e-c25a-4d7a-8dca-627fec6fd354 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b218402abe6540d8b81295676199f6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:47.182749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8532e-c25a-4d7a-8dca-627fec6fd354 service placement] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:47.186345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8532e-c25a-4d7a-8dca-627fec6fd354 service placement] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:47.187081 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8532e-c25a-4d7a-8dca-627fec6fd354 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:47.203683 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a8f8532e-c25a-4d7a-8dca-627fec6fd354 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:47.249246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8532e-c25a-4d7a-8dca-627fec6fd354 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:47.253696 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8532e-c25a-4d7a-8dca-627fec6fd354 service placement] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:47.297168 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 859/1700] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:47.420405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d790b4-e40b-436b-923e-a6b1dac8c941 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:47.421026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-24d790b4-e40b-436b-923e-a6b1dac8c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:47.538680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d790b4-e40b-436b-923e-a6b1dac8c941 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:47.567259 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646948a-2a6b-46d0-b6cd-c0622c8df981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:47.568861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646948a-2a6b-46d0-b6cd-c0622c8df981 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:47.569569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646948a-2a6b-46d0-b6cd-c0622c8df981 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:47.570253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646948a-2a6b-46d0-b6cd-c0622c8df981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:47.598134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646948a-2a6b-46d0-b6cd-c0622c8df981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:47.612237 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646948a-2a6b-46d0-b6cd-c0622c8df981 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:47.652611 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 842/1701] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:57:48.033633 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8532e-c25a-4d7a-8dca-627fec6fd354 service placement] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:48.036823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a8f8532e-c25a-4d7a-8dca-627fec6fd354 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:48.094897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8532e-c25a-4d7a-8dca-627fec6fd354 service placement] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:48.155693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e832f-a01a-4b21-bd07-209596559f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:48.158341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e832f-a01a-4b21-bd07-209596559f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:48.159218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e832f-a01a-4b21-bd07-209596559f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:48.159899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e832f-a01a-4b21-bd07-209596559f92 admin admin] PATH_INFO: `/v3/projects/d0e903cb32f846bea5e2f1d520c902a1` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:48.162380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e832f-a01a-4b21-bd07-209596559f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e903cb32f846bea5e2f1d520c902a1)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:48.167570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e832f-a01a-4b21-bd07-209596559f92 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:48.527764 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a67e832f-a01a-4b21-bd07-209596559f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e903cb32f846bea5e2f1d520c902a1', 'request_id': 'req-a67e832f-a01a-4b21-bd07-209596559f92'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:48.561177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a67e832f-a01a-4b21-bd07-209596559f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e903cb32f846bea5e2f1d520c902a1', 'request_id': 'req-a67e832f-a01a-4b21-bd07-209596559f92'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:48.619278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a67e832f-a01a-4b21-bd07-209596559f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e903cb32f846bea5e2f1d520c902a1', 'request_id': 'req-a67e832f-a01a-4b21-bd07-209596559f92'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:48.815770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a67e832f-a01a-4b21-bd07-209596559f92 admin admin] The token cache is being invalidate because project d0e903cb32f846bea5e2f1d520c902a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:57:48.816068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a67e832f-a01a-4b21-bd07-209596559f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:48.826473 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a67e832f-a01a-4b21-bd07-209596559f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:48.826473 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 860/1702] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:57:48 2022] DELETE /identity/v3/projects/d0e903cb32f846bea5e2f1d520c902a1 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:48.827148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfabc04-6c3e-405e-8209-dff20e8b9660 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:48.827148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfabc04-6c3e-405e-8209-dff20e8b9660 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:48.827148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfabc04-6c3e-405e-8209-dff20e8b9660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:48.872152 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-abfabc04-6c3e-405e-8209-dff20e8b9660 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:48.874645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-abfabc04-6c3e-405e-8209-dff20e8b9660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:49.084547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 843/1703] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:49.087957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31102c-55f0-4040-b696-9c3a10563e25 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:49.089034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31102c-55f0-4040-b696-9c3a10563e25 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:49.089545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31102c-55f0-4040-b696-9c3a10563e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:49.145715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-2c31102c-55f0-4040-b696-9c3a10563e25 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:49.147018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2c31102c-55f0-4040-b696-9c3a10563e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:49.149311 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37ceb7-fd57-4768-b7c3-9ec4d6adaa11 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:49.149804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37ceb7-fd57-4768-b7c3-9ec4d6adaa11 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:49.150264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37ceb7-fd57-4768-b7c3-9ec4d6adaa11 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:49.151973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 844/1704] 10.222.0.27 () {54 vars in 912 bytes} [Wed Jul 20 17:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:57:49.169380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4f1e0-8ca2-42c6-99ae-1fba08cd9532 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:49.169958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4f1e0-8ca2-42c6-99ae-1fba08cd9532 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:49.170408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4f1e0-8ca2-42c6-99ae-1fba08cd9532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:49.222489 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 861/1705] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:49.224687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31102c-55f0-4040-b696-9c3a10563e25 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:49.235614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-48d4f1e0-8ca2-42c6-99ae-1fba08cd9532 None None] MFA Rules not processed for user `11930f08a1324902a083436649660130`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:49.235778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-48d4f1e0-8ca2-42c6-99ae-1fba08cd9532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:49.274823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31102c-55f0-4040-b696-9c3a10563e25 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:49.320292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ca73-6466-4028-90b7-bd8c26a485e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:49.331056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ca73-6466-4028-90b7-bd8c26a485e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:49.345638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ca73-6466-4028-90b7-bd8c26a485e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:49.348197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ca73-6466-4028-90b7-bd8c26a485e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:49.350308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662ca73-6466-4028-90b7-bd8c26a485e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:57:49.355240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662ca73-6466-4028-90b7-bd8c26a485e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:49.365013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662ca73-6466-4028-90b7-bd8c26a485e3 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:49.374287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:49.440761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 862/1706] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:57:49.451588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ca73-6466-4028-90b7-bd8c26a485e3 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:49.507612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ca73-6466-4028-90b7-bd8c26a485e3 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:49.522637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c662c80-7289-4639-9357-1060eb76f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:49.523343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c662c80-7289-4639-9357-1060eb76f7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:49.523628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c662c80-7289-4639-9357-1060eb76f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:49.523906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c662c80-7289-4639-9357-1060eb76f7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:49.524660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c662c80-7289-4639-9357-1060eb76f7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:49.527454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c662c80-7289-4639-9357-1060eb76f7b0 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:49.678352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 845/1707] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 17:57:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:57:49.688326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 863/1708] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:49 2022] POST /identity/v3/projects => generated 363 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:49.689969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4f1e0-8ca2-42c6-99ae-1fba08cd9532 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:49.780147 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4f1e0-8ca2-42c6-99ae-1fba08cd9532 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:49.807621 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c662c80-7289-4639-9357-1060eb76f7b0 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:49.809930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2c662c80-7289-4639-9357-1060eb76f7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:50.034695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:50.107460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c662c80-7289-4639-9357-1060eb76f7b0 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:50.118444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa2b95-40aa-43c3-b6a8-0a449b7e848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:50.119447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b2f85-0494-467a-9011-d2acc5050dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:50.120401 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b2f85-0494-467a-9011-d2acc5050dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:50.120884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b2f85-0494-467a-9011-d2acc5050dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:50.121843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa2b95-40aa-43c3-b6a8-0a449b7e848b admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:50.122634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa2b95-40aa-43c3-b6a8-0a449b7e848b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:50.123365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa2b95-40aa-43c3-b6a8-0a449b7e848b admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:50.126570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa2b95-40aa-43c3-b6a8-0a449b7e848b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:50.130586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b2f85-0494-467a-9011-d2acc5050dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:50.134638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa2b95-40aa-43c3-b6a8-0a449b7e848b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:50.167844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b2f85-0494-467a-9011-d2acc5050dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:50.184530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b2f85-0494-467a-9011-d2acc5050dd6 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:50.225861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 864/1709] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:57:50.348596 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b2f85-0494-467a-9011-d2acc5050dd6 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:50.349555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 846/1710] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:49 2022] POST /identity/v3/users => generated 282 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:50.468108 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b2f85-0494-467a-9011-d2acc5050dd6 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:50.538663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4989fe1-fb4c-4e0e-adf7-5b87322b1595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:50.546184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4989fe1-fb4c-4e0e-adf7-5b87322b1595 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:50.546681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4989fe1-fb4c-4e0e-adf7-5b87322b1595 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:50.547175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4989fe1-fb4c-4e0e-adf7-5b87322b1595 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:50.566786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4989fe1-fb4c-4e0e-adf7-5b87322b1595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:50.574519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4989fe1-fb4c-4e0e-adf7-5b87322b1595 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:50.612109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 865/1711] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:50.618139 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa2b95-40aa-43c3-b6a8-0a449b7e848b admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:50.682239 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa2b95-40aa-43c3-b6a8-0a449b7e848b admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:50.700207 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc347ee-af8c-4de6-8578-7893d485b4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:50.701184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc347ee-af8c-4de6-8578-7893d485b4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:50.704831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc347ee-af8c-4de6-8578-7893d485b4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:50.705545 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc347ee-af8c-4de6-8578-7893d485b4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:50.709591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc347ee-af8c-4de6-8578-7893d485b4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:50.716101 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc347ee-af8c-4de6-8578-7893d485b4e5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:50.782820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 847/1712] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:50.796201 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4989fe1-fb4c-4e0e-adf7-5b87322b1595 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:50.810707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4989fe1-fb4c-4e0e-adf7-5b87322b1595 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:50.816537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e73ff2-9970-405a-ae34-3af2cef8e1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:50.818000 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e73ff2-9970-405a-ae34-3af2cef8e1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:50.818468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e73ff2-9970-405a-ae34-3af2cef8e1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:50.819025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e73ff2-9970-405a-ae34-3af2cef8e1f8 admin admin] PATH_INFO: `/v3/projects/4b3709fcee074f0bb0cd9fe273cbabbe/users/a9c0e8bd53ae43d7ac8056c15bb40f44/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:50.865443 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e73ff2-9970-405a-ae34-3af2cef8e1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3709fcee074f0bb0cd9fe273cbabbe, user_id=a9c0e8bd53ae43d7ac8056c15bb40f44, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:50.869564 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e73ff2-9970-405a-ae34-3af2cef8e1f8 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:51.024036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 866/1713] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:50 2022] PUT /identity/v3/projects/4b3709fcee074f0bb0cd9fe273cbabbe/users/a9c0e8bd53ae43d7ac8056c15bb40f44/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:51.037606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421af7f-a245-4e51-af4d-361a5f49c8f0 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:51.037606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421af7f-a245-4e51-af4d-361a5f49c8f0 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:51.037606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421af7f-a245-4e51-af4d-361a5f49c8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:51.157432 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae492-a1c7-4f75-8fba-1d2530163d1b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:51.157965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae492-a1c7-4f75-8fba-1d2530163d1b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:51.157965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae492-a1c7-4f75-8fba-1d2530163d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:51.174153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-4421af7f-a245-4e51-af4d-361a5f49c8f0 None None] MFA Rules not processed for user `a9c0e8bd53ae43d7ac8056c15bb40f44`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:51.176629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4421af7f-a245-4e51-af4d-361a5f49c8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:51.212083 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-7b8ae492-a1c7-4f75-8fba-1d2530163d1b None None] MFA Rules not processed for user `fed263f071864582ba96d79f75fbfb36`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:51.216402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7b8ae492-a1c7-4f75-8fba-1d2530163d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:51.349082 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 867/1714] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:51.350331 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae492-a1c7-4f75-8fba-1d2530163d1b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:51.357166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7b8ae492-a1c7-4f75-8fba-1d2530163d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:51.364137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 848/1715] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:51.365172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421af7f-a245-4e51-af4d-361a5f49c8f0 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:51.591600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae492-a1c7-4f75-8fba-1d2530163d1b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:51.597504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421af7f-a245-4e51-af4d-361a5f49c8f0 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:51.609100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d031dc-cddb-4cd9-bc43-ba9c7f3627ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:51.609100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d031dc-cddb-4cd9-bc43-ba9c7f3627ed admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:51.609304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b828ae-6ba1-4d84-8943-ed66fabe0e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:51.614976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b828ae-6ba1-4d84-8943-ed66fabe0e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:51.615549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b828ae-6ba1-4d84-8943-ed66fabe0e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:51.616143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b828ae-6ba1-4d84-8943-ed66fabe0e21 admin admin] PATH_INFO: `/v3/users/77bdbd31da9441c39b33f5e00a27ff73` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:51.618249 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b828ae-6ba1-4d84-8943-ed66fabe0e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77bdbd31da9441c39b33f5e00a27ff73)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:51.623384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b828ae-6ba1-4d84-8943-ed66fabe0e21 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:51.624825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d031dc-cddb-4cd9-bc43-ba9c7f3627ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:51.625212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d031dc-cddb-4cd9-bc43-ba9c7f3627ed admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:51.625984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d031dc-cddb-4cd9-bc43-ba9c7f3627ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:51.632601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d031dc-cddb-4cd9-bc43-ba9c7f3627ed admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:51.792106 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 849/1716] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:51 2022] POST /identity/v3/projects => generated 365 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:51.795455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d031dc-cddb-4cd9-bc43-ba9c7f3627ed admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:52.027805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-68b828ae-6ba1-4d84-8943-ed66fabe0e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77bdbd31da9441c39b33f5e00a27ff73'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:52.092502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-68b828ae-6ba1-4d84-8943-ed66fabe0e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77bdbd31da9441c39b33f5e00a27ff73'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:52.137995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-68b828ae-6ba1-4d84-8943-ed66fabe0e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77bdbd31da9441c39b33f5e00a27ff73'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:52.150599 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d031dc-cddb-4cd9-bc43-ba9c7f3627ed admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:52.172245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3430a-dc03-473d-98ed-a1004092793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:52.173314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3430a-dc03-473d-98ed-a1004092793a admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:52.174022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3430a-dc03-473d-98ed-a1004092793a admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:52.174983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3430a-dc03-473d-98ed-a1004092793a admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:52.177041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3430a-dc03-473d-98ed-a1004092793a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:52.185239 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3430a-dc03-473d-98ed-a1004092793a admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:52.293973 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-68b828ae-6ba1-4d84-8943-ed66fabe0e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77bdbd31da9441c39b33f5e00a27ff73'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:52.294608 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-68b828ae-6ba1-4d84-8943-ed66fabe0e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77bdbd31da9441c39b33f5e00a27ff73'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:52.305585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 868/1717] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:57:51 2022] DELETE /identity/v3/users/77bdbd31da9441c39b33f5e00a27ff73 => generated 0 bytes in 956 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:52.312085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820670cb-c0b2-4b92-9fea-81397a54b39c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:52.312422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820670cb-c0b2-4b92-9fea-81397a54b39c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:52.312733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820670cb-c0b2-4b92-9fea-81397a54b39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:52.353907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 850/1718] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:51 2022] POST /identity/v3/users => generated 289 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:52.358845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3430a-dc03-473d-98ed-a1004092793a admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:52.364526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-34f3430a-dc03-473d-98ed-a1004092793a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:52.399330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-820670cb-c0b2-4b92-9fea-81397a54b39c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:52.403495 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-820670cb-c0b2-4b92-9fea-81397a54b39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:52.451545 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3430a-dc03-473d-98ed-a1004092793a admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:52.559719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:52.714435 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 869/1719] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:52.730379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdece1-d13a-4d31-9b77-567559fe3f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:52.731088 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdece1-d13a-4d31-9b77-567559fe3f4f admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:52.731372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdece1-d13a-4d31-9b77-567559fe3f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:52.731646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdece1-d13a-4d31-9b77-567559fe3f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:52.732426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdece1-d13a-4d31-9b77-567559fe3f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:52.734142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdece1-d13a-4d31-9b77-567559fe3f4f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:52.746122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820670cb-c0b2-4b92-9fea-81397a54b39c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:52.747759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-820670cb-c0b2-4b92-9fea-81397a54b39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:52.781988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 851/1720] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:52.781988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdece1-d13a-4d31-9b77-567559fe3f4f admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:52.816724 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdece1-d13a-4d31-9b77-567559fe3f4f admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:52.857386 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a88c43-7e5e-4111-9026-9a6db29720c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:52.858483 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a88c43-7e5e-4111-9026-9a6db29720c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:52.858777 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a88c43-7e5e-4111-9026-9a6db29720c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:52.859077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a88c43-7e5e-4111-9026-9a6db29720c1 admin admin] PATH_INFO: `/v3/projects/28a0b4410e9a490d9f45ff253f0e1b6d/users/7bbc64b940784ce78f37f3854d74b376/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:52.927763 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a88c43-7e5e-4111-9026-9a6db29720c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a0b4410e9a490d9f45ff253f0e1b6d, user_id=7bbc64b940784ce78f37f3854d74b376, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:52.930842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a88c43-7e5e-4111-9026-9a6db29720c1 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:52.965346 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820670cb-c0b2-4b92-9fea-81397a54b39c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:52.981251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591e786-e8d1-4a47-a3a7-c536421c2021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:52.982037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591e786-e8d1-4a47-a3a7-c536421c2021 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:52.982466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591e786-e8d1-4a47-a3a7-c536421c2021 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:52.982815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591e786-e8d1-4a47-a3a7-c536421c2021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:53.012371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:53.024344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591e786-e8d1-4a47-a3a7-c536421c2021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:53.026612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591e786-e8d1-4a47-a3a7-c536421c2021 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:53.043334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 870/1721] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:57:53.086973 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc274ed-af86-4851-ac1c-4c994295956b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:53.087804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc274ed-af86-4851-ac1c-4c994295956b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:53.088363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc274ed-af86-4851-ac1c-4c994295956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:53.101065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 852/1722] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:52 2022] PUT /identity/v3/projects/28a0b4410e9a490d9f45ff253f0e1b6d/users/7bbc64b940784ce78f37f3854d74b376/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:53.106708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a88c43-7e5e-4111-9026-9a6db29720c1 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:53.115517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-acc274ed-af86-4851-ac1c-4c994295956b None None] MFA Rules not processed for user `de47dd54e8fc48ca9411ce4c7906b80b`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:53.117309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-acc274ed-af86-4851-ac1c-4c994295956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:53.220986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 871/1723] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:57:53.376673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a88c43-7e5e-4111-9026-9a6db29720c1 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:53.386911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29338a8-e457-459d-a1d8-ba44bc80df24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:53.387707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29338a8-e457-459d-a1d8-ba44bc80df24 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:53.388112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29338a8-e457-459d-a1d8-ba44bc80df24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:53.390767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29338a8-e457-459d-a1d8-ba44bc80df24 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:53.391784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29338a8-e457-459d-a1d8-ba44bc80df24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:53.395190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29338a8-e457-459d-a1d8-ba44bc80df24 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:53.414621 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 853/1724] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:53.422087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc274ed-af86-4851-ac1c-4c994295956b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:53.451221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc274ed-af86-4851-ac1c-4c994295956b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:53.466456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f5bd1-7d0b-4a1e-a394-107fdd5bceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:53.474855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f5bd1-7d0b-4a1e-a394-107fdd5bceb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:53.474855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f5bd1-7d0b-4a1e-a394-107fdd5bceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:53.474855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f5bd1-7d0b-4a1e-a394-107fdd5bceb8 admin admin] PATH_INFO: `/v3/projects/28a0b4410e9a490d9f45ff253f0e1b6d/users/7bbc64b940784ce78f37f3854d74b376/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:53.481427 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f5bd1-7d0b-4a1e-a394-107fdd5bceb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a0b4410e9a490d9f45ff253f0e1b6d, user_id=7bbc64b940784ce78f37f3854d74b376, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:53.510042 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f5bd1-7d0b-4a1e-a394-107fdd5bceb8 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:53.568673 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 872/1725] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:53 2022] PUT /identity/v3/projects/28a0b4410e9a490d9f45ff253f0e1b6d/users/7bbc64b940784ce78f37f3854d74b376/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:53.580187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5ac87-d184-46de-9c40-00d5ead35cd7 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:53.583832 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5ac87-d184-46de-9c40-00d5ead35cd7 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:53.583832 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5ac87-d184-46de-9c40-00d5ead35cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:53.736429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-edf5ac87-d184-46de-9c40-00d5ead35cd7 None None] MFA Rules not processed for user `7bbc64b940784ce78f37f3854d74b376`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:53.745162 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-edf5ac87-d184-46de-9c40-00d5ead35cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:54.086314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 854/1726] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:54.110666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f5bd1-7d0b-4a1e-a394-107fdd5bceb8 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:54.113072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-333f5bd1-7d0b-4a1e-a394-107fdd5bceb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:54.342573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f5bd1-7d0b-4a1e-a394-107fdd5bceb8 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:54.358442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e8490-0ee9-4cba-b76f-956a7b7be979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:54.359319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e8490-0ee9-4cba-b76f-956a7b7be979 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:54.359753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e8490-0ee9-4cba-b76f-956a7b7be979 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:54.360205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e8490-0ee9-4cba-b76f-956a7b7be979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:54.381410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e8490-0ee9-4cba-b76f-956a7b7be979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:54.383506 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e8490-0ee9-4cba-b76f-956a7b7be979 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:54.422004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 873/1727] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:54.977706 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5ac87-d184-46de-9c40-00d5ead35cd7 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:54.978828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-edf5ac87-d184-46de-9c40-00d5ead35cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:54.999419 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5ac87-d184-46de-9c40-00d5ead35cd7 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:55.010076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e8490-0ee9-4cba-b76f-956a7b7be979 service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:55.011670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-241e8490-0ee9-4cba-b76f-956a7b7be979 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:55.025776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e434ef-7219-4651-b096-54ea9a3bd14e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:55.033399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e434ef-7219-4651-b096-54ea9a3bd14e service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:55.033690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e434ef-7219-4651-b096-54ea9a3bd14e service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:55.033975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e434ef-7219-4651-b096-54ea9a3bd14e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:55.039887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a8e434ef-7219-4651-b096-54ea9a3bd14e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:55.207197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e8490-0ee9-4cba-b76f-956a7b7be979 service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:55.243433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e434ef-7219-4651-b096-54ea9a3bd14e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:55.245009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e434ef-7219-4651-b096-54ea9a3bd14e service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:55.247122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:55.248256 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:55.251682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:55.252234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8 admin admin] PATH_INFO: `/v3/projects/73ddf54699e24150bd73086d56aab221` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:55.257933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ddf54699e24150bd73086d56aab221)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:55.262769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:55.278661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 855/1728] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:57:55.430081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686980e-36ea-4422-8dde-baf10935b2d9 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:55.430537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686980e-36ea-4422-8dde-baf10935b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:55.432129 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686980e-36ea-4422-8dde-baf10935b2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:55.507449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-3686980e-36ea-4422-8dde-baf10935b2d9 None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:55.510104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3686980e-36ea-4422-8dde-baf10935b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:55.599903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ddf54699e24150bd73086d56aab221', 'request_id': 'req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:55.608011 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ddf54699e24150bd73086d56aab221', 'request_id': 'req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:55.617913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ddf54699e24150bd73086d56aab221', 'request_id': 'req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:55.731917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 856/1729] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 17:57:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:55.754309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8 admin admin] The token cache is being invalidate because project 73ddf54699e24150bd73086d56aab221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:57:55.756927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:55.757978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-aaf042d2-ca2d-4d28-8c12-4007ad3197c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:55.762264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 874/1730] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:57:55 2022] DELETE /identity/v3/projects/73ddf54699e24150bd73086d56aab221 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:57:55.774827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c67dd4-9394-4879-99ac-9ad1b484b90c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:55.776039 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c67dd4-9394-4879-99ac-9ad1b484b90c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:55.777016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c67dd4-9394-4879-99ac-9ad1b484b90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:55.823145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-82c67dd4-9394-4879-99ac-9ad1b484b90c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:55.825684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-82c67dd4-9394-4879-99ac-9ad1b484b90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:56.083138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 857/1731] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:56.085262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfbf0e-01ff-4098-a0df-08cda452c4aa None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:56.085963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfbf0e-01ff-4098-a0df-08cda452c4aa None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:56.086091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfbf0e-01ff-4098-a0df-08cda452c4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:56.123713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-1ecfbf0e-01ff-4098-a0df-08cda452c4aa None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:56.126305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-1ecfbf0e-01ff-4098-a0df-08cda452c4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:56.139822 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 875/1732] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:56.146450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c67dd4-9394-4879-99ac-9ad1b484b90c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:56.168923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c67dd4-9394-4879-99ac-9ad1b484b90c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:56.183541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73539370-affd-4db4-aa98-1de3fa7496b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:56.184824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73539370-affd-4db4-aa98-1de3fa7496b0 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:56.185353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73539370-affd-4db4-aa98-1de3fa7496b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:56.185916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73539370-affd-4db4-aa98-1de3fa7496b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:56.187603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73539370-affd-4db4-aa98-1de3fa7496b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:57:56.202811 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73539370-affd-4db4-aa98-1de3fa7496b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:56.203569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:56.213241 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73539370-affd-4db4-aa98-1de3fa7496b0 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:56.251389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 858/1733] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:57:56.253182 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfbf0e-01ff-4098-a0df-08cda452c4aa None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:56.305871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfbf0e-01ff-4098-a0df-08cda452c4aa None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:56.305871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a583b9-bec8-4329-8622-a5ff9d568e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:56.305871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a583b9-bec8-4329-8622-a5ff9d568e44 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:56.305871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a583b9-bec8-4329-8622-a5ff9d568e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:56.308748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a583b9-bec8-4329-8622-a5ff9d568e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:56.308748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a583b9-bec8-4329-8622-a5ff9d568e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:56.308748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a583b9-bec8-4329-8622-a5ff9d568e44 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:56.423979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efe4c9-580c-4619-8027-0589b2ca7a04 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:56.424710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efe4c9-580c-4619-8027-0589b2ca7a04 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:56.425336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efe4c9-580c-4619-8027-0589b2ca7a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:56.457187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-89efe4c9-580c-4619-8027-0589b2ca7a04 None None] MFA Rules not processed for user `f1d5e5f7ad994b8481b8c5e885db1739`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:56.458843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-89efe4c9-580c-4619-8027-0589b2ca7a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:56.637556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 876/1734] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:56 2022] POST /identity/v3/projects => generated 381 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:56.644569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a583b9-bec8-4329-8622-a5ff9d568e44 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:56.655224 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c8a583b9-bec8-4329-8622-a5ff9d568e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:56.721719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 859/1735] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:56.746157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efe4c9-580c-4619-8027-0589b2ca7a04 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:56.762050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-89efe4c9-580c-4619-8027-0589b2ca7a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:56.924711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:57.081466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a583b9-bec8-4329-8622-a5ff9d568e44 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:57.096458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384315d-49c5-4d9c-9486-513143fe733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:57.103120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384315d-49c5-4d9c-9486-513143fe733f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:57.104588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384315d-49c5-4d9c-9486-513143fe733f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:57.105335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384315d-49c5-4d9c-9486-513143fe733f admin admin] PATH_INFO: `/v3/users/20abbff633f74157ae014e1589ee06d9` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:57.111596 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384315d-49c5-4d9c-9486-513143fe733f admin admin] RBAC: Authorizing `identity:delete_user(user_id=20abbff633f74157ae014e1589ee06d9)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:57.117458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384315d-49c5-4d9c-9486-513143fe733f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:57.183285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efe4c9-580c-4619-8027-0589b2ca7a04 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:57.454712 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b6c55-d2f0-4489-aec3-4d887233bae0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:57.455612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6c55-d2f0-4489-aec3-4d887233bae0 service swift] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:57.456045 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6c55-d2f0-4489-aec3-4d887233bae0 service swift] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:57.456529 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6c55-d2f0-4489-aec3-4d887233bae0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:57.462629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f384315d-49c5-4d9c-9486-513143fe733f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20abbff633f74157ae014e1589ee06d9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:57.465110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e09b6c55-d2f0-4489-aec3-4d887233bae0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:57.523426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f384315d-49c5-4d9c-9486-513143fe733f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20abbff633f74157ae014e1589ee06d9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:57.557086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f384315d-49c5-4d9c-9486-513143fe733f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20abbff633f74157ae014e1589ee06d9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:57.630225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:57.738788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b6c55-d2f0-4489-aec3-4d887233bae0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:57.750880 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b6c55-d2f0-4489-aec3-4d887233bae0 service swift] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:57.766209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 860/1736] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 17:57:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1049 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 17:57:57.770568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b6c55-d2f0-4489-aec3-4d887233bae0 service swift] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:57.796728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f384315d-49c5-4d9c-9486-513143fe733f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20abbff633f74157ae014e1589ee06d9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:57.798195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f384315d-49c5-4d9c-9486-513143fe733f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20abbff633f74157ae014e1589ee06d9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:57:57.833752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b6c55-d2f0-4489-aec3-4d887233bae0 service swift] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:57.872252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 877/1737] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:57:56 2022] DELETE /identity/v3/users/20abbff633f74157ae014e1589ee06d9 => generated 0 bytes in 1234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:57.902227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89a81-c1a9-43c7-a374-edd89bd8c9f6 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:57.902698 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89a81-c1a9-43c7-a374-edd89bd8c9f6 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:57.903176 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89a81-c1a9-43c7-a374-edd89bd8c9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:58.161307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-04f89a81-c1a9-43c7-a374-edd89bd8c9f6 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:58.161307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-04f89a81-c1a9-43c7-a374-edd89bd8c9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:58.182228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f2968-6391-4cc5-946a-bb60062ba7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:58.183419 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f2968-6391-4cc5-946a-bb60062ba7fd admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:58.184787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f2968-6391-4cc5-946a-bb60062ba7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:58.186498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f2968-6391-4cc5-946a-bb60062ba7fd admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:58.187610 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f2968-6391-4cc5-946a-bb60062ba7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:58.197877 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f2968-6391-4cc5-946a-bb60062ba7fd admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:58.221391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 878/1738] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:58.396952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89a81-c1a9-43c7-a374-edd89bd8c9f6 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:58.400535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-04f89a81-c1a9-43c7-a374-edd89bd8c9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:58.498150 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 861/1739] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:57 2022] POST /identity/v3/users => generated 291 bytes in 718 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:57:58.502214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f2968-6391-4cc5-946a-bb60062ba7fd admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:58.516976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-532f2968-6391-4cc5-946a-bb60062ba7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:58.573198 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f2968-6391-4cc5-946a-bb60062ba7fd admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:58.601378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee28b29-d85b-4893-baf7-9756d20edc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:58.602555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee28b29-d85b-4893-baf7-9756d20edc5c admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:58.603637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee28b29-d85b-4893-baf7-9756d20edc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:58.604119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee28b29-d85b-4893-baf7-9756d20edc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:58.605214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee28b29-d85b-4893-baf7-9756d20edc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:58.614663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee28b29-d85b-4893-baf7-9756d20edc5c admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:58.651321 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 862/1740] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:57:58.664397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee28b29-d85b-4893-baf7-9756d20edc5c admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:58.681829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee28b29-d85b-4893-baf7-9756d20edc5c admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:58.698341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89a81-c1a9-43c7-a374-edd89bd8c9f6 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:58.698969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132e884-03ee-4055-9dbf-29e8b46c56b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:58.699753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132e884-03ee-4055-9dbf-29e8b46c56b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:58.700784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132e884-03ee-4055-9dbf-29e8b46c56b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:58.701395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132e884-03ee-4055-9dbf-29e8b46c56b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:58.702615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132e884-03ee-4055-9dbf-29e8b46c56b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:58.704772 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132e884-03ee-4055-9dbf-29e8b46c56b2 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:58.713655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa577e5a-baaf-4371-9744-1e59e751e738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:58.720183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa577e5a-baaf-4371-9744-1e59e751e738 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:58.720537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa577e5a-baaf-4371-9744-1e59e751e738 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:58.723517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa577e5a-baaf-4371-9744-1e59e751e738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:58.747530 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 863/1741] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:57:58.752078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132e884-03ee-4055-9dbf-29e8b46c56b2 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:58.771600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa577e5a-baaf-4371-9744-1e59e751e738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:58.784716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa577e5a-baaf-4371-9744-1e59e751e738 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:58.797998 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132e884-03ee-4055-9dbf-29e8b46c56b2 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:58.812845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73930-bc21-4629-82e6-e39e21f8a201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:58.814683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73930-bc21-4629-82e6-e39e21f8a201 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:58.815275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73930-bc21-4629-82e6-e39e21f8a201 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:58.815787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73930-bc21-4629-82e6-e39e21f8a201 admin admin] PATH_INFO: `/v3/projects/4e8500222884485a9d692ce7b6d10513/users/ea83002c642947dd93b9bfa320a374e2/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:58.820272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 879/1742] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:57:58.857022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73930-bc21-4629-82e6-e39e21f8a201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8500222884485a9d692ce7b6d10513, user_id=ea83002c642947dd93b9bfa320a374e2, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:58.862139 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73930-bc21-4629-82e6-e39e21f8a201 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:59.019099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 864/1743] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:57:58 2022] PUT /identity/v3/projects/4e8500222884485a9d692ce7b6d10513/users/ea83002c642947dd93b9bfa320a374e2/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:57:59.037356 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ba2eb-24e0-41aa-a98d-7115e1c5e97c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:59.038009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:57:59.039070 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ba2eb-24e0-41aa-a98d-7115e1c5e97c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:59.039364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ba2eb-24e0-41aa-a98d-7115e1c5e97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:59.170874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-391ba2eb-24e0-41aa-a98d-7115e1c5e97c None None] MFA Rules not processed for user `ea83002c642947dd93b9bfa320a374e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:57:59.173326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-391ba2eb-24e0-41aa-a98d-7115e1c5e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:57:59.466693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 880/1744] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:57:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:57:59.468164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73930-bc21-4629-82e6-e39e21f8a201 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:57:59.735301 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73930-bc21-4629-82e6-e39e21f8a201 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:57:59.754097 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85437e55-3b71-49dd-863e-85ff79d5a109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:57:59.755144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85437e55-3b71-49dd-863e-85ff79d5a109 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:57:59.755594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85437e55-3b71-49dd-863e-85ff79d5a109 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:57:59.756036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85437e55-3b71-49dd-863e-85ff79d5a109 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:57:59.757053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85437e55-3b71-49dd-863e-85ff79d5a109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:57:59.761941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85437e55-3b71-49dd-863e-85ff79d5a109 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:57:59.989670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 865/1745] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:57:59 2022] POST /identity/v3/projects => generated 381 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:00.006501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ba2eb-24e0-41aa-a98d-7115e1c5e97c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:00.053633 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ba2eb-24e0-41aa-a98d-7115e1c5e97c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:00.232228 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8241ff5-3cea-4841-bb96-81075fc9ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:00.233412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8241ff5-3cea-4841-bb96-81075fc9ec6b admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:00.235185 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8241ff5-3cea-4841-bb96-81075fc9ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:00.235987 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8241ff5-3cea-4841-bb96-81075fc9ec6b admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:00.237612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8241ff5-3cea-4841-bb96-81075fc9ec6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:00.250831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8241ff5-3cea-4841-bb96-81075fc9ec6b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:00.653168 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 881/1746] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:57:59 2022] POST /identity/v3/users => generated 297 bytes in 654 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:00.659672 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85437e55-3b71-49dd-863e-85ff79d5a109 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:00.720640 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85437e55-3b71-49dd-863e-85ff79d5a109 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:00.761392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ce130-8c64-40a7-b401-253b78373a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:00.766758 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ce130-8c64-40a7-b401-253b78373a58 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:00.785341 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ce130-8c64-40a7-b401-253b78373a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:00.785811 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ce130-8c64-40a7-b401-253b78373a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:00.787210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ce130-8c64-40a7-b401-253b78373a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:00.803115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ce130-8c64-40a7-b401-253b78373a58 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:00.873484 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 866/1747] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:00.875843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8241ff5-3cea-4841-bb96-81075fc9ec6b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:00.921048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8241ff5-3cea-4841-bb96-81075fc9ec6b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:00.978867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b2df5-95ec-49c0-9ab2-74e1f7c59099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:00.980669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b2df5-95ec-49c0-9ab2-74e1f7c59099 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:00.981164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b2df5-95ec-49c0-9ab2-74e1f7c59099 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:00.981650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b2df5-95ec-49c0-9ab2-74e1f7c59099 admin admin] PATH_INFO: `/v3/projects/b2245ff9dedb4dba92d41a2ec19d42fd/users/6f8595b5c5b74f6581c036ecc90f614b/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:01.063718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b2df5-95ec-49c0-9ab2-74e1f7c59099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2245ff9dedb4dba92d41a2ec19d42fd, user_id=6f8595b5c5b74f6581c036ecc90f614b, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:01.090614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b2df5-95ec-49c0-9ab2-74e1f7c59099 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:01.161437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a97d3-88c8-4a83-9255-6a19adfc1ee6 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:01.162445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a97d3-88c8-4a83-9255-6a19adfc1ee6 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:01.163136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a97d3-88c8-4a83-9255-6a19adfc1ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:01.224972 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 882/1748] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:00 2022] PUT /identity/v3/projects/b2245ff9dedb4dba92d41a2ec19d42fd/users/6f8595b5c5b74f6581c036ecc90f614b/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:01.237281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b2df5-95ec-49c0-9ab2-74e1f7c59099 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:01.268458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d43a97d3-88c8-4a83-9255-6a19adfc1ee6 None None] MFA Rules not processed for user `11930f08a1324902a083436649660130`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:01.275418 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d43a97d3-88c8-4a83-9255-6a19adfc1ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:01.322934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:01.536430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b2df5-95ec-49c0-9ab2-74e1f7c59099 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:01.549217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9c28-eb84-4d45-a67e-c800e5354ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:01.554507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9c28-eb84-4d45-a67e-c800e5354ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:01.562730 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9c28-eb84-4d45-a67e-c800e5354ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:01.564316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9c28-eb84-4d45-a67e-c800e5354ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:01.569085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e9c28-eb84-4d45-a67e-c800e5354ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:01.570112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 867/1749] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Jul 20 17:58:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:01.586903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e9c28-eb84-4d45-a67e-c800e5354ad4 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:01.619468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 883/1750] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:01.625582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a97d3-88c8-4a83-9255-6a19adfc1ee6 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:01.649197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a97d3-88c8-4a83-9255-6a19adfc1ee6 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:01.667410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9c28-eb84-4d45-a67e-c800e5354ad4 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:01.670050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e49e9c28-eb84-4d45-a67e-c800e5354ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:01.681319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1e2f6-6c2e-4d05-919d-07e69b13cb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:01.684359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1e2f6-6c2e-4d05-919d-07e69b13cb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:01.692632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1e2f6-6c2e-4d05-919d-07e69b13cb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:01.692632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1e2f6-6c2e-4d05-919d-07e69b13cb6d admin admin] PATH_INFO: `/v3/projects/b2245ff9dedb4dba92d41a2ec19d42fd/users/6f8595b5c5b74f6581c036ecc90f614b/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:01.692632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1e2f6-6c2e-4d05-919d-07e69b13cb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2245ff9dedb4dba92d41a2ec19d42fd, user_id=6f8595b5c5b74f6581c036ecc90f614b, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:01.695681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9c28-eb84-4d45-a67e-c800e5354ad4 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:01.701824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1e2f6-6c2e-4d05-919d-07e69b13cb6d admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:01.710543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3068f-40dd-43b4-a8d5-bc77df35a004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:01.711639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3068f-40dd-43b4-a8d5-bc77df35a004 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:01.713029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3068f-40dd-43b4-a8d5-bc77df35a004 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:01.713455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3068f-40dd-43b4-a8d5-bc77df35a004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:01.750984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 868/1751] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:01 2022] PUT /identity/v3/projects/b2245ff9dedb4dba92d41a2ec19d42fd/users/6f8595b5c5b74f6581c036ecc90f614b/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:01.751093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3068f-40dd-43b4-a8d5-bc77df35a004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:01.753442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3068f-40dd-43b4-a8d5-bc77df35a004 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:01.779651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47864a77-9713-4cda-8647-1b3520074c86 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:01.779819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47864a77-9713-4cda-8647-1b3520074c86 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:01.780121 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47864a77-9713-4cda-8647-1b3520074c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:01.793339 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 884/1752] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:01.851632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-47864a77-9713-4cda-8647-1b3520074c86 None None] MFA Rules not processed for user `6f8595b5c5b74f6581c036ecc90f614b`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:01.855950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-47864a77-9713-4cda-8647-1b3520074c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:02.085707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 869/1753] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:02.098455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3068f-40dd-43b4-a8d5-bc77df35a004 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:02.100176 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7ce3068f-40dd-43b4-a8d5-bc77df35a004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:02.246144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:02.387935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3068f-40dd-43b4-a8d5-bc77df35a004 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:02.707399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b0df6-7cd5-459e-a537-153414816b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:02.714305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b0df6-7cd5-459e-a537-153414816b22 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:02.716409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b0df6-7cd5-459e-a537-153414816b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:02.720440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b0df6-7cd5-459e-a537-153414816b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:02.794678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b0df6-7cd5-459e-a537-153414816b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:02.796149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b0df6-7cd5-459e-a537-153414816b22 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:02.819995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 885/1754] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:03.330376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47864a77-9713-4cda-8647-1b3520074c86 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:03.332889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-47864a77-9713-4cda-8647-1b3520074c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:03.639919 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b0df6-7cd5-459e-a537-153414816b22 service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:03.657422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b0df6-7cd5-459e-a537-153414816b22 service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:03.684342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3baf54-8538-47b5-adb6-6b98a6fe27eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:03.685391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3baf54-8538-47b5-adb6-6b98a6fe27eb service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:03.686566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3baf54-8538-47b5-adb6-6b98a6fe27eb service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:03.688458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3baf54-8538-47b5-adb6-6b98a6fe27eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:03.744317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47864a77-9713-4cda-8647-1b3520074c86 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:03.766948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ae510-5b33-49c4-a875-543a5fa4ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:03.789732 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ae510-5b33-49c4-a875-543a5fa4ac70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:03.791765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ae510-5b33-49c4-a875-543a5fa4ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:03.793851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ae510-5b33-49c4-a875-543a5fa4ac70 admin admin] PATH_INFO: `/v3/projects/8efc9c83db3047cfa90f94674f01b179` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:03.796977 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ae510-5b33-49c4-a875-543a5fa4ac70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8efc9c83db3047cfa90f94674f01b179)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:03.800543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ae510-5b33-49c4-a875-543a5fa4ac70 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:03.911574 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3baf54-8538-47b5-adb6-6b98a6fe27eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:03.913434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3baf54-8538-47b5-adb6-6b98a6fe27eb service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:03.957646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 886/1755] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:04.080310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3f2ae510-5b33-49c4-a875-543a5fa4ac70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8efc9c83db3047cfa90f94674f01b179', 'request_id': 'req-3f2ae510-5b33-49c4-a875-543a5fa4ac70'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:04.089354 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3f2ae510-5b33-49c4-a875-543a5fa4ac70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8efc9c83db3047cfa90f94674f01b179', 'request_id': 'req-3f2ae510-5b33-49c4-a875-543a5fa4ac70'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:04.200181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3f2ae510-5b33-49c4-a875-543a5fa4ac70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8efc9c83db3047cfa90f94674f01b179', 'request_id': 'req-3f2ae510-5b33-49c4-a875-543a5fa4ac70'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:04.243437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3f2ae510-5b33-49c4-a875-543a5fa4ac70 admin admin] The token cache is being invalidate because project 8efc9c83db3047cfa90f94674f01b179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:04.243927 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3f2ae510-5b33-49c4-a875-543a5fa4ac70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:04.245228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3f2ae510-5b33-49c4-a875-543a5fa4ac70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:04.248368 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 870/1756] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:03 2022] DELETE /identity/v3/projects/8efc9c83db3047cfa90f94674f01b179 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:04.254308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3baf54-8538-47b5-adb6-6b98a6fe27eb service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:04.280061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3baf54-8538-47b5-adb6-6b98a6fe27eb service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:04.458733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628debd-e6ab-4c00-8b69-d85840e8ae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:04.458733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628debd-e6ab-4c00-8b69-d85840e8ae23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:04.458733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628debd-e6ab-4c00-8b69-d85840e8ae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:04.459353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628debd-e6ab-4c00-8b69-d85840e8ae23 admin admin] PATH_INFO: `/v3/users/9a2285e6e31c4c2b8ffc58055dde556b` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:04.474682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628debd-e6ab-4c00-8b69-d85840e8ae23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2285e6e31c4c2b8ffc58055dde556b)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:04.485150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628debd-e6ab-4c00-8b69-d85840e8ae23 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:04.871016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:04.951112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a628debd-e6ab-4c00-8b69-d85840e8ae23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2285e6e31c4c2b8ffc58055dde556b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:04.997859 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a628debd-e6ab-4c00-8b69-d85840e8ae23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2285e6e31c4c2b8ffc58055dde556b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:05.032314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:05.032968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a628debd-e6ab-4c00-8b69-d85840e8ae23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2285e6e31c4c2b8ffc58055dde556b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:05.167716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a628debd-e6ab-4c00-8b69-d85840e8ae23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2285e6e31c4c2b8ffc58055dde556b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:05.168517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a628debd-e6ab-4c00-8b69-d85840e8ae23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2285e6e31c4c2b8ffc58055dde556b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:05.184425 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 887/1757] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:04 2022] DELETE /identity/v3/users/9a2285e6e31c4c2b8ffc58055dde556b => generated 0 bytes in 931 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:05.614106 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5bce6-3b7e-4329-b667-d87a8724100d None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:05.620943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5bce6-3b7e-4329-b667-d87a8724100d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:05.621417 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5bce6-3b7e-4329-b667-d87a8724100d None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:05.630168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 871/1758] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 17:58:05 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:58:05.658576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b3e2-2c22-4bd7-9315-82f557dc9e43 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:05.659233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b3e2-2c22-4bd7-9315-82f557dc9e43 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:05.659749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b3e2-2c22-4bd7-9315-82f557dc9e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:05.726897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-7a34b3e2-2c22-4bd7-9315-82f557dc9e43 None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:05.738077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7a34b3e2-2c22-4bd7-9315-82f557dc9e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:06.042796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 888/1759] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 17:58:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:06.606114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5bce6-3b7e-4329-b667-d87a8724100d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:06.609905 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9cf5bce6-3b7e-4329-b667-d87a8724100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:06.638872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5bce6-3b7e-4329-b667-d87a8724100d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:06.648433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1bb4f-95e0-44c5-8b0a-6225ff9f96bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:06.650450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1bb4f-95e0-44c5-8b0a-6225ff9f96bc service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:06.650973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1bb4f-95e0-44c5-8b0a-6225ff9f96bc service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:06.654155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1bb4f-95e0-44c5-8b0a-6225ff9f96bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:06.671262 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1bb4f-95e0-44c5-8b0a-6225ff9f96bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:06.677265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1bb4f-95e0-44c5-8b0a-6225ff9f96bc service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:06.684536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:06.715835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 872/1760] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:06.932995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:07.877084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34b3e2-2c22-4bd7-9315-82f557dc9e43 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:07.882062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7a34b3e2-2c22-4bd7-9315-82f557dc9e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:08.148509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34b3e2-2c22-4bd7-9315-82f557dc9e43 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:08.169312 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d580f-9b53-4217-b96d-e623fcdb613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:08.170628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d580f-9b53-4217-b96d-e623fcdb613f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:08.173556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d580f-9b53-4217-b96d-e623fcdb613f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:08.175147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d580f-9b53-4217-b96d-e623fcdb613f admin admin] PATH_INFO: `/v3/projects/2fb2dcb8a3ab4ddc94889c315970b163` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:08.181875 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d580f-9b53-4217-b96d-e623fcdb613f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb2dcb8a3ab4ddc94889c315970b163)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:08.184830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d580f-9b53-4217-b96d-e623fcdb613f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:08.199585 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:08.462569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c06d580f-9b53-4217-b96d-e623fcdb613f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb2dcb8a3ab4ddc94889c315970b163', 'request_id': 'req-c06d580f-9b53-4217-b96d-e623fcdb613f'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:08.478414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c06d580f-9b53-4217-b96d-e623fcdb613f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb2dcb8a3ab4ddc94889c315970b163', 'request_id': 'req-c06d580f-9b53-4217-b96d-e623fcdb613f'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:08.497565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c06d580f-9b53-4217-b96d-e623fcdb613f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb2dcb8a3ab4ddc94889c315970b163', 'request_id': 'req-c06d580f-9b53-4217-b96d-e623fcdb613f'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:08.688724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c06d580f-9b53-4217-b96d-e623fcdb613f admin admin] The token cache is being invalidate because project 2fb2dcb8a3ab4ddc94889c315970b163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:08.688724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c06d580f-9b53-4217-b96d-e623fcdb613f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:08.688724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c06d580f-9b53-4217-b96d-e623fcdb613f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:08.694208 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 889/1761] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:07 2022] DELETE /identity/v3/projects/2fb2dcb8a3ab4ddc94889c315970b163 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:08.695258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde4be-9f35-48ce-aae8-a6ffd326ee28 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:08.695601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde4be-9f35-48ce-aae8-a6ffd326ee28 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:08.695938 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde4be-9f35-48ce-aae8-a6ffd326ee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:08.745867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-3bdde4be-9f35-48ce-aae8-a6ffd326ee28 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:08.750248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3bdde4be-9f35-48ce-aae8-a6ffd326ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:09.053772 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 873/1762] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:09.066799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a67d1-7c8a-476c-a866-ff6a62f14d78 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:09.067372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a67d1-7c8a-476c-a866-ff6a62f14d78 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:09.067775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a67d1-7c8a-476c-a866-ff6a62f14d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:09.138155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-429a67d1-7c8a-476c-a866-ff6a62f14d78 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:09.163722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-429a67d1-7c8a-476c-a866-ff6a62f14d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:09.199879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 890/1763] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:09.206773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde4be-9f35-48ce-aae8-a6ffd326ee28 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:09.252899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde4be-9f35-48ce-aae8-a6ffd326ee28 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:09.277961 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4af2ce-674f-4835-bae5-97a584731130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:09.280122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4af2ce-674f-4835-bae5-97a584731130 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:09.285903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4af2ce-674f-4835-bae5-97a584731130 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:09.286734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4af2ce-674f-4835-bae5-97a584731130 admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:09.288524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4af2ce-674f-4835-bae5-97a584731130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:09.290813 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4af2ce-674f-4835-bae5-97a584731130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:09.300330 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4af2ce-674f-4835-bae5-97a584731130 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:09.386103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 874/1764] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:58:09.386429 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a67d1-7c8a-476c-a866-ff6a62f14d78 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:09.397391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a67d1-7c8a-476c-a866-ff6a62f14d78 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:09.419104 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d39975-e598-49c5-a3d5-7aca89748d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:09.421862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d39975-e598-49c5-a3d5-7aca89748d2f admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:09.422427 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d39975-e598-49c5-a3d5-7aca89748d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:09.423356 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d39975-e598-49c5-a3d5-7aca89748d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:09.425263 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d39975-e598-49c5-a3d5-7aca89748d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:09.432365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d39975-e598-49c5-a3d5-7aca89748d2f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:09.660188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 891/1765] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:09 2022] POST /identity/v3/projects => generated 377 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:09.669581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4af2ce-674f-4835-bae5-97a584731130 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:09.696931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4af2ce-674f-4835-bae5-97a584731130 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:09.778236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:09.910918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7374a6-4d6d-4294-8824-22dc0e4bff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:09.913029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7374a6-4d6d-4294-8824-22dc0e4bff33 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:09.914423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7374a6-4d6d-4294-8824-22dc0e4bff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:09.915821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7374a6-4d6d-4294-8824-22dc0e4bff33 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:09.918852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7374a6-4d6d-4294-8824-22dc0e4bff33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:09.925953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7374a6-4d6d-4294-8824-22dc0e4bff33 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:10.106044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 875/1766] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:09 2022] POST /identity/v3/users => generated 289 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:10.107354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d39975-e598-49c5-a3d5-7aca89748d2f admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:10.123693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d39975-e598-49c5-a3d5-7aca89748d2f admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:10.149935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f7d0a-bad4-4df7-bd4e-bc0bd273166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:10.149935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f7d0a-bad4-4df7-bd4e-bc0bd273166c admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:10.149935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f7d0a-bad4-4df7-bd4e-bc0bd273166c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:10.149935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f7d0a-bad4-4df7-bd4e-bc0bd273166c admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:10.150425 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f7d0a-bad4-4df7-bd4e-bc0bd273166c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:10.150425 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f7d0a-bad4-4df7-bd4e-bc0bd273166c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:10.187181 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 892/1767] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:10.188915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7374a6-4d6d-4294-8824-22dc0e4bff33 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:10.209332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7374a6-4d6d-4294-8824-22dc0e4bff33 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:10.239462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223891d-7748-4321-80e7-7366b84c3882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:10.240242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223891d-7748-4321-80e7-7366b84c3882 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:10.240554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223891d-7748-4321-80e7-7366b84c3882 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:10.240844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223891d-7748-4321-80e7-7366b84c3882 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:10.241653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223891d-7748-4321-80e7-7366b84c3882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:10.243429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223891d-7748-4321-80e7-7366b84c3882 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:10.280140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 876/1768] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:10.284401 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f7d0a-bad4-4df7-bd4e-bc0bd273166c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:10.321283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f7d0a-bad4-4df7-bd4e-bc0bd273166c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:10.340361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bed1d-184d-4dbb-93c6-41b537bc0a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:10.341535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bed1d-184d-4dbb-93c6-41b537bc0a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:10.342165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bed1d-184d-4dbb-93c6-41b537bc0a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:10.344965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bed1d-184d-4dbb-93c6-41b537bc0a98 admin admin] PATH_INFO: `/v3/projects/0da042e22f87457f9a0e8ed78848b414/users/4d3b2ad4b7d947fa80bea5343e2e7805/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:10.404998 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c57c4-f427-4191-8c91-bb1fac93ea37 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:10.405509 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c57c4-f427-4191-8c91-bb1fac93ea37 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:10.405790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c57c4-f427-4191-8c91-bb1fac93ea37 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:10.407569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 877/1769] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 17:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:58:10.409308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bed1d-184d-4dbb-93c6-41b537bc0a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da042e22f87457f9a0e8ed78848b414, user_id=4d3b2ad4b7d947fa80bea5343e2e7805, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:10.414014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bed1d-184d-4dbb-93c6-41b537bc0a98 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:10.423187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc76c6-f1a6-4617-bdd6-fc38fb8b4dac None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:10.426853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc76c6-f1a6-4617-bdd6-fc38fb8b4dac None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:10.426853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc76c6-f1a6-4617-bdd6-fc38fb8b4dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:10.459475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e3dc76c6-f1a6-4617-bdd6-fc38fb8b4dac None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:10.465190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e3dc76c6-f1a6-4617-bdd6-fc38fb8b4dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:10.522050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 893/1770] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:10 2022] PUT /identity/v3/projects/0da042e22f87457f9a0e8ed78848b414/users/4d3b2ad4b7d947fa80bea5343e2e7805/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:10.538946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2928f-311c-404e-9332-7fc96e9f65ab None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:10.539239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2928f-311c-404e-9332-7fc96e9f65ab None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:10.539573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2928f-311c-404e-9332-7fc96e9f65ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:10.644438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-cdb2928f-311c-404e-9332-7fc96e9f65ab None None] MFA Rules not processed for user `4d3b2ad4b7d947fa80bea5343e2e7805`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:10.645889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-cdb2928f-311c-404e-9332-7fc96e9f65ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:10.673334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 878/1771] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 17:58:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:10.731142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc76c6-f1a6-4617-bdd6-fc38fb8b4dac None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:10.734069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e3dc76c6-f1a6-4617-bdd6-fc38fb8b4dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:10.762191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc76c6-f1a6-4617-bdd6-fc38fb8b4dac None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:10.932800 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 894/1772] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:10.938152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2928f-311c-404e-9332-7fc96e9f65ab None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:11.004916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aa4e4-4a3c-4c69-9732-90ddca4e4a11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:11.005729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aa4e4-4a3c-4c69-9732-90ddca4e4a11 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:11.006019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aa4e4-4a3c-4c69-9732-90ddca4e4a11 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:11.006378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aa4e4-4a3c-4c69-9732-90ddca4e4a11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:11.089009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796aa4e4-4a3c-4c69-9732-90ddca4e4a11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:11.098177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796aa4e4-4a3c-4c69-9732-90ddca4e4a11 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:11.147895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 879/1773] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:11.169102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aa4e4-4a3c-4c69-9732-90ddca4e4a11 service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:11.171052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-796aa4e4-4a3c-4c69-9732-90ddca4e4a11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:11.200377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aa4e4-4a3c-4c69-9732-90ddca4e4a11 service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:11.211671 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602018e-20cc-427a-8e0b-077a32ef05b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:11.212655 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602018e-20cc-427a-8e0b-077a32ef05b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:11.212941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602018e-20cc-427a-8e0b-077a32ef05b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:11.213286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602018e-20cc-427a-8e0b-077a32ef05b5 admin admin] PATH_INFO: `/v3/users/a9c0e8bd53ae43d7ac8056c15bb40f44` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:11.217515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602018e-20cc-427a-8e0b-077a32ef05b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9c0e8bd53ae43d7ac8056c15bb40f44)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:11.220396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2928f-311c-404e-9332-7fc96e9f65ab None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:11.226394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602018e-20cc-427a-8e0b-077a32ef05b5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:11.250959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305d2cb-054b-4eb2-b87d-9c67546bb81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:11.253022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305d2cb-054b-4eb2-b87d-9c67546bb81d admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:11.253555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305d2cb-054b-4eb2-b87d-9c67546bb81d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:11.254813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305d2cb-054b-4eb2-b87d-9c67546bb81d admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:11.255850 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305d2cb-054b-4eb2-b87d-9c67546bb81d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:11.261083 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305d2cb-054b-4eb2-b87d-9c67546bb81d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:11.485431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 895/1774] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:10 2022] POST /identity/v3/projects => generated 379 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:11.489009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305d2cb-054b-4eb2-b87d-9c67546bb81d admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:11.558115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6602018e-20cc-427a-8e0b-077a32ef05b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9c0e8bd53ae43d7ac8056c15bb40f44'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:11.599222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6602018e-20cc-427a-8e0b-077a32ef05b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9c0e8bd53ae43d7ac8056c15bb40f44'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:11.623869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6602018e-20cc-427a-8e0b-077a32ef05b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9c0e8bd53ae43d7ac8056c15bb40f44'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:11.662163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305d2cb-054b-4eb2-b87d-9c67546bb81d admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:11.669088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe3d6e-ab06-4d62-8706-98b339c2de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:11.670047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe3d6e-ab06-4d62-8706-98b339c2de83 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:11.670341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe3d6e-ab06-4d62-8706-98b339c2de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:11.670629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe3d6e-ab06-4d62-8706-98b339c2de83 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:11.671442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe3d6e-ab06-4d62-8706-98b339c2de83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:11.674303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe3d6e-ab06-4d62-8706-98b339c2de83 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:11.773142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6602018e-20cc-427a-8e0b-077a32ef05b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9c0e8bd53ae43d7ac8056c15bb40f44'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:11.774145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6602018e-20cc-427a-8e0b-077a32ef05b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9c0e8bd53ae43d7ac8056c15bb40f44'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:11.783223 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 880/1775] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:11 2022] DELETE /identity/v3/users/a9c0e8bd53ae43d7ac8056c15bb40f44 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:11.792571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63067187-3e5b-466d-a866-a4f27b8c1ec3 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:11.793243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63067187-3e5b-466d-a866-a4f27b8c1ec3 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:11.793753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63067187-3e5b-466d-a866-a4f27b8c1ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:11.840385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 896/1776] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:11 2022] POST /identity/v3/users => generated 296 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:11.842393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe3d6e-ab06-4d62-8706-98b339c2de83 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:11.843986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-63067187-3e5b-466d-a866-a4f27b8c1ec3 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:11.846600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-63067187-3e5b-466d-a866-a4f27b8c1ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:11.848106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5afe3d6e-ab06-4d62-8706-98b339c2de83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:11.920126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe3d6e-ab06-4d62-8706-98b339c2de83 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:12.014285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 881/1777] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:12.019518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63067187-3e5b-466d-a866-a4f27b8c1ec3 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:12.022236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-63067187-3e5b-466d-a866-a4f27b8c1ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:12.083341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e07caf-3fe8-4e00-a675-11a4a2a8ff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:12.084665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e07caf-3fe8-4e00-a675-11a4a2a8ff9a admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:12.084967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e07caf-3fe8-4e00-a675-11a4a2a8ff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:12.085250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e07caf-3fe8-4e00-a675-11a4a2a8ff9a admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:12.094404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e07caf-3fe8-4e00-a675-11a4a2a8ff9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:12.101844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e07caf-3fe8-4e00-a675-11a4a2a8ff9a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:12.154477 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 897/1778] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:12.156442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e07caf-3fe8-4e00-a675-11a4a2a8ff9a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:12.184928 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:12.226805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e07caf-3fe8-4e00-a675-11a4a2a8ff9a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:12.231686 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63067187-3e5b-466d-a866-a4f27b8c1ec3 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:12.237337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935f35b-1c6f-414b-8295-b60553ed697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:12.238455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6a5e3-db81-41fb-bf98-0e3a3b9dec4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:12.240693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935f35b-1c6f-414b-8295-b60553ed697b admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:12.241024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935f35b-1c6f-414b-8295-b60553ed697b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:12.241419 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6a5e3-db81-41fb-bf98-0e3a3b9dec4d service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:12.241788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6a5e3-db81-41fb-bf98-0e3a3b9dec4d service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:12.242172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6a5e3-db81-41fb-bf98-0e3a3b9dec4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:12.242377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935f35b-1c6f-414b-8295-b60553ed697b admin admin] PATH_INFO: `/v3/projects/6ecfa79eb09e4dfc94a2ac30a632948d/users/a4b17bd49b9f4b3991ab2e9aa921fac4/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:12.278070 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935f35b-1c6f-414b-8295-b60553ed697b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ecfa79eb09e4dfc94a2ac30a632948d, user_id=a4b17bd49b9f4b3991ab2e9aa921fac4, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:12.285013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935f35b-1c6f-414b-8295-b60553ed697b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:12.368699 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6a5e3-db81-41fb-bf98-0e3a3b9dec4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:12.384524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6a5e3-db81-41fb-bf98-0e3a3b9dec4d service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:12.553840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 898/1779] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:12 2022] PUT /identity/v3/projects/6ecfa79eb09e4dfc94a2ac30a632948d/users/a4b17bd49b9f4b3991ab2e9aa921fac4/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:12.557451 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 882/1780] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:12.564577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935f35b-1c6f-414b-8295-b60553ed697b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:12.882187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935f35b-1c6f-414b-8295-b60553ed697b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:12.915119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8409d5-7ff3-44b2-82fd-43d3d2e3c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:12.917665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8409d5-7ff3-44b2-82fd-43d3d2e3c13f admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:12.917965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8409d5-7ff3-44b2-82fd-43d3d2e3c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:12.918318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8409d5-7ff3-44b2-82fd-43d3d2e3c13f admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:12.919158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8409d5-7ff3-44b2-82fd-43d3d2e3c13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:12.921955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8409d5-7ff3-44b2-82fd-43d3d2e3c13f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:12.973489 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 899/1781] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:12.981249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6a5e3-db81-41fb-bf98-0e3a3b9dec4d service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:12.995929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6a5e3-db81-41fb-bf98-0e3a3b9dec4d service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:13.008568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f3ef3-090b-4e66-b616-ff7dfd0e9e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:13.008568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f3ef3-090b-4e66-b616-ff7dfd0e9e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:13.008568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f3ef3-090b-4e66-b616-ff7dfd0e9e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:13.008568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f3ef3-090b-4e66-b616-ff7dfd0e9e41 admin admin] PATH_INFO: `/v3/projects/6ecfa79eb09e4dfc94a2ac30a632948d/users/a4b17bd49b9f4b3991ab2e9aa921fac4/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:13.021826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f3ef3-090b-4e66-b616-ff7dfd0e9e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ecfa79eb09e4dfc94a2ac30a632948d, user_id=a4b17bd49b9f4b3991ab2e9aa921fac4, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:13.041382 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f3ef3-090b-4e66-b616-ff7dfd0e9e41 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:13.058700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 883/1782] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:12 2022] PUT /identity/v3/projects/6ecfa79eb09e4dfc94a2ac30a632948d/users/a4b17bd49b9f4b3991ab2e9aa921fac4/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:13.074099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97622b-6dd8-4ed9-8ec3-12d60b7a13bb None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:13.074404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97622b-6dd8-4ed9-8ec3-12d60b7a13bb None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:13.074666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97622b-6dd8-4ed9-8ec3-12d60b7a13bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:13.174650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-de97622b-6dd8-4ed9-8ec3-12d60b7a13bb None None] MFA Rules not processed for user `a4b17bd49b9f4b3991ab2e9aa921fac4`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:13.182072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-de97622b-6dd8-4ed9-8ec3-12d60b7a13bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:13.372008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 900/1783] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:13.403703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f3ef3-090b-4e66-b616-ff7dfd0e9e41 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:13.403703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d22f3ef3-090b-4e66-b616-ff7dfd0e9e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:13.510370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f3ef3-090b-4e66-b616-ff7dfd0e9e41 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:13.515256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b560891-56e9-4e58-b676-84243b19bfd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:13.516291 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b560891-56e9-4e58-b676-84243b19bfd3 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:13.516718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b560891-56e9-4e58-b676-84243b19bfd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:13.517111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b560891-56e9-4e58-b676-84243b19bfd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:13.520306 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6b560891-56e9-4e58-b676-84243b19bfd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:13.606275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:13.670335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b560891-56e9-4e58-b676-84243b19bfd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:13.671845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b560891-56e9-4e58-b676-84243b19bfd3 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:13.730272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 884/1784] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:14.329300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97622b-6dd8-4ed9-8ec3-12d60b7a13bb None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:14.330850 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-de97622b-6dd8-4ed9-8ec3-12d60b7a13bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:14.531241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97622b-6dd8-4ed9-8ec3-12d60b7a13bb None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:14.548113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:14.548113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:14.568294 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:14.571123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] PATH_INFO: `/v3/projects/4b3709fcee074f0bb0cd9fe273cbabbe` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:14.578000 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3709fcee074f0bb0cd9fe273cbabbe)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:14.580357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:14.841198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3709fcee074f0bb0cd9fe273cbabbe', 'request_id': 'req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:14.842816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3709fcee074f0bb0cd9fe273cbabbe', 'request_id': 'req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:14.854204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3709fcee074f0bb0cd9fe273cbabbe', 'request_id': 'req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:15.366738 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] The token cache is being invalidate because project 4b3709fcee074f0bb0cd9fe273cbabbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:15.367695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:15.369953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:15.381505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 901/1785] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:14 2022] DELETE /identity/v3/projects/4b3709fcee074f0bb0cd9fe273cbabbe => generated 0 bytes in 1048 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:15.383330 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b560891-56e9-4e58-b676-84243b19bfd3 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:15.429044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b560891-56e9-4e58-b676-84243b19bfd3 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:15.565024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b6564-3d98-4b21-af49-491bd5a666dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:15.565917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b6564-3d98-4b21-af49-491bd5a666dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:15.566277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b6564-3d98-4b21-af49-491bd5a666dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:15.566761 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b6564-3d98-4b21-af49-491bd5a666dd admin admin] PATH_INFO: `/v3/users/7bbc64b940784ce78f37f3854d74b376` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:15.568037 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b6564-3d98-4b21-af49-491bd5a666dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bbc64b940784ce78f37f3854d74b376)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:15.570877 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b6564-3d98-4b21-af49-491bd5a666dd admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:15.916604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e16b6564-3d98-4b21-af49-491bd5a666dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bbc64b940784ce78f37f3854d74b376'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:15.944061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e16b6564-3d98-4b21-af49-491bd5a666dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bbc64b940784ce78f37f3854d74b376'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:15.958345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e16b6564-3d98-4b21-af49-491bd5a666dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bbc64b940784ce78f37f3854d74b376'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:16.038480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e16b6564-3d98-4b21-af49-491bd5a666dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bbc64b940784ce78f37f3854d74b376'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:16.041909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e16b6564-3d98-4b21-af49-491bd5a666dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bbc64b940784ce78f37f3854d74b376'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:16.072556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 885/1786] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:15 2022] DELETE /identity/v3/users/7bbc64b940784ce78f37f3854d74b376 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:16.735347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:16.735347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:16.747645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b94f96-34e9-4ef7-9d01-40d08dbef2b9 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:16.819818 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c1154-755e-41ff-86f3-aafacc34e341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:16.820775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c1154-755e-41ff-86f3-aafacc34e341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:16.821095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c1154-755e-41ff-86f3-aafacc34e341 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:16.821353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c1154-755e-41ff-86f3-aafacc34e341 admin admin] PATH_INFO: `/v3/projects/28a0b4410e9a490d9f45ff253f0e1b6d` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:16.822838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c1154-755e-41ff-86f3-aafacc34e341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a0b4410e9a490d9f45ff253f0e1b6d)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:16.824839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c1154-755e-41ff-86f3-aafacc34e341 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:17.030235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-fc9c1154-755e-41ff-86f3-aafacc34e341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a0b4410e9a490d9f45ff253f0e1b6d', 'request_id': 'req-fc9c1154-755e-41ff-86f3-aafacc34e341'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:17.037175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-fc9c1154-755e-41ff-86f3-aafacc34e341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a0b4410e9a490d9f45ff253f0e1b6d', 'request_id': 'req-fc9c1154-755e-41ff-86f3-aafacc34e341'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:17.046216 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-fc9c1154-755e-41ff-86f3-aafacc34e341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a0b4410e9a490d9f45ff253f0e1b6d', 'request_id': 'req-fc9c1154-755e-41ff-86f3-aafacc34e341'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:17.171690 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-fc9c1154-755e-41ff-86f3-aafacc34e341 admin admin] The token cache is being invalidate because project 28a0b4410e9a490d9f45ff253f0e1b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:17.173210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-fc9c1154-755e-41ff-86f3-aafacc34e341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:17.173210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-fc9c1154-755e-41ff-86f3-aafacc34e341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:17.174306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 902/1787] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:16 2022] DELETE /identity/v3/projects/28a0b4410e9a490d9f45ff253f0e1b6d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:17.180193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650d855-18c6-4cd6-8fb1-309b76c3075d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:17.181268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650d855-18c6-4cd6-8fb1-309b76c3075d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:17.181268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650d855-18c6-4cd6-8fb1-309b76c3075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:17.201540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-6650d855-18c6-4cd6-8fb1-309b76c3075d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:17.202832 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6650d855-18c6-4cd6-8fb1-309b76c3075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:17.273815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 886/1788] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:17.284629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed03712-5346-4dfb-b8f2-a9072f93886b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:17.284629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed03712-5346-4dfb-b8f2-a9072f93886b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:17.284629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed03712-5346-4dfb-b8f2-a9072f93886b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:17.312378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-5ed03712-5346-4dfb-b8f2-a9072f93886b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:17.313738 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5ed03712-5346-4dfb-b8f2-a9072f93886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:17.325976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 903/1789] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:17.330599 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650d855-18c6-4cd6-8fb1-309b76c3075d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:17.351044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650d855-18c6-4cd6-8fb1-309b76c3075d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:17.360014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c7f2a-53a8-4dad-9dd2-5e83d0869da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:17.361111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c7f2a-53a8-4dad-9dd2-5e83d0869da4 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:17.361617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c7f2a-53a8-4dad-9dd2-5e83d0869da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:17.362127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c7f2a-53a8-4dad-9dd2-5e83d0869da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:17.363558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c7f2a-53a8-4dad-9dd2-5e83d0869da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:17.364119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c7f2a-53a8-4dad-9dd2-5e83d0869da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:17.367231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c7f2a-53a8-4dad-9dd2-5e83d0869da4 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:17.388281 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 887/1790] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:58:17.393817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed03712-5346-4dfb-b8f2-a9072f93886b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:17.410978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed03712-5346-4dfb-b8f2-a9072f93886b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:17.421463 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e1954-5b62-4696-b13a-a8f7e11ad8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:17.422454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e1954-5b62-4696-b13a-a8f7e11ad8ae admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:17.423877 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e1954-5b62-4696-b13a-a8f7e11ad8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:17.424332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e1954-5b62-4696-b13a-a8f7e11ad8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:17.433795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e1954-5b62-4696-b13a-a8f7e11ad8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:17.433795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e1954-5b62-4696-b13a-a8f7e11ad8ae admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:17.486207 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c7f2a-53a8-4dad-9dd2-5e83d0869da4 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:17.488020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8d9c7f2a-53a8-4dad-9dd2-5e83d0869da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:17.533830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 904/1791] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:17 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:17.538355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e1954-5b62-4696-b13a-a8f7e11ad8ae admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:17.563067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c7f2a-53a8-4dad-9dd2-5e83d0869da4 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:17.624050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e1954-5b62-4696-b13a-a8f7e11ad8ae admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:17.624370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047255f1-860c-41e3-a0ff-72558921404b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:17.624999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047255f1-860c-41e3-a0ff-72558921404b service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:17.625285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047255f1-860c-41e3-a0ff-72558921404b service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:17.625561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047255f1-860c-41e3-a0ff-72558921404b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:17.627427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-047255f1-860c-41e3-a0ff-72558921404b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:17.630519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0525706-107e-418e-9ed7-d0d9599174b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:17.631369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0525706-107e-418e-9ed7-d0d9599174b2 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:17.631369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0525706-107e-418e-9ed7-d0d9599174b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:17.631590 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0525706-107e-418e-9ed7-d0d9599174b2 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:17.632215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0525706-107e-418e-9ed7-d0d9599174b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:17.634877 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0525706-107e-418e-9ed7-d0d9599174b2 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:17.709919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047255f1-860c-41e3-a0ff-72558921404b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:17.732117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047255f1-860c-41e3-a0ff-72558921404b service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:17.732117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 888/1792] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:17.813972 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 905/1793] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:17 2022] POST /identity/v3/users => generated 294 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:17.819507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047255f1-860c-41e3-a0ff-72558921404b service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:17.843076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047255f1-860c-41e3-a0ff-72558921404b service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:17.852517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35baed-8958-4538-96bb-6bda0a818680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:17.853719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35baed-8958-4538-96bb-6bda0a818680 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:17.854485 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35baed-8958-4538-96bb-6bda0a818680 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:17.855085 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35baed-8958-4538-96bb-6bda0a818680 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:17.856694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35baed-8958-4538-96bb-6bda0a818680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:17.860105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35baed-8958-4538-96bb-6bda0a818680 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:17.908580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 889/1794] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:17.913852 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0525706-107e-418e-9ed7-d0d9599174b2 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:17.933651 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0525706-107e-418e-9ed7-d0d9599174b2 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:17.943508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e246b-d1ed-457c-b5cd-e640d11a8890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:17.943508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e246b-d1ed-457c-b5cd-e640d11a8890 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:17.943508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e246b-d1ed-457c-b5cd-e640d11a8890 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:17.943508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e246b-d1ed-457c-b5cd-e640d11a8890 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:17.943857 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e246b-d1ed-457c-b5cd-e640d11a8890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:17.946916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e246b-d1ed-457c-b5cd-e640d11a8890 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:17.959483 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 906/1795] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:17.968325 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35baed-8958-4538-96bb-6bda0a818680 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:17.989286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35baed-8958-4538-96bb-6bda0a818680 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:17.999694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d3e3f-278a-4b6b-9b06-6b8154c0a8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:18.000744 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d3e3f-278a-4b6b-9b06-6b8154c0a8eb admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:18.001107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d3e3f-278a-4b6b-9b06-6b8154c0a8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:18.001452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d3e3f-278a-4b6b-9b06-6b8154c0a8eb admin admin] PATH_INFO: `/v3/projects/617b3818c8d349f8ad832df9c31f3893/users/c6ee8c4860cc48aca1f8a58a163af8f2/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:18.018356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d3e3f-278a-4b6b-9b06-6b8154c0a8eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=617b3818c8d349f8ad832df9c31f3893, user_id=c6ee8c4860cc48aca1f8a58a163af8f2, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:18.021170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d3e3f-278a-4b6b-9b06-6b8154c0a8eb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:18.105170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 890/1796] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:17 2022] PUT /identity/v3/projects/617b3818c8d349f8ad832df9c31f3893/users/c6ee8c4860cc48aca1f8a58a163af8f2/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:18.125344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87177a5e-29a2-428b-8236-a5a0ce8007bb None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:18.125728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87177a5e-29a2-428b-8236-a5a0ce8007bb None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:18.126073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87177a5e-29a2-428b-8236-a5a0ce8007bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:18.169047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-87177a5e-29a2-428b-8236-a5a0ce8007bb None None] MFA Rules not processed for user `c6ee8c4860cc48aca1f8a58a163af8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:18.170537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-87177a5e-29a2-428b-8236-a5a0ce8007bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:18.264619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 907/1797] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:18.270024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d3e3f-278a-4b6b-9b06-6b8154c0a8eb admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:18.337603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d3e3f-278a-4b6b-9b06-6b8154c0a8eb admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:18.342294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f4aef-172c-41b4-931e-7f7accec74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:18.342952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f4aef-172c-41b4-931e-7f7accec74c1 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:18.343234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f4aef-172c-41b4-931e-7f7accec74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:18.343508 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f4aef-172c-41b4-931e-7f7accec74c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:18.344244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f4aef-172c-41b4-931e-7f7accec74c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:18.346393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f4aef-172c-41b4-931e-7f7accec74c1 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:18.465948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 891/1798] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:18 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:18.470361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87177a5e-29a2-428b-8236-a5a0ce8007bb None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:18.482205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87177a5e-29a2-428b-8236-a5a0ce8007bb None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:18.545020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac435f-be9f-4b3c-924a-190bc1dc6611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:18.552838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac435f-be9f-4b3c-924a-190bc1dc6611 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:18.552838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac435f-be9f-4b3c-924a-190bc1dc6611 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:18.552838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac435f-be9f-4b3c-924a-190bc1dc6611 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:18.552838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac435f-be9f-4b3c-924a-190bc1dc6611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:18.552838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac435f-be9f-4b3c-924a-190bc1dc6611 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:18.676115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 908/1799] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:18 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:18.681729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f4aef-172c-41b4-931e-7f7accec74c1 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:18.698946 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f4aef-172c-41b4-931e-7f7accec74c1 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:18.703990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622106bf-3a81-4df5-bbbb-725bd25cea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:18.704715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622106bf-3a81-4df5-bbbb-725bd25cea51 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:18.704996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622106bf-3a81-4df5-bbbb-725bd25cea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:18.705271 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622106bf-3a81-4df5-bbbb-725bd25cea51 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:18.706524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622106bf-3a81-4df5-bbbb-725bd25cea51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:18.707649 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622106bf-3a81-4df5-bbbb-725bd25cea51 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:18.727572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 892/1800] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:18.735001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac435f-be9f-4b3c-924a-190bc1dc6611 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:18.745577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac435f-be9f-4b3c-924a-190bc1dc6611 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:18.750479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e1503-cf68-439d-b412-ddeda0bda11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:18.751173 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e1503-cf68-439d-b412-ddeda0bda11b admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:18.751453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e1503-cf68-439d-b412-ddeda0bda11b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:18.751732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e1503-cf68-439d-b412-ddeda0bda11b admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:18.752500 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e1503-cf68-439d-b412-ddeda0bda11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:18.754112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e1503-cf68-439d-b412-ddeda0bda11b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:18.769209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 909/1801] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:18.771486 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622106bf-3a81-4df5-bbbb-725bd25cea51 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:18.783773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622106bf-3a81-4df5-bbbb-725bd25cea51 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:18.788980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53873be-f10f-4292-8fea-126ed4cbe1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:18.790172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53873be-f10f-4292-8fea-126ed4cbe1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:18.793592 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53873be-f10f-4292-8fea-126ed4cbe1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:18.793592 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53873be-f10f-4292-8fea-126ed4cbe1f4 admin admin] PATH_INFO: `/v3/projects/e5859998cf984ba2b1ab1049f7273c2d/users/3e6e27457d2d417cb48ccf52054ec782/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:18.810625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53873be-f10f-4292-8fea-126ed4cbe1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5859998cf984ba2b1ab1049f7273c2d, user_id=3e6e27457d2d417cb48ccf52054ec782, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:18.813738 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53873be-f10f-4292-8fea-126ed4cbe1f4 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:18.932574 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:19.038563 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 893/1802] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:18 2022] PUT /identity/v3/projects/e5859998cf984ba2b1ab1049f7273c2d/users/3e6e27457d2d417cb48ccf52054ec782/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:19.050248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0196e2-40f7-40a4-a02a-99e3ee306c50 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:19.050906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0196e2-40f7-40a4-a02a-99e3ee306c50 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:19.051518 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0196e2-40f7-40a4-a02a-99e3ee306c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:19.099131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-6b0196e2-40f7-40a4-a02a-99e3ee306c50 None None] MFA Rules not processed for user `3e6e27457d2d417cb48ccf52054ec782`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:19.101706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6b0196e2-40f7-40a4-a02a-99e3ee306c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:19.230173 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 910/1803] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:19.235740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53873be-f10f-4292-8fea-126ed4cbe1f4 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:19.360930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53873be-f10f-4292-8fea-126ed4cbe1f4 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:19.372799 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e71b-cb82-4fe3-a78c-bffca79e57a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:19.373961 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e71b-cb82-4fe3-a78c-bffca79e57a7 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:19.374453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e71b-cb82-4fe3-a78c-bffca79e57a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:19.374942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e71b-cb82-4fe3-a78c-bffca79e57a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:19.376279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254e71b-cb82-4fe3-a78c-bffca79e57a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:19.380641 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254e71b-cb82-4fe3-a78c-bffca79e57a7 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:19.464352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0196e2-40f7-40a4-a02a-99e3ee306c50 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:19.466604 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6b0196e2-40f7-40a4-a02a-99e3ee306c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:19.516845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0196e2-40f7-40a4-a02a-99e3ee306c50 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:19.526214 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56f3b5-9dc8-4b0d-82c9-170f4049667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:19.527937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f3b5-9dc8-4b0d-82c9-170f4049667e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:19.528710 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f3b5-9dc8-4b0d-82c9-170f4049667e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:19.529580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f3b5-9dc8-4b0d-82c9-170f4049667e admin admin] PATH_INFO: `/v3/users/ea83002c642947dd93b9bfa320a374e2` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:19.532026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56f3b5-9dc8-4b0d-82c9-170f4049667e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea83002c642947dd93b9bfa320a374e2)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:19.535747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56f3b5-9dc8-4b0d-82c9-170f4049667e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:19.646475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 894/1804] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:19 2022] POST /identity/v3/projects => generated 385 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:19.651184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e71b-cb82-4fe3-a78c-bffca79e57a7 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:19.747135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e71b-cb82-4fe3-a78c-bffca79e57a7 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:19.755612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870f20e-47ef-42c4-ae91-6f85b8748b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:19.756956 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870f20e-47ef-42c4-ae91-6f85b8748b32 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:19.757468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870f20e-47ef-42c4-ae91-6f85b8748b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:19.757969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870f20e-47ef-42c4-ae91-6f85b8748b32 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:19.759427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870f20e-47ef-42c4-ae91-6f85b8748b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:19.763408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870f20e-47ef-42c4-ae91-6f85b8748b32 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:19.920172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb56f3b5-9dc8-4b0d-82c9-170f4049667e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea83002c642947dd93b9bfa320a374e2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:19.945086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb56f3b5-9dc8-4b0d-82c9-170f4049667e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea83002c642947dd93b9bfa320a374e2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:19.959922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 895/1805] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:19 2022] POST /identity/v3/users => generated 299 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:19.966310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb56f3b5-9dc8-4b0d-82c9-170f4049667e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea83002c642947dd93b9bfa320a374e2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:19.969013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870f20e-47ef-42c4-ae91-6f85b8748b32 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:19.998889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870f20e-47ef-42c4-ae91-6f85b8748b32 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:20.012414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeefd4-2742-4913-aadf-12795d7e4049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:20.012414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeefd4-2742-4913-aadf-12795d7e4049 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:20.012764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeefd4-2742-4913-aadf-12795d7e4049 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:20.013024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeefd4-2742-4913-aadf-12795d7e4049 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:20.014688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eeefd4-2742-4913-aadf-12795d7e4049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:20.017898 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eeefd4-2742-4913-aadf-12795d7e4049 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:20.044876 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 896/1806] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:20.047498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeefd4-2742-4913-aadf-12795d7e4049 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:20.066207 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeefd4-2742-4913-aadf-12795d7e4049 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:20.074889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0695d-80a0-41b5-b4b5-63db96cae83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:20.078158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0695d-80a0-41b5-b4b5-63db96cae83d admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:20.078158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0695d-80a0-41b5-b4b5-63db96cae83d admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:20.078158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0695d-80a0-41b5-b4b5-63db96cae83d admin admin] PATH_INFO: `/v3/projects/85b4e8c212fc40a78bf71f97267da97b/users/f69b3328cfb54d36a6d8a3e035021fe3/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:20.091708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb56f3b5-9dc8-4b0d-82c9-170f4049667e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea83002c642947dd93b9bfa320a374e2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:20.094805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb56f3b5-9dc8-4b0d-82c9-170f4049667e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea83002c642947dd93b9bfa320a374e2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:20.113663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0695d-80a0-41b5-b4b5-63db96cae83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b4e8c212fc40a78bf71f97267da97b, user_id=f69b3328cfb54d36a6d8a3e035021fe3, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:20.121367 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0695d-80a0-41b5-b4b5-63db96cae83d admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:20.125142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 911/1807] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:19 2022] DELETE /identity/v3/users/ea83002c642947dd93b9bfa320a374e2 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:20.131983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a96170-eb20-4548-82f8-d5f9a22ad89c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:20.133890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a96170-eb20-4548-82f8-d5f9a22ad89c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:20.134881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a96170-eb20-4548-82f8-d5f9a22ad89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:20.173451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-d8a96170-eb20-4548-82f8-d5f9a22ad89c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:20.174817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d8a96170-eb20-4548-82f8-d5f9a22ad89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:20.272595 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 897/1808] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:20 2022] PUT /identity/v3/projects/85b4e8c212fc40a78bf71f97267da97b/users/f69b3328cfb54d36a6d8a3e035021fe3/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:20.279188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0695d-80a0-41b5-b4b5-63db96cae83d admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:20.281464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-18d0695d-80a0-41b5-b4b5-63db96cae83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:20.313382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 912/1809] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:20.352139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a96170-eb20-4548-82f8-d5f9a22ad89c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:20.365765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d8a96170-eb20-4548-82f8-d5f9a22ad89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:20.438536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0695d-80a0-41b5-b4b5-63db96cae83d admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:20.452034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722369f-675e-4b85-9bdf-1afc2699c5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:20.454779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722369f-675e-4b85-9bdf-1afc2699c5dc admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:20.455754 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722369f-675e-4b85-9bdf-1afc2699c5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:20.456621 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722369f-675e-4b85-9bdf-1afc2699c5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:20.470189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722369f-675e-4b85-9bdf-1afc2699c5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:20.476737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722369f-675e-4b85-9bdf-1afc2699c5dc admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:20.498042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 898/1810] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:20.631076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722369f-675e-4b85-9bdf-1afc2699c5dc admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:20.631076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722369f-675e-4b85-9bdf-1afc2699c5dc admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:20.631246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a96170-eb20-4548-82f8-d5f9a22ad89c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:20.631343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3069-75b5-4c75-871d-cf2483a46af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:20.631343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3069-75b5-4c75-871d-cf2483a46af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:20.631343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3069-75b5-4c75-871d-cf2483a46af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:20.631343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3069-75b5-4c75-871d-cf2483a46af8 admin admin] PATH_INFO: `/v3/projects/85b4e8c212fc40a78bf71f97267da97b/users/f69b3328cfb54d36a6d8a3e035021fe3/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:20.631647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a3069-75b5-4c75-871d-cf2483a46af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b4e8c212fc40a78bf71f97267da97b, user_id=f69b3328cfb54d36a6d8a3e035021fe3, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:20.631647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a3069-75b5-4c75-871d-cf2483a46af8 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:20.631647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 899/1811] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:20 2022] PUT /identity/v3/projects/85b4e8c212fc40a78bf71f97267da97b/users/f69b3328cfb54d36a6d8a3e035021fe3/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:20.631647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52761c5-2228-40e7-be13-389b91487e83 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:20.631647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52761c5-2228-40e7-be13-389b91487e83 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:20.631647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52761c5-2228-40e7-be13-389b91487e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:20.704430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173df0e-26ef-486e-9259-00d112de1876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:20.705167 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173df0e-26ef-486e-9259-00d112de1876 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:20.705745 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173df0e-26ef-486e-9259-00d112de1876 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:20.706133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173df0e-26ef-486e-9259-00d112de1876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:20.721107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173df0e-26ef-486e-9259-00d112de1876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:20.722967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173df0e-26ef-486e-9259-00d112de1876 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:20.740320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 913/1812] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:20.752730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e52761c5-2228-40e7-be13-389b91487e83 None None] MFA Rules not processed for user `f69b3328cfb54d36a6d8a3e035021fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:20.754868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e52761c5-2228-40e7-be13-389b91487e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:20.945873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 900/1813] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:21.438712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173df0e-26ef-486e-9259-00d112de1876 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:21.441053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4173df0e-26ef-486e-9259-00d112de1876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:21.581183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173df0e-26ef-486e-9259-00d112de1876 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:21.662177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1a7f9-740d-486a-a039-7803485b4f2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:21.663024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1a7f9-740d-486a-a039-7803485b4f2e service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:21.663393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1a7f9-740d-486a-a039-7803485b4f2e service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:21.663762 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1a7f9-740d-486a-a039-7803485b4f2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:21.676418 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1a7f9-740d-486a-a039-7803485b4f2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:21.678424 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1a7f9-740d-486a-a039-7803485b4f2e service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:21.692015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 914/1814] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:21.921214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:21.994155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cf544-3a6c-41a3-9159-a1857314c7a2 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:22.000751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cf544-3a6c-41a3-9159-a1857314c7a2 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:22.000751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cf544-3a6c-41a3-9159-a1857314c7a2 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:22.000751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 901/1815] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 17:58:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 17:58:22.023131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c747a0-0389-4ac5-a8ff-af0ba965e16a None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:22.024260 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c747a0-0389-4ac5-a8ff-af0ba965e16a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:22.024757 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c747a0-0389-4ac5-a8ff-af0ba965e16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:22.109932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-27c747a0-0389-4ac5-a8ff-af0ba965e16a None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:22.109932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-27c747a0-0389-4ac5-a8ff-af0ba965e16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:22.221809 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 915/1816] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 17:58:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:22.413025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cf544-3a6c-41a3-9159-a1857314c7a2 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:22.416254 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3e1cf544-3a6c-41a3-9159-a1857314c7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:22.526364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cf544-3a6c-41a3-9159-a1857314c7a2 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:22.551846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89954-ea3b-4e02-9138-da733577c564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:22.552665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89954-ea3b-4e02-9138-da733577c564 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:22.553340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89954-ea3b-4e02-9138-da733577c564 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:22.553631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89954-ea3b-4e02-9138-da733577c564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:22.580879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f89954-ea3b-4e02-9138-da733577c564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:22.582609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f89954-ea3b-4e02-9138-da733577c564 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:22.610369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 902/1817] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:22.934851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c747a0-0389-4ac5-a8ff-af0ba965e16a None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:22.937562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-27c747a0-0389-4ac5-a8ff-af0ba965e16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:23.131632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c747a0-0389-4ac5-a8ff-af0ba965e16a None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:23.144714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:23.144714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:23.144714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:23.144714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] PATH_INFO: `/v3/projects/4e8500222884485a9d692ce7b6d10513` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:23.153261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8500222884485a9d692ce7b6d10513)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:23.154269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:23.306027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8500222884485a9d692ce7b6d10513', 'request_id': 'req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:23.315373 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8500222884485a9d692ce7b6d10513', 'request_id': 'req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:23.324083 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8500222884485a9d692ce7b6d10513', 'request_id': 'req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:23.447227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] The token cache is being invalidate because project 4e8500222884485a9d692ce7b6d10513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:23.451391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:23.451391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:23.451391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 916/1818] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:22 2022] DELETE /identity/v3/projects/4e8500222884485a9d692ce7b6d10513 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:23.454137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89954-ea3b-4e02-9138-da733577c564 service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:23.465736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89954-ea3b-4e02-9138-da733577c564 service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:23.560522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:23.561312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:23.561581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:23.562031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] PATH_INFO: `/v3/users/6f8595b5c5b74f6581c036ecc90f614b` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:23.563489 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8595b5c5b74f6581c036ecc90f614b)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:23.565701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:23.905559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8595b5c5b74f6581c036ecc90f614b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:23.923480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8595b5c5b74f6581c036ecc90f614b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:23.928818 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:23.938889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:23.939553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8595b5c5b74f6581c036ecc90f614b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:24.021486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dee3bd-8334-4dfc-a200-54d0b2bf3356 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:24.030212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692499f9-f530-4faf-bcd8-c7ae747591d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:24.031116 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692499f9-f530-4faf-bcd8-c7ae747591d6 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:24.031714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692499f9-f530-4faf-bcd8-c7ae747591d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:24.032293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692499f9-f530-4faf-bcd8-c7ae747591d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:24.042944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-692499f9-f530-4faf-bcd8-c7ae747591d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:24.053809 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8595b5c5b74f6581c036ecc90f614b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:24.055350 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8595b5c5b74f6581c036ecc90f614b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:24.067382 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 903/1819] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:23 2022] DELETE /identity/v3/users/6f8595b5c5b74f6581c036ecc90f614b => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:24.249864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692499f9-f530-4faf-bcd8-c7ae747591d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:24.251434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692499f9-f530-4faf-bcd8-c7ae747591d6 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:24.280817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 917/1820] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:24.610599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:24.916439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:24.919193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:25.001475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba8777-fe79-4c43-9b68-1f4b025824b4 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:25.011542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b04fc6-62f1-465f-9b59-2998e5b638f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:25.011542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b04fc6-62f1-465f-9b59-2998e5b638f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:25.011542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b04fc6-62f1-465f-9b59-2998e5b638f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:25.011542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b04fc6-62f1-465f-9b59-2998e5b638f1 admin admin] PATH_INFO: `/v3/users/4d3b2ad4b7d947fa80bea5343e2e7805` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:25.012378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b04fc6-62f1-465f-9b59-2998e5b638f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3b2ad4b7d947fa80bea5343e2e7805)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:25.013336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692499f9-f530-4faf-bcd8-c7ae747591d6 service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:25.015498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-692499f9-f530-4faf-bcd8-c7ae747591d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:25.017586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b04fc6-62f1-465f-9b59-2998e5b638f1 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:25.030324 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692499f9-f530-4faf-bcd8-c7ae747591d6 service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:25.035977 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e8edd-e975-4d96-8ad3-19198c638db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:25.044141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e8edd-e975-4d96-8ad3-19198c638db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:25.044795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e8edd-e975-4d96-8ad3-19198c638db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:25.045290 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e8edd-e975-4d96-8ad3-19198c638db9 admin admin] PATH_INFO: `/v3/projects/b2245ff9dedb4dba92d41a2ec19d42fd` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:25.047053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e8edd-e975-4d96-8ad3-19198c638db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2245ff9dedb4dba92d41a2ec19d42fd)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:25.049494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e8edd-e975-4d96-8ad3-19198c638db9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:25.313128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f6b04fc6-62f1-465f-9b59-2998e5b638f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3b2ad4b7d947fa80bea5343e2e7805'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:25.324467 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c19e8edd-e975-4d96-8ad3-19198c638db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2245ff9dedb4dba92d41a2ec19d42fd', 'request_id': 'req-c19e8edd-e975-4d96-8ad3-19198c638db9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:25.327578 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f6b04fc6-62f1-465f-9b59-2998e5b638f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3b2ad4b7d947fa80bea5343e2e7805'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:25.337913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f6b04fc6-62f1-465f-9b59-2998e5b638f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3b2ad4b7d947fa80bea5343e2e7805'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:25.338247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c19e8edd-e975-4d96-8ad3-19198c638db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2245ff9dedb4dba92d41a2ec19d42fd', 'request_id': 'req-c19e8edd-e975-4d96-8ad3-19198c638db9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:25.348886 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c19e8edd-e975-4d96-8ad3-19198c638db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2245ff9dedb4dba92d41a2ec19d42fd', 'request_id': 'req-c19e8edd-e975-4d96-8ad3-19198c638db9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:25.474625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f6b04fc6-62f1-465f-9b59-2998e5b638f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3b2ad4b7d947fa80bea5343e2e7805'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:25.475281 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f6b04fc6-62f1-465f-9b59-2998e5b638f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3b2ad4b7d947fa80bea5343e2e7805'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:25.483261 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 904/1821] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:24 2022] DELETE /identity/v3/users/4d3b2ad4b7d947fa80bea5343e2e7805 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:25.487666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c17ca9-10d2-4333-8688-87adc1a7968a None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:25.487961 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c17ca9-10d2-4333-8688-87adc1a7968a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:25.488296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c17ca9-10d2-4333-8688-87adc1a7968a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:25.508759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-74c17ca9-10d2-4333-8688-87adc1a7968a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:25.510061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-74c17ca9-10d2-4333-8688-87adc1a7968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:25.566621 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c19e8edd-e975-4d96-8ad3-19198c638db9 admin admin] The token cache is being invalidate because project b2245ff9dedb4dba92d41a2ec19d42fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:25.566882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c19e8edd-e975-4d96-8ad3-19198c638db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:25.567724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c19e8edd-e975-4d96-8ad3-19198c638db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:25.571001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 918/1822] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:25 2022] DELETE /identity/v3/projects/b2245ff9dedb4dba92d41a2ec19d42fd => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:25.577033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cad373-b120-46d8-9c62-1c1c378376d5 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:25.577609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cad373-b120-46d8-9c62-1c1c378376d5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:25.578144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cad373-b120-46d8-9c62-1c1c378376d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:25.594918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 905/1823] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:25.606137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c17ca9-10d2-4333-8688-87adc1a7968a None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:25.606399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f2cad373-b120-46d8-9c62-1c1c378376d5 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:25.607712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f2cad373-b120-46d8-9c62-1c1c378376d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:25.610750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-74c17ca9-10d2-4333-8688-87adc1a7968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:25.619920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 919/1824] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:25.628820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad29ee-2ae3-4a5c-bfcb-2c80defb912c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:25.629213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad29ee-2ae3-4a5c-bfcb-2c80defb912c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:25.629570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad29ee-2ae3-4a5c-bfcb-2c80defb912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:25.650951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-28ad29ee-2ae3-4a5c-bfcb-2c80defb912c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:25.652294 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-28ad29ee-2ae3-4a5c-bfcb-2c80defb912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:25.667146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 920/1825] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:25.668959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad29ee-2ae3-4a5c-bfcb-2c80defb912c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:25.678671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad29ee-2ae3-4a5c-bfcb-2c80defb912c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:25.684218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeaefb-7766-4cf3-ae88-7922f7a04a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:25.684929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeaefb-7766-4cf3-ae88-7922f7a04a49 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:25.685309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeaefb-7766-4cf3-ae88-7922f7a04a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:25.685592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeaefb-7766-4cf3-ae88-7922f7a04a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:25.686348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eeaefb-7766-4cf3-ae88-7922f7a04a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:25.686658 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eeaefb-7766-4cf3-ae88-7922f7a04a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:25.688519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eeaefb-7766-4cf3-ae88-7922f7a04a49 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:25.690714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c17ca9-10d2-4333-8688-87adc1a7968a None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:25.699795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736ac4a-c94e-442a-803a-24e92292f98e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:25.700964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736ac4a-c94e-442a-803a-24e92292f98e service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:25.701480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736ac4a-c94e-442a-803a-24e92292f98e service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:25.701979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736ac4a-c94e-442a-803a-24e92292f98e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:25.706521 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 921/1826] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:58:25.717756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeaefb-7766-4cf3-ae88-7922f7a04a49 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:25.729189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736ac4a-c94e-442a-803a-24e92292f98e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:25.731725 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736ac4a-c94e-442a-803a-24e92292f98e service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:25.733351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeaefb-7766-4cf3-ae88-7922f7a04a49 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:25.741612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6cfee-a4bc-408d-ae17-538a32bd7cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:25.742786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6cfee-a4bc-408d-ae17-538a32bd7cce admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:25.743150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6cfee-a4bc-408d-ae17-538a32bd7cce admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:25.743508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6cfee-a4bc-408d-ae17-538a32bd7cce admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:25.744358 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6cfee-a4bc-408d-ae17-538a32bd7cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:25.747771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 906/1827] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:25.748626 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6cfee-a4bc-408d-ae17-538a32bd7cce admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:25.863566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:25.909059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 922/1828] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:25 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:25.913222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736ac4a-c94e-442a-803a-24e92292f98e service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:25.928585 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736ac4a-c94e-442a-803a-24e92292f98e service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:26.045317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c72fd-6c1d-4c27-959a-874265ff8cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:26.046887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c72fd-6c1d-4c27-959a-874265ff8cab admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:26.047459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c72fd-6c1d-4c27-959a-874265ff8cab admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:26.048159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c72fd-6c1d-4c27-959a-874265ff8cab admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:26.049790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c72fd-6c1d-4c27-959a-874265ff8cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:26.057258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c72fd-6c1d-4c27-959a-874265ff8cab admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:26.195944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 907/1829] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:25 2022] POST /identity/v3/users => generated 286 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:26.200349 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6cfee-a4bc-408d-ae17-538a32bd7cce admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:26.213050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6cfee-a4bc-408d-ae17-538a32bd7cce admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:26.220566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b04ad-7d35-4394-bd93-5461903a4bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:26.222030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b04ad-7d35-4394-bd93-5461903a4bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:26.223547 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b04ad-7d35-4394-bd93-5461903a4bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:26.224034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b04ad-7d35-4394-bd93-5461903a4bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:26.225037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b04ad-7d35-4394-bd93-5461903a4bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:26.227482 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b04ad-7d35-4394-bd93-5461903a4bb7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:26.239795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 923/1830] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:26.245448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c72fd-6c1d-4c27-959a-874265ff8cab admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:26.256707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c72fd-6c1d-4c27-959a-874265ff8cab admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:26.262149 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723ecf5-b12e-48c1-8396-c933ccc25fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:26.263146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ecf5-b12e-48c1-8396-c933ccc25fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:26.263914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ecf5-b12e-48c1-8396-c933ccc25fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:26.264188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ecf5-b12e-48c1-8396-c933ccc25fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:26.264992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723ecf5-b12e-48c1-8396-c933ccc25fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:26.266702 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723ecf5-b12e-48c1-8396-c933ccc25fd8 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:26.278581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 908/1831] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:26.284124 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b04ad-7d35-4394-bd93-5461903a4bb7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:26.299280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b04ad-7d35-4394-bd93-5461903a4bb7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:26.305333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a63250-3c60-4217-84d3-f08c3777184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:26.306099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a63250-3c60-4217-84d3-f08c3777184a admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:26.306389 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a63250-3c60-4217-84d3-f08c3777184a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:26.306665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a63250-3c60-4217-84d3-f08c3777184a admin admin] PATH_INFO: `/v3/projects/8ec7a2b3e7384d6990bc9e5ad281dfc7/users/c7519bed99024e8a8951059d465c1392/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:26.326074 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a63250-3c60-4217-84d3-f08c3777184a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec7a2b3e7384d6990bc9e5ad281dfc7, user_id=c7519bed99024e8a8951059d465c1392, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:26.329397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a63250-3c60-4217-84d3-f08c3777184a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:26.440199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 924/1832] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:26 2022] PUT /identity/v3/projects/8ec7a2b3e7384d6990bc9e5ad281dfc7/users/c7519bed99024e8a8951059d465c1392/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:26.443011 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f734558-3362-4f8b-9808-8df203044a4a None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:26.443339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f734558-3362-4f8b-9808-8df203044a4a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:26.443753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f734558-3362-4f8b-9808-8df203044a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:26.524941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-2f734558-3362-4f8b-9808-8df203044a4a None None] MFA Rules not processed for user `c7519bed99024e8a8951059d465c1392`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:26.526218 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2f734558-3362-4f8b-9808-8df203044a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:26.603668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a63250-3c60-4217-84d3-f08c3777184a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:26.608520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-72a63250-3c60-4217-84d3-f08c3777184a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:26.658824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 909/1833] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:26.664077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f734558-3362-4f8b-9808-8df203044a4a None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:26.734692 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a63250-3c60-4217-84d3-f08c3777184a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:26.741499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:26.743043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:26.743396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:26.749459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] PATH_INFO: `/v3/projects/0da042e22f87457f9a0e8ed78848b414` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:26.750537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da042e22f87457f9a0e8ed78848b414)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:26.752386 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f734558-3362-4f8b-9808-8df203044a4a None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:26.752833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:26.758428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942bf2b-ca8a-4708-b511-65be301380b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:26.759306 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942bf2b-ca8a-4708-b511-65be301380b6 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:26.759550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942bf2b-ca8a-4708-b511-65be301380b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:26.760398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942bf2b-ca8a-4708-b511-65be301380b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:26.760763 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942bf2b-ca8a-4708-b511-65be301380b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:26.762826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942bf2b-ca8a-4708-b511-65be301380b6 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:26.890978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 910/1834] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:26 2022] POST /identity/v3/projects => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:26.895314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942bf2b-ca8a-4708-b511-65be301380b6 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:26.940373 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da042e22f87457f9a0e8ed78848b414', 'request_id': 'req-4ba7131f-810b-4676-b651-60e13af5b8c3'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:26.947834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da042e22f87457f9a0e8ed78848b414', 'request_id': 'req-4ba7131f-810b-4676-b651-60e13af5b8c3'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:26.956248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da042e22f87457f9a0e8ed78848b414', 'request_id': 'req-4ba7131f-810b-4676-b651-60e13af5b8c3'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:26.987950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942bf2b-ca8a-4708-b511-65be301380b6 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:27.082173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa330176-c90f-45f3-bad6-3463b23bd583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:27.082881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa330176-c90f-45f3-bad6-3463b23bd583 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:27.083200 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa330176-c90f-45f3-bad6-3463b23bd583 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:27.083433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa330176-c90f-45f3-bad6-3463b23bd583 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:27.084426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa330176-c90f-45f3-bad6-3463b23bd583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:27.088159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa330176-c90f-45f3-bad6-3463b23bd583 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:27.103897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] The token cache is being invalidate because project 0da042e22f87457f9a0e8ed78848b414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:27.104279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:27.109009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:27.109009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 925/1835] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:26 2022] DELETE /identity/v3/projects/0da042e22f87457f9a0e8ed78848b414 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:27.111771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:27.113230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:27.132055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7131f-810b-4676-b651-60e13af5b8c3 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:27.147453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:27.149101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:27.149454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:27.150201 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] PATH_INFO: `/v3/users/a4b17bd49b9f4b3991ab2e9aa921fac4` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:27.153381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b17bd49b9f4b3991ab2e9aa921fac4)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:27.155960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:27.210569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 911/1836] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:26 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:27.216707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa330176-c90f-45f3-bad6-3463b23bd583 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:27.218729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-aa330176-c90f-45f3-bad6-3463b23bd583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:27.232365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa330176-c90f-45f3-bad6-3463b23bd583 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:27.248293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15af2c4-8232-4800-b703-50c2cc97200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:27.250090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15af2c4-8232-4800-b703-50c2cc97200e admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:27.250480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15af2c4-8232-4800-b703-50c2cc97200e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:27.250760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15af2c4-8232-4800-b703-50c2cc97200e admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:27.251713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15af2c4-8232-4800-b703-50c2cc97200e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:27.254448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15af2c4-8232-4800-b703-50c2cc97200e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:27.270954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 912/1837] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:27.276554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15af2c4-8232-4800-b703-50c2cc97200e admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:27.287083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15af2c4-8232-4800-b703-50c2cc97200e admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:27.292991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d18cc2-724b-47f5-b738-018ee6416f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:27.294209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18cc2-724b-47f5-b738-018ee6416f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:27.294209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18cc2-724b-47f5-b738-018ee6416f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:27.294487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18cc2-724b-47f5-b738-018ee6416f89 admin admin] PATH_INFO: `/v3/projects/5b0a1c0273a14baba46057aaf87926ff/users/6b550e8f69df49e9a06cc456f96a7f3f/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:27.314522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d18cc2-724b-47f5-b738-018ee6416f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0a1c0273a14baba46057aaf87926ff, user_id=6b550e8f69df49e9a06cc456f96a7f3f, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:27.317473 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d18cc2-724b-47f5-b738-018ee6416f89 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:27.493895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 913/1838] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:27 2022] PUT /identity/v3/projects/5b0a1c0273a14baba46057aaf87926ff/users/6b550e8f69df49e9a06cc456f96a7f3f/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:27.498563 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d18cc2-724b-47f5-b738-018ee6416f89 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:27.515533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b17bd49b9f4b3991ab2e9aa921fac4'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:27.580049 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b17bd49b9f4b3991ab2e9aa921fac4'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:27.597007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b17bd49b9f4b3991ab2e9aa921fac4'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:27.703029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b17bd49b9f4b3991ab2e9aa921fac4'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:27.710509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b17bd49b9f4b3991ab2e9aa921fac4'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:27.715460 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d18cc2-724b-47f5-b738-018ee6416f89 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:27.723012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 926/1839] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:27 2022] DELETE /identity/v3/users/a4b17bd49b9f4b3991ab2e9aa921fac4 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:27.926618 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9581f2-32ea-42bb-8406-c8837a81fb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:27.928335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9581f2-32ea-42bb-8406-c8837a81fb1f admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:27.929387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9581f2-32ea-42bb-8406-c8837a81fb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:27.931464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9581f2-32ea-42bb-8406-c8837a81fb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:27.933401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9581f2-32ea-42bb-8406-c8837a81fb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:27.936980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9581f2-32ea-42bb-8406-c8837a81fb1f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:27.972156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 914/1840] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:27.977253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:27.979180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:28.008438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50fc84-7330-4018-ae7e-c539bfa3a711 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:28.029265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e98398-6b78-4422-bf3f-ddec30943ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:28.031524 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e98398-6b78-4422-bf3f-ddec30943ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:28.037988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e98398-6b78-4422-bf3f-ddec30943ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:28.037988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e98398-6b78-4422-bf3f-ddec30943ab9 admin admin] PATH_INFO: `/v3/projects/5b0a1c0273a14baba46057aaf87926ff/users/6b550e8f69df49e9a06cc456f96a7f3f/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:28.037988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e98398-6b78-4422-bf3f-ddec30943ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0a1c0273a14baba46057aaf87926ff, user_id=6b550e8f69df49e9a06cc456f96a7f3f, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:28.041885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e98398-6b78-4422-bf3f-ddec30943ab9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:28.063378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 927/1841] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:27 2022] PUT /identity/v3/projects/5b0a1c0273a14baba46057aaf87926ff/users/6b550e8f69df49e9a06cc456f96a7f3f/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:28.081800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7bf5-8657-423a-9995-a6168d7e2bf1 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:28.082394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7bf5-8657-423a-9995-a6168d7e2bf1 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:28.082394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7bf5-8657-423a-9995-a6168d7e2bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:28.113793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-efdc7bf5-8657-423a-9995-a6168d7e2bf1 None None] MFA Rules not processed for user `6b550e8f69df49e9a06cc456f96a7f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:28.115016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-efdc7bf5-8657-423a-9995-a6168d7e2bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:28.186643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 915/1842] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:28.308310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e98398-6b78-4422-bf3f-ddec30943ab9 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:28.310409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c1e98398-6b78-4422-bf3f-ddec30943ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:28.433830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e98398-6b78-4422-bf3f-ddec30943ab9 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:28.448997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b0356-5f1d-46c3-9242-c0d098d4ab36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:28.448997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b0356-5f1d-46c3-9242-c0d098d4ab36 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:28.448997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b0356-5f1d-46c3-9242-c0d098d4ab36 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:28.448997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b0356-5f1d-46c3-9242-c0d098d4ab36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:28.455281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b0356-5f1d-46c3-9242-c0d098d4ab36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:28.457027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b0356-5f1d-46c3-9242-c0d098d4ab36 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:28.474819 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 928/1843] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:28.739006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc7bf5-8657-423a-9995-a6168d7e2bf1 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:28.740957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-efdc7bf5-8657-423a-9995-a6168d7e2bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:28.830459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc7bf5-8657-423a-9995-a6168d7e2bf1 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:28.835384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28641cb4-869b-49fb-a237-ff248a65f4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:28.837037 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28641cb4-869b-49fb-a237-ff248a65f4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:28.837188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28641cb4-869b-49fb-a237-ff248a65f4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:28.838070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28641cb4-869b-49fb-a237-ff248a65f4aa admin admin] PATH_INFO: `/v3/projects/6ecfa79eb09e4dfc94a2ac30a632948d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:28.838958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28641cb4-869b-49fb-a237-ff248a65f4aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ecfa79eb09e4dfc94a2ac30a632948d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:28.841061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28641cb4-869b-49fb-a237-ff248a65f4aa admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:29.024674 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-28641cb4-869b-49fb-a237-ff248a65f4aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ecfa79eb09e4dfc94a2ac30a632948d', 'request_id': 'req-28641cb4-869b-49fb-a237-ff248a65f4aa'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:29.030494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-28641cb4-869b-49fb-a237-ff248a65f4aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ecfa79eb09e4dfc94a2ac30a632948d', 'request_id': 'req-28641cb4-869b-49fb-a237-ff248a65f4aa'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:29.220002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-28641cb4-869b-49fb-a237-ff248a65f4aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ecfa79eb09e4dfc94a2ac30a632948d', 'request_id': 'req-28641cb4-869b-49fb-a237-ff248a65f4aa'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:29.247163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-28641cb4-869b-49fb-a237-ff248a65f4aa admin admin] The token cache is being invalidate because project 6ecfa79eb09e4dfc94a2ac30a632948d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:29.247742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-28641cb4-869b-49fb-a237-ff248a65f4aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:29.251747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-28641cb4-869b-49fb-a237-ff248a65f4aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:29.251890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:29.252470 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 916/1844] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:28 2022] DELETE /identity/v3/projects/6ecfa79eb09e4dfc94a2ac30a632948d => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:29.258180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb30da4-72b4-4af0-84ad-308d1696b371 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:29.258446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb30da4-72b4-4af0-84ad-308d1696b371 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:29.258719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb30da4-72b4-4af0-84ad-308d1696b371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:29.281881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-acb30da4-72b4-4af0-84ad-308d1696b371 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:29.283173 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-acb30da4-72b4-4af0-84ad-308d1696b371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:29.357952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 929/1845] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:29.374214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9435e-746e-4228-869b-66fbb8496100 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:29.374214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9435e-746e-4228-869b-66fbb8496100 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:29.374214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9435e-746e-4228-869b-66fbb8496100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:29.397534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-66f9435e-746e-4228-869b-66fbb8496100 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:29.399633 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-66f9435e-746e-4228-869b-66fbb8496100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:29.413510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 917/1846] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:29.415092 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb30da4-72b4-4af0-84ad-308d1696b371 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:29.425698 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb30da4-72b4-4af0-84ad-308d1696b371 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:29.430836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5560fc-7e62-4dc0-9d5d-2418186d4938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:29.431529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5560fc-7e62-4dc0-9d5d-2418186d4938 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:29.431804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5560fc-7e62-4dc0-9d5d-2418186d4938 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:29.432083 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5560fc-7e62-4dc0-9d5d-2418186d4938 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:29.433046 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5560fc-7e62-4dc0-9d5d-2418186d4938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:29.433350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5560fc-7e62-4dc0-9d5d-2418186d4938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:29.434978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5560fc-7e62-4dc0-9d5d-2418186d4938 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:29.449263 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 930/1847] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:58:29.453796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9435e-746e-4228-869b-66fbb8496100 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:29.465617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9435e-746e-4228-869b-66fbb8496100 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:29.471016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000e13-132d-4a81-b966-1b50f6c0bbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:29.471736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000e13-132d-4a81-b966-1b50f6c0bbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:29.472022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000e13-132d-4a81-b966-1b50f6c0bbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:29.472303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000e13-132d-4a81-b966-1b50f6c0bbe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:29.474169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45000e13-132d-4a81-b966-1b50f6c0bbe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:29.475166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45000e13-132d-4a81-b966-1b50f6c0bbe7 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:29.597272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 918/1848] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:29 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:29.602403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5560fc-7e62-4dc0-9d5d-2418186d4938 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:29.620773 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5560fc-7e62-4dc0-9d5d-2418186d4938 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:29.684975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7f0f6-5eae-41da-9a97-b634c13abe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:29.686290 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7f0f6-5eae-41da-9a97-b634c13abe1a admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:29.686650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7f0f6-5eae-41da-9a97-b634c13abe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:29.687010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7f0f6-5eae-41da-9a97-b634c13abe1a admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:29.688109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7f0f6-5eae-41da-9a97-b634c13abe1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:29.691144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7f0f6-5eae-41da-9a97-b634c13abe1a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:29.809793 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 931/1849] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:29 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:29.815452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000e13-132d-4a81-b966-1b50f6c0bbe7 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:29.850135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000e13-132d-4a81-b966-1b50f6c0bbe7 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:29.859425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e23a8a-166a-4e51-9db9-041890b085b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:29.859646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e23a8a-166a-4e51-9db9-041890b085b5 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:29.859927 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e23a8a-166a-4e51-9db9-041890b085b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:29.860846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e23a8a-166a-4e51-9db9-041890b085b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:29.865319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e23a8a-166a-4e51-9db9-041890b085b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:29.872537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e23a8a-166a-4e51-9db9-041890b085b5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:29.910625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 919/1850] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:29.916197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7f0f6-5eae-41da-9a97-b634c13abe1a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:29.937108 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7f0f6-5eae-41da-9a97-b634c13abe1a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:29.943312 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85579f-0c83-44c6-ada7-d5a015162ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:29.944019 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85579f-0c83-44c6-ada7-d5a015162ceb admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:29.944305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85579f-0c83-44c6-ada7-d5a015162ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:29.944615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85579f-0c83-44c6-ada7-d5a015162ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:29.945924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85579f-0c83-44c6-ada7-d5a015162ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:29.947557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85579f-0c83-44c6-ada7-d5a015162ceb admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:29.974514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 932/1851] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:29.978985 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e23a8a-166a-4e51-9db9-041890b085b5 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:29.993721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e23a8a-166a-4e51-9db9-041890b085b5 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:30.009535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d021-9094-4d36-b74d-0b4dbe9b6ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:30.010756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d021-9094-4d36-b74d-0b4dbe9b6ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:30.011327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d021-9094-4d36-b74d-0b4dbe9b6ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:30.011752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d021-9094-4d36-b74d-0b4dbe9b6ab9 admin admin] PATH_INFO: `/v3/projects/ce547161b25b43a585c3531397f3800d/users/210e4ed5dd3c425995fff112dd738a58/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:30.030858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92d021-9094-4d36-b74d-0b4dbe9b6ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce547161b25b43a585c3531397f3800d, user_id=210e4ed5dd3c425995fff112dd738a58, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:30.033830 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92d021-9094-4d36-b74d-0b4dbe9b6ab9 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:30.159776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:30.247367 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 920/1852] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:29 2022] PUT /identity/v3/projects/ce547161b25b43a585c3531397f3800d/users/210e4ed5dd3c425995fff112dd738a58/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:30.257863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5623c-19f2-4334-8210-05a65a086b55 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:30.258427 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5623c-19f2-4334-8210-05a65a086b55 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:30.258427 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5623c-19f2-4334-8210-05a65a086b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:30.310920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-64d5623c-19f2-4334-8210-05a65a086b55 None None] MFA Rules not processed for user `210e4ed5dd3c425995fff112dd738a58`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:30.314046 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-64d5623c-19f2-4334-8210-05a65a086b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:30.380646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d021-9094-4d36-b74d-0b4dbe9b6ab9 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:30.382624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ea92d021-9094-4d36-b74d-0b4dbe9b6ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:30.473334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 933/1853] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:30.478568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5623c-19f2-4334-8210-05a65a086b55 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:30.484918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d021-9094-4d36-b74d-0b4dbe9b6ab9 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:30.493723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5623c-19f2-4334-8210-05a65a086b55 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:30.499722 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4731bb-2374-41fe-841b-89e5c2872661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:30.500726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4731bb-2374-41fe-841b-89e5c2872661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:30.501007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4731bb-2374-41fe-841b-89e5c2872661 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:30.501283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4731bb-2374-41fe-841b-89e5c2872661 admin admin] PATH_INFO: `/v3/users/c7519bed99024e8a8951059d465c1392` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:30.502872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4731bb-2374-41fe-841b-89e5c2872661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7519bed99024e8a8951059d465c1392)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:30.504875 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9facb4-6fb8-4598-a765-44d384d5c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:30.508894 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9facb4-6fb8-4598-a765-44d384d5c380 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:30.508894 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9facb4-6fb8-4598-a765-44d384d5c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:30.508894 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9facb4-6fb8-4598-a765-44d384d5c380 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:30.509202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4731bb-2374-41fe-841b-89e5c2872661 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:30.509301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9facb4-6fb8-4598-a765-44d384d5c380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:30.510975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9facb4-6fb8-4598-a765-44d384d5c380 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:30.630657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 934/1854] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:30 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:30.635910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9facb4-6fb8-4598-a765-44d384d5c380 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:30.718228 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9facb4-6fb8-4598-a765-44d384d5c380 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:30.723356 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fb6a0-fbfc-4acc-a5ca-a2398636cde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:30.724037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fb6a0-fbfc-4acc-a5ca-a2398636cde9 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:30.724317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fb6a0-fbfc-4acc-a5ca-a2398636cde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:30.724626 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fb6a0-fbfc-4acc-a5ca-a2398636cde9 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:30.725335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fb6a0-fbfc-4acc-a5ca-a2398636cde9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:30.728674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fb6a0-fbfc-4acc-a5ca-a2398636cde9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:30.824292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6f4731bb-2374-41fe-841b-89e5c2872661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7519bed99024e8a8951059d465c1392'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:30.844813 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6f4731bb-2374-41fe-841b-89e5c2872661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7519bed99024e8a8951059d465c1392'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:30.859417 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6f4731bb-2374-41fe-841b-89e5c2872661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7519bed99024e8a8951059d465c1392'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:30.892795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 935/1855] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:30 2022] POST /identity/v3/users => generated 299 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:30.896659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fb6a0-fbfc-4acc-a5ca-a2398636cde9 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:30.908951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fb6a0-fbfc-4acc-a5ca-a2398636cde9 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:30.916140 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b00663-d98c-43c0-bc42-e6aa1b6002b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:30.917522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b00663-d98c-43c0-bc42-e6aa1b6002b1 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:30.917809 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b00663-d98c-43c0-bc42-e6aa1b6002b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:30.918176 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b00663-d98c-43c0-bc42-e6aa1b6002b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:30.918814 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b00663-d98c-43c0-bc42-e6aa1b6002b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:30.920568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b00663-d98c-43c0-bc42-e6aa1b6002b1 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:30.939178 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 936/1856] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:30.943059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b00663-d98c-43c0-bc42-e6aa1b6002b1 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:30.952805 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6f4731bb-2374-41fe-841b-89e5c2872661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7519bed99024e8a8951059d465c1392'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:30.953521 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6f4731bb-2374-41fe-841b-89e5c2872661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7519bed99024e8a8951059d465c1392'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:30.955291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b00663-d98c-43c0-bc42-e6aa1b6002b1 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:30.961365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 921/1857] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:30 2022] DELETE /identity/v3/users/c7519bed99024e8a8951059d465c1392 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:30.967248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e007ee0-2655-4618-9393-3f15291cf0b6 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:30.968214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e007ee0-2655-4618-9393-3f15291cf0b6 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:30.968942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e007ee0-2655-4618-9393-3f15291cf0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:30.976638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5df803-1bcb-473e-8ed0-4da6b29312a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:30.978221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5df803-1bcb-473e-8ed0-4da6b29312a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:30.978508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5df803-1bcb-473e-8ed0-4da6b29312a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:30.978779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5df803-1bcb-473e-8ed0-4da6b29312a2 admin admin] PATH_INFO: `/v3/projects/ba23da6d46a84273992fd9a091e79ba5/users/2b563062d56947a2a6a236c37100152e/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:30.997560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5df803-1bcb-473e-8ed0-4da6b29312a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba23da6d46a84273992fd9a091e79ba5, user_id=2b563062d56947a2a6a236c37100152e, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:31.000408 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5df803-1bcb-473e-8ed0-4da6b29312a2 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:31.020413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-9e007ee0-2655-4618-9393-3f15291cf0b6 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:31.021917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9e007ee0-2655-4618-9393-3f15291cf0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:31.149493 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 937/1858] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:30 2022] PUT /identity/v3/projects/ba23da6d46a84273992fd9a091e79ba5/users/2b563062d56947a2a6a236c37100152e/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:31.153710 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5df803-1bcb-473e-8ed0-4da6b29312a2 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:31.156781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0c5df803-1bcb-473e-8ed0-4da6b29312a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:31.168104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 922/1859] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:31.183288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e007ee0-2655-4618-9393-3f15291cf0b6 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:31.188600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9e007ee0-2655-4618-9393-3f15291cf0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:31.277050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5df803-1bcb-473e-8ed0-4da6b29312a2 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:31.278826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e007ee0-2655-4618-9393-3f15291cf0b6 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:31.282668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa0605-14f7-405e-a07d-1c5f2cfee862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:31.283511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa0605-14f7-405e-a07d-1c5f2cfee862 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:31.283955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa0605-14f7-405e-a07d-1c5f2cfee862 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:31.284203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa0605-14f7-405e-a07d-1c5f2cfee862 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:31.285129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa0605-14f7-405e-a07d-1c5f2cfee862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:31.286851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa0605-14f7-405e-a07d-1c5f2cfee862 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:31.303377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 938/1860] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:31.308465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa0605-14f7-405e-a07d-1c5f2cfee862 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:31.334978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa0605-14f7-405e-a07d-1c5f2cfee862 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:31.340836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a46d30-cdde-45c4-bdd5-ed8789826ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:31.342035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a46d30-cdde-45c4-bdd5-ed8789826ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:31.342323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a46d30-cdde-45c4-bdd5-ed8789826ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:31.342625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a46d30-cdde-45c4-bdd5-ed8789826ac8 admin admin] PATH_INFO: `/v3/projects/ba23da6d46a84273992fd9a091e79ba5/users/2b563062d56947a2a6a236c37100152e/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:31.346036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a46d30-cdde-45c4-bdd5-ed8789826ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba23da6d46a84273992fd9a091e79ba5, user_id=2b563062d56947a2a6a236c37100152e, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:31.349884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a46d30-cdde-45c4-bdd5-ed8789826ac8 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:31.360955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a81dd-e68e-4c0b-900b-c1937b88116d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:31.372982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a81dd-e68e-4c0b-900b-c1937b88116d service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:31.372982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a81dd-e68e-4c0b-900b-c1937b88116d service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:31.372982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a81dd-e68e-4c0b-900b-c1937b88116d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:31.373189 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 939/1861] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:31 2022] PUT /identity/v3/projects/ba23da6d46a84273992fd9a091e79ba5/users/2b563062d56947a2a6a236c37100152e/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:31.375764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a81dd-e68e-4c0b-900b-c1937b88116d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:31.377484 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a81dd-e68e-4c0b-900b-c1937b88116d service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:31.383718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b908f-c92e-4621-a80d-7ba500985b47 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:31.385086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b908f-c92e-4621-a80d-7ba500985b47 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:31.385086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b908f-c92e-4621-a80d-7ba500985b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:31.390675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 923/1862] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:31.423030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e73b908f-c92e-4621-a80d-7ba500985b47 None None] MFA Rules not processed for user `2b563062d56947a2a6a236c37100152e`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:31.424256 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e73b908f-c92e-4621-a80d-7ba500985b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:31.539412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 940/1863] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:31.556463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a81dd-e68e-4c0b-900b-c1937b88116d service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:31.558321 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ff1a81dd-e68e-4c0b-900b-c1937b88116d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:31.651040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a81dd-e68e-4c0b-900b-c1937b88116d service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:31.744434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251bb44-8887-41ea-b80b-7e20f7577aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:31.745138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251bb44-8887-41ea-b80b-7e20f7577aad service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:31.745769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251bb44-8887-41ea-b80b-7e20f7577aad service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:31.745870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251bb44-8887-41ea-b80b-7e20f7577aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:31.758222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251bb44-8887-41ea-b80b-7e20f7577aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:31.760822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251bb44-8887-41ea-b80b-7e20f7577aad service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:31.772659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 924/1864] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:31.926115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b908f-c92e-4621-a80d-7ba500985b47 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:31.944693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251bb44-8887-41ea-b80b-7e20f7577aad service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:31.946763 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4251bb44-8887-41ea-b80b-7e20f7577aad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:32.033622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b908f-c92e-4621-a80d-7ba500985b47 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:32.039696 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:32.041282 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:32.041569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:32.041846 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] PATH_INFO: `/v3/users/210e4ed5dd3c425995fff112dd738a58` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:32.047273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] RBAC: Authorizing `identity:delete_user(user_id=210e4ed5dd3c425995fff112dd738a58)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:32.047273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:32.094646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251bb44-8887-41ea-b80b-7e20f7577aad service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:32.097479 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:32.098589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:32.098892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:32.099142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] PATH_INFO: `/v3/users/6beabb7911684f308a834972f4d824d3` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:32.100613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6beabb7911684f308a834972f4d824d3)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:32.102862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:32.151174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:32.391794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '210e4ed5dd3c425995fff112dd738a58'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.408613 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '210e4ed5dd3c425995fff112dd738a58'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.418697 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '210e4ed5dd3c425995fff112dd738a58'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.547628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '210e4ed5dd3c425995fff112dd738a58'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.548933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '210e4ed5dd3c425995fff112dd738a58'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.558703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 941/1865] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:31 2022] DELETE /identity/v3/users/210e4ed5dd3c425995fff112dd738a58 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:32.562643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:32.567704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:32.568561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6beabb7911684f308a834972f4d824d3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.585831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6beabb7911684f308a834972f4d824d3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.596445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:32.597067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6beabb7911684f308a834972f4d824d3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.642434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04603081-a05d-4618-bf43-c1f704ceb27d admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:32.647404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514d341-9f28-4332-8f7f-70aa39a69ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:32.648381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514d341-9f28-4332-8f7f-70aa39a69ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:32.648798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514d341-9f28-4332-8f7f-70aa39a69ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:32.649079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514d341-9f28-4332-8f7f-70aa39a69ec1 admin admin] PATH_INFO: `/v3/projects/8ec7a2b3e7384d6990bc9e5ad281dfc7` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:32.650364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514d341-9f28-4332-8f7f-70aa39a69ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec7a2b3e7384d6990bc9e5ad281dfc7)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:32.652311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514d341-9f28-4332-8f7f-70aa39a69ec1 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:32.735876 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6beabb7911684f308a834972f4d824d3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.737222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6beabb7911684f308a834972f4d824d3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.749727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 925/1866] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:31 2022] DELETE /identity/v3/users/6beabb7911684f308a834972f4d824d3 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:32.752581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:32.753653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:32.820373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d95d9-4a4a-4b2e-b234-dd579c609c11 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:32.821573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f514d341-9f28-4332-8f7f-70aa39a69ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec7a2b3e7384d6990bc9e5ad281dfc7', 'request_id': 'req-f514d341-9f28-4332-8f7f-70aa39a69ec1'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.830006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f514d341-9f28-4332-8f7f-70aa39a69ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec7a2b3e7384d6990bc9e5ad281dfc7', 'request_id': 'req-f514d341-9f28-4332-8f7f-70aa39a69ec1'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.841573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f514d341-9f28-4332-8f7f-70aa39a69ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec7a2b3e7384d6990bc9e5ad281dfc7', 'request_id': 'req-f514d341-9f28-4332-8f7f-70aa39a69ec1'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.884566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a5b8e-40ce-4de0-81cc-3b0b8139de9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:32.884566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a5b8e-40ce-4de0-81cc-3b0b8139de9a service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:32.884566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a5b8e-40ce-4de0-81cc-3b0b8139de9a service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:32.884566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a5b8e-40ce-4de0-81cc-3b0b8139de9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:32.893388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-157a5b8e-40ce-4de0-81cc-3b0b8139de9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:32.938565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f514d341-9f28-4332-8f7f-70aa39a69ec1 admin admin] The token cache is being invalidate because project 8ec7a2b3e7384d6990bc9e5ad281dfc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:32.939071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f514d341-9f28-4332-8f7f-70aa39a69ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.939862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f514d341-9f28-4332-8f7f-70aa39a69ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:32.942344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 942/1867] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:32 2022] DELETE /identity/v3/projects/8ec7a2b3e7384d6990bc9e5ad281dfc7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:32.943920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab49896-2b49-4817-ba47-08da3dc2c068 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:32.944412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab49896-2b49-4817-ba47-08da3dc2c068 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:32.944778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab49896-2b49-4817-ba47-08da3dc2c068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:32.970863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-8ab49896-2b49-4817-ba47-08da3dc2c068 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:32.972725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8ab49896-2b49-4817-ba47-08da3dc2c068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:32.995126 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a5b8e-40ce-4de0-81cc-3b0b8139de9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:32.998976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a5b8e-40ce-4de0-81cc-3b0b8139de9a service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:33.051871 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 926/1868] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:33.053620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c97f86-3b92-40c3-b25b-6eb8fa0275ce None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:33.053901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c97f86-3b92-40c3-b25b-6eb8fa0275ce None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:33.061087 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c97f86-3b92-40c3-b25b-6eb8fa0275ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:33.109653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-63c97f86-3b92-40c3-b25b-6eb8fa0275ce None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:33.117606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-63c97f86-3b92-40c3-b25b-6eb8fa0275ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:33.135580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 943/1869] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:33.136674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab49896-2b49-4817-ba47-08da3dc2c068 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:33.139414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8ab49896-2b49-4817-ba47-08da3dc2c068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:33.150601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 927/1870] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:33.158587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c97f86-3b92-40c3-b25b-6eb8fa0275ce None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:33.161083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-63c97f86-3b92-40c3-b25b-6eb8fa0275ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:33.161574 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab49896-2b49-4817-ba47-08da3dc2c068 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:33.168045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:33.169084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:33.169392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:33.169639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] PATH_INFO: `/v3/users/6b550e8f69df49e9a06cc456f96a7f3f` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:33.172027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b550e8f69df49e9a06cc456f96a7f3f)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:33.174922 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:33.273951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c97f86-3b92-40c3-b25b-6eb8fa0275ce None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:33.280407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd405f97-4b33-4fe7-8f24-56796d494de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:33.281316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd405f97-4b33-4fe7-8f24-56796d494de6 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:33.281684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd405f97-4b33-4fe7-8f24-56796d494de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:33.282089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd405f97-4b33-4fe7-8f24-56796d494de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:33.293231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd405f97-4b33-4fe7-8f24-56796d494de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:33.294710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd405f97-4b33-4fe7-8f24-56796d494de6 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:33.306621 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 928/1871] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:33.310027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd405f97-4b33-4fe7-8f24-56796d494de6 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:33.312601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bd405f97-4b33-4fe7-8f24-56796d494de6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:33.337445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd405f97-4b33-4fe7-8f24-56796d494de6 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:33.342619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73edb0-66f8-4b0f-8a80-e0dd12b7d943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:33.343297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73edb0-66f8-4b0f-8a80-e0dd12b7d943 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:33.343804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73edb0-66f8-4b0f-8a80-e0dd12b7d943 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:33.348315 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73edb0-66f8-4b0f-8a80-e0dd12b7d943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:33.357653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73edb0-66f8-4b0f-8a80-e0dd12b7d943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:33.359261 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73edb0-66f8-4b0f-8a80-e0dd12b7d943 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:33.371440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 929/1872] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:33.550020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b550e8f69df49e9a06cc456f96a7f3f'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:33.577335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b550e8f69df49e9a06cc456f96a7f3f'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:33.590406 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b550e8f69df49e9a06cc456f96a7f3f'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:33.714413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b550e8f69df49e9a06cc456f96a7f3f'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:33.714932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b550e8f69df49e9a06cc456f96a7f3f'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:33.727269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 944/1873] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:33 2022] DELETE /identity/v3/users/6b550e8f69df49e9a06cc456f96a7f3f => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:34.301366 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73edb0-66f8-4b0f-8a80-e0dd12b7d943 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:34.303704 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0a73edb0-66f8-4b0f-8a80-e0dd12b7d943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:34.331609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73edb0-66f8-4b0f-8a80-e0dd12b7d943 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:34.473872 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:34.478060 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:34.535040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:34.536914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:34.537430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:34.537934 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] PATH_INFO: `/v3/projects/ce547161b25b43a585c3531397f3800d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:34.567779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce547161b25b43a585c3531397f3800d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:34.584089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:34.680535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74cca7-0d5b-44ca-b34e-bc927bdfbd61 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:34.686204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:34.687483 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:34.687823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:34.688116 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] PATH_INFO: `/v3/projects/dd226b6f240f4eb88ef3d74e62660f95` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:34.689430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd226b6f240f4eb88ef3d74e62660f95)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:34.691409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:34.791289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce547161b25b43a585c3531397f3800d', 'request_id': 'req-e68fe120-630e-44c5-a25a-f1f59c87bdc5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:34.798253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce547161b25b43a585c3531397f3800d', 'request_id': 'req-e68fe120-630e-44c5-a25a-f1f59c87bdc5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:34.880281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd226b6f240f4eb88ef3d74e62660f95', 'request_id': 'req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:34.895846 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd226b6f240f4eb88ef3d74e62660f95', 'request_id': 'req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:34.908113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd226b6f240f4eb88ef3d74e62660f95', 'request_id': 'req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:34.926044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce547161b25b43a585c3531397f3800d', 'request_id': 'req-e68fe120-630e-44c5-a25a-f1f59c87bdc5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:34.941776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] The token cache is being invalidate because project ce547161b25b43a585c3531397f3800d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:34.942127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:34.942828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:34.944523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 930/1874] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:34 2022] DELETE /identity/v3/projects/ce547161b25b43a585c3531397f3800d => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:34.949584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:34.949584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:35.036756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fe120-630e-44c5-a25a-f1f59c87bdc5 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:35.076104 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] The token cache is being invalidate because project dd226b6f240f4eb88ef3d74e62660f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:35.080930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.086042 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.091869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 945/1875] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:34 2022] DELETE /identity/v3/projects/dd226b6f240f4eb88ef3d74e62660f95 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:35.095073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:35.096571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:35.120351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:35.123717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:35.123717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:35.123717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] PATH_INFO: `/v3/projects/5b0a1c0273a14baba46057aaf87926ff` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:35.123717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0a1c0273a14baba46057aaf87926ff)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:35.125271 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:35.184510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:35.188995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fabf28-496c-45f3-8d7d-afc8e5ff47ae admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:35.195217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44ebe1-7881-403f-9c36-9a499a67302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:35.196368 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ebe1-7881-403f-9c36-9a499a67302f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:35.196789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ebe1-7881-403f-9c36-9a499a67302f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:35.196949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ebe1-7881-403f-9c36-9a499a67302f admin admin] PATH_INFO: `/v3/users/2b563062d56947a2a6a236c37100152e` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:35.198291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44ebe1-7881-403f-9c36-9a499a67302f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b563062d56947a2a6a236c37100152e)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:35.200258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44ebe1-7881-403f-9c36-9a499a67302f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:35.303252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0a1c0273a14baba46057aaf87926ff', 'request_id': 'req-e226316d-d5f7-4f90-b706-901b7a9de162'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.311480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0a1c0273a14baba46057aaf87926ff', 'request_id': 'req-e226316d-d5f7-4f90-b706-901b7a9de162'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.393577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0a1c0273a14baba46057aaf87926ff', 'request_id': 'req-e226316d-d5f7-4f90-b706-901b7a9de162'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.410935 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] The token cache is being invalidate because project 5b0a1c0273a14baba46057aaf87926ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:35.411595 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.413295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.416168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 931/1876] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:34 2022] DELETE /identity/v3/projects/5b0a1c0273a14baba46057aaf87926ff => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:35.422300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:35.424105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:35.483854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1f44ebe1-7881-403f-9c36-9a499a67302f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b563062d56947a2a6a236c37100152e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.514510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226316d-d5f7-4f90-b706-901b7a9de162 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:35.520332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:35.521339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:35.521640 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:35.521921 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] PATH_INFO: `/v3/users/10b683e2bfe442829a24b84172ba93ab` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:35.524157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b683e2bfe442829a24b84172ba93ab)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:35.526938 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:35.555180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1f44ebe1-7881-403f-9c36-9a499a67302f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b563062d56947a2a6a236c37100152e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.573264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1f44ebe1-7881-403f-9c36-9a499a67302f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b563062d56947a2a6a236c37100152e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.720712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1f44ebe1-7881-403f-9c36-9a499a67302f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b563062d56947a2a6a236c37100152e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.722836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1f44ebe1-7881-403f-9c36-9a499a67302f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b563062d56947a2a6a236c37100152e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.736331 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 946/1877] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:35 2022] DELETE /identity/v3/users/2b563062d56947a2a6a236c37100152e => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:35.740087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b2575-6b44-4c09-a5e3-32b669e9dbfb None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:35.742953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b2575-6b44-4c09-a5e3-32b669e9dbfb None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:35.746932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b2575-6b44-4c09-a5e3-32b669e9dbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:35.783530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-6f5b2575-6b44-4c09-a5e3-32b669e9dbfb None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:35.795558 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6f5b2575-6b44-4c09-a5e3-32b669e9dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:35.890404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b683e2bfe442829a24b84172ba93ab'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.917118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b683e2bfe442829a24b84172ba93ab'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.927408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b683e2bfe442829a24b84172ba93ab'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:35.935925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 947/1878] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:35.945033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a57ae1-435c-44dc-945a-c08b6477b823 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:35.945505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a57ae1-435c-44dc-945a-c08b6477b823 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:35.945995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a57ae1-435c-44dc-945a-c08b6477b823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:35.983214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:35.983431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-83a57ae1-435c-44dc-945a-c08b6477b823 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:35.984750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-83a57ae1-435c-44dc-945a-c08b6477b823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:35.994141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 948/1879] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:36.001279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a57ae1-435c-44dc-945a-c08b6477b823 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:36.012111 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a57ae1-435c-44dc-945a-c08b6477b823 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:36.017007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcdb0d-6a40-44e4-99f2-c88383fd0368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:36.017681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcdb0d-6a40-44e4-99f2-c88383fd0368 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:36.017963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcdb0d-6a40-44e4-99f2-c88383fd0368 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:36.018235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcdb0d-6a40-44e4-99f2-c88383fd0368 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:36.018969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcdb0d-6a40-44e4-99f2-c88383fd0368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:36.019286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcdb0d-6a40-44e4-99f2-c88383fd0368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:36.021106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcdb0d-6a40-44e4-99f2-c88383fd0368 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:36.035215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 949/1880] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:58:36.041145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcdb0d-6a40-44e4-99f2-c88383fd0368 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:36.052938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcdb0d-6a40-44e4-99f2-c88383fd0368 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:36.058165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b683e2bfe442829a24b84172ba93ab'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:36.059256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b683e2bfe442829a24b84172ba93ab'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:36.061886 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5285e9b-fa51-42af-9bce-96217feee1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:36.063061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285e9b-fa51-42af-9bce-96217feee1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:36.064177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285e9b-fa51-42af-9bce-96217feee1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:36.064947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285e9b-fa51-42af-9bce-96217feee1d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:36.066706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5285e9b-fa51-42af-9bce-96217feee1d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:36.075159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5285e9b-fa51-42af-9bce-96217feee1d7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:36.075309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 932/1881] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:35 2022] DELETE /identity/v3/users/10b683e2bfe442829a24b84172ba93ab => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:36.228184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 950/1882] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:36 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:36.233021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:36.234697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:36.421445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12681-b8fb-4692-8bfc-66696738d506 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:36.528300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3b531-54c1-4eac-a60c-c757e61e36fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:36.529040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3b531-54c1-4eac-a60c-c757e61e36fb admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:36.529318 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3b531-54c1-4eac-a60c-c757e61e36fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:36.529748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3b531-54c1-4eac-a60c-c757e61e36fb admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:36.530600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3b531-54c1-4eac-a60c-c757e61e36fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:36.532815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3b531-54c1-4eac-a60c-c757e61e36fb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:36.643508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5285e9b-fa51-42af-9bce-96217feee1d7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:36.645788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d5285e9b-fa51-42af-9bce-96217feee1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:36.669388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5285e9b-fa51-42af-9bce-96217feee1d7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:36.674630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b49c43-89ea-4691-9bc2-da359840a171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:36.675545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b49c43-89ea-4691-9bc2-da359840a171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:36.675882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b49c43-89ea-4691-9bc2-da359840a171 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:36.676160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b49c43-89ea-4691-9bc2-da359840a171 admin admin] PATH_INFO: `/v3/projects/ba23da6d46a84273992fd9a091e79ba5` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:36.677571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b49c43-89ea-4691-9bc2-da359840a171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba23da6d46a84273992fd9a091e79ba5)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:36.679291 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 933/1883] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:36 2022] POST /identity/v3/users => generated 294 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:36.681244 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b49c43-89ea-4691-9bc2-da359840a171 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:36.681863 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3b531-54c1-4eac-a60c-c757e61e36fb admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:36.703479 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3b531-54c1-4eac-a60c-c757e61e36fb admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:36.720841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceb655-111a-456c-a7a1-597eaf953faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:36.722188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceb655-111a-456c-a7a1-597eaf953faa admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:36.722852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceb655-111a-456c-a7a1-597eaf953faa admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:36.723600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceb655-111a-456c-a7a1-597eaf953faa admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:36.725004 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceb655-111a-456c-a7a1-597eaf953faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:36.728510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceb655-111a-456c-a7a1-597eaf953faa admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:36.743168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 934/1884] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:36.747226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceb655-111a-456c-a7a1-597eaf953faa admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:36.761616 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceb655-111a-456c-a7a1-597eaf953faa admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:36.772198 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ca290-5517-40e9-8793-aef8a884a692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:36.772564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ca290-5517-40e9-8793-aef8a884a692 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:36.772995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ca290-5517-40e9-8793-aef8a884a692 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:36.773462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ca290-5517-40e9-8793-aef8a884a692 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:36.774949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ca290-5517-40e9-8793-aef8a884a692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:36.778020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ca290-5517-40e9-8793-aef8a884a692 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:36.792337 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 935/1885] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:36.797137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ca290-5517-40e9-8793-aef8a884a692 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:36.810598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ca290-5517-40e9-8793-aef8a884a692 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:36.816797 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41359c-55d7-4763-9d16-dd27840fd9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:36.818835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41359c-55d7-4763-9d16-dd27840fd9f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:36.818835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41359c-55d7-4763-9d16-dd27840fd9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:36.818835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41359c-55d7-4763-9d16-dd27840fd9f5 admin admin] PATH_INFO: `/v3/projects/7cb9ffa3234b4ea4bdbc2e543adf4985/users/4020e5f4640143bca581998234427535/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:36.857375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-29b49c43-89ea-4691-9bc2-da359840a171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba23da6d46a84273992fd9a091e79ba5', 'request_id': 'req-29b49c43-89ea-4691-9bc2-da359840a171'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:36.860598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41359c-55d7-4763-9d16-dd27840fd9f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb9ffa3234b4ea4bdbc2e543adf4985, user_id=4020e5f4640143bca581998234427535, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:36.864615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41359c-55d7-4763-9d16-dd27840fd9f5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:36.890040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-29b49c43-89ea-4691-9bc2-da359840a171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba23da6d46a84273992fd9a091e79ba5', 'request_id': 'req-29b49c43-89ea-4691-9bc2-da359840a171'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:36.935265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-29b49c43-89ea-4691-9bc2-da359840a171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba23da6d46a84273992fd9a091e79ba5', 'request_id': 'req-29b49c43-89ea-4691-9bc2-da359840a171'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:36.994483 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 936/1886] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:36 2022] PUT /identity/v3/projects/7cb9ffa3234b4ea4bdbc2e543adf4985/users/4020e5f4640143bca581998234427535/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:37.007815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfc037-a44b-41a9-b914-307069ddf299 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:37.008510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfc037-a44b-41a9-b914-307069ddf299 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:37.009073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfc037-a44b-41a9-b914-307069ddf299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:37.026429 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-29b49c43-89ea-4691-9bc2-da359840a171 admin admin] The token cache is being invalidate because project ba23da6d46a84273992fd9a091e79ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:37.027311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-29b49c43-89ea-4691-9bc2-da359840a171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:37.029076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-29b49c43-89ea-4691-9bc2-da359840a171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:37.032344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 951/1887] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:36 2022] DELETE /identity/v3/projects/ba23da6d46a84273992fd9a091e79ba5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:37.043246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6946d-db07-4fe7-85f6-12ea8a0f77eb None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:37.044204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6946d-db07-4fe7-85f6-12ea8a0f77eb None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:37.045582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6946d-db07-4fe7-85f6-12ea8a0f77eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:37.076088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-77e6946d-db07-4fe7-85f6-12ea8a0f77eb None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:37.078006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-77e6946d-db07-4fe7-85f6-12ea8a0f77eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:37.088324 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-69bfc037-a44b-41a9-b914-307069ddf299 None None] MFA Rules not processed for user `4020e5f4640143bca581998234427535`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:37.091011 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-69bfc037-a44b-41a9-b914-307069ddf299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:37.240225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 952/1888] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:37.241972 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6946d-db07-4fe7-85f6-12ea8a0f77eb None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:37.244432 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-77e6946d-db07-4fe7-85f6-12ea8a0f77eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:37.275448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6946d-db07-4fe7-85f6-12ea8a0f77eb None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:37.304609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:37.306146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:37.306616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:37.307081 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] PATH_INFO: `/v3/projects/bd3d8da529e54573a2ebd899472e8478` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:37.315130 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3d8da529e54573a2ebd899472e8478)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:37.317756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 937/1889] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:37.322171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:37.324296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7355c-aabf-4aa4-b2e7-58a34c1a2bad None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:37.324745 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7355c-aabf-4aa4-b2e7-58a34c1a2bad None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:37.325176 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7355c-aabf-4aa4-b2e7-58a34c1a2bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:37.346263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-2bf7355c-aabf-4aa4-b2e7-58a34c1a2bad None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:37.347637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2bf7355c-aabf-4aa4-b2e7-58a34c1a2bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:37.369197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 938/1890] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:37.371074 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7355c-aabf-4aa4-b2e7-58a34c1a2bad None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:37.372822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2bf7355c-aabf-4aa4-b2e7-58a34c1a2bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:37.390196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7355c-aabf-4aa4-b2e7-58a34c1a2bad None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:37.395486 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c013e1-8466-4b6a-8ab0-ff0e78b8a17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:37.396284 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c013e1-8466-4b6a-8ab0-ff0e78b8a17f admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:37.396746 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c013e1-8466-4b6a-8ab0-ff0e78b8a17f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:37.397243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c013e1-8466-4b6a-8ab0-ff0e78b8a17f admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:37.398987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c013e1-8466-4b6a-8ab0-ff0e78b8a17f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:37.400588 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c013e1-8466-4b6a-8ab0-ff0e78b8a17f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:37.490505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:37.523026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3d8da529e54573a2ebd899472e8478', 'request_id': 'req-59e6a423-579a-4d53-95dd-d705660c7865'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:37.537682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3d8da529e54573a2ebd899472e8478', 'request_id': 'req-59e6a423-579a-4d53-95dd-d705660c7865'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:37.546392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3d8da529e54573a2ebd899472e8478', 'request_id': 'req-59e6a423-579a-4d53-95dd-d705660c7865'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:37.577040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 939/1891] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:37 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:37.578679 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c013e1-8466-4b6a-8ab0-ff0e78b8a17f admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:37.668355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c013e1-8466-4b6a-8ab0-ff0e78b8a17f admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:37.673839 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfdd21-382e-4340-a1ef-223d4aded356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:37.674535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfdd21-382e-4340-a1ef-223d4aded356 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:37.674824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfdd21-382e-4340-a1ef-223d4aded356 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:37.675107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfdd21-382e-4340-a1ef-223d4aded356 admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:37.675866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfdd21-382e-4340-a1ef-223d4aded356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:37.676195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfdd21-382e-4340-a1ef-223d4aded356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:37.678247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfdd21-382e-4340-a1ef-223d4aded356 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:37.693782 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 940/1892] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:58:37.695428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfdd21-382e-4340-a1ef-223d4aded356 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:37.709735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] The token cache is being invalidate because project bd3d8da529e54573a2ebd899472e8478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:37.710269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:37.710942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfdd21-382e-4340-a1ef-223d4aded356 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:37.711651 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:37.717009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a66cc9-2897-4f4b-8054-d2f15a026f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:37.717417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 953/1893] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:37 2022] DELETE /identity/v3/projects/bd3d8da529e54573a2ebd899472e8478 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:37.717622 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66cc9-2897-4f4b-8054-d2f15a026f20 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:37.718084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66cc9-2897-4f4b-8054-d2f15a026f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:37.718560 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66cc9-2897-4f4b-8054-d2f15a026f20 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:37.718851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:37.719449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a66cc9-2897-4f4b-8054-d2f15a026f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:37.721862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a66cc9-2897-4f4b-8054-d2f15a026f20 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:37.726663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:37.822552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6a423-579a-4d53-95dd-d705660c7865 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:37.828226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50236012-f8a6-4a08-9970-5f1d12cb5948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:37.828965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50236012-f8a6-4a08-9970-5f1d12cb5948 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:37.829246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50236012-f8a6-4a08-9970-5f1d12cb5948 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:37.829525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50236012-f8a6-4a08-9970-5f1d12cb5948 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:37.830247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50236012-f8a6-4a08-9970-5f1d12cb5948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:37.832197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50236012-f8a6-4a08-9970-5f1d12cb5948 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:37.902782 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 941/1894] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:37 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:37.905225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a988ed-9ffa-47a4-b946-b3ab0d0a4c54 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:37.905553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a988ed-9ffa-47a4-b946-b3ab0d0a4c54 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:37.905924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a988ed-9ffa-47a4-b946-b3ab0d0a4c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:37.927395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e2a988ed-9ffa-47a4-b946-b3ab0d0a4c54 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:37.929586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e2a988ed-9ffa-47a4-b946-b3ab0d0a4c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:37.938275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 942/1895] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:37.939143 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a988ed-9ffa-47a4-b946-b3ab0d0a4c54 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:37.940551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e2a988ed-9ffa-47a4-b946-b3ab0d0a4c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:37.954322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a988ed-9ffa-47a4-b946-b3ab0d0a4c54 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:37.959123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3c79c-72e4-4d79-ab6e-6d9391a40723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:37.959791 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3c79c-72e4-4d79-ab6e-6d9391a40723 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:37.960103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3c79c-72e4-4d79-ab6e-6d9391a40723 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:37.960384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3c79c-72e4-4d79-ab6e-6d9391a40723 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:37.964971 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3c79c-72e4-4d79-ab6e-6d9391a40723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:37.964971 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3c79c-72e4-4d79-ab6e-6d9391a40723 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:37.976979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 943/1896] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:37.978787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edfb37-3e5a-4790-bf07-d833d2e20765 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:37.979084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edfb37-3e5a-4790-bf07-d833d2e20765 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:37.979371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edfb37-3e5a-4790-bf07-d833d2e20765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:37.998227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d3edfb37-3e5a-4790-bf07-d833d2e20765 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:37.999454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d3edfb37-3e5a-4790-bf07-d833d2e20765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:38.008905 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 944/1897] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:38.011140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edfb37-3e5a-4790-bf07-d833d2e20765 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:38.011261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 954/1898] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:37 2022] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:38.013921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50236012-f8a6-4a08-9970-5f1d12cb5948 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:38.020841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edfb37-3e5a-4790-bf07-d833d2e20765 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:38.090661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50236012-f8a6-4a08-9970-5f1d12cb5948 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:38.095888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3251310-28a4-4a7e-8c63-8388c3a4a2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:38.096919 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3251310-28a4-4a7e-8c63-8388c3a4a2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:38.097353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3251310-28a4-4a7e-8c63-8388c3a4a2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:38.097776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3251310-28a4-4a7e-8c63-8388c3a4a2a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:38.098681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3251310-28a4-4a7e-8c63-8388c3a4a2a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:38.098992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3251310-28a4-4a7e-8c63-8388c3a4a2a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:38.100856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3251310-28a4-4a7e-8c63-8388c3a4a2a8 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:38.109081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632634-edd8-4cc2-b425-ee975104d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:38.109081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632634-edd8-4cc2-b425-ee975104d630 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:38.109081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632634-edd8-4cc2-b425-ee975104d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:38.109081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632634-edd8-4cc2-b425-ee975104d630 admin admin] PATH_INFO: `/v3/projects/4ac96e83ccb54d87871c74713246f5e2/users/4e2a7dc5cbda4fefa0fad3fa469e0cec/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:38.134248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c632634-edd8-4cc2-b425-ee975104d630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac96e83ccb54d87871c74713246f5e2, user_id=4e2a7dc5cbda4fefa0fad3fa469e0cec, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:38.134494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 955/1899] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:58:38.135275 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3251310-28a4-4a7e-8c63-8388c3a4a2a8 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:38.139865 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c632634-edd8-4cc2-b425-ee975104d630 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:38.151137 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3251310-28a4-4a7e-8c63-8388c3a4a2a8 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:38.157006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a137f29-b36d-4f24-b4ee-10efc8288141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:38.157781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a137f29-b36d-4f24-b4ee-10efc8288141 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:38.158126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a137f29-b36d-4f24-b4ee-10efc8288141 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:38.158409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a137f29-b36d-4f24-b4ee-10efc8288141 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:38.159128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a137f29-b36d-4f24-b4ee-10efc8288141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:38.161171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a137f29-b36d-4f24-b4ee-10efc8288141 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:38.257407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:38.309032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 945/1900] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:38 2022] PUT /identity/v3/projects/4ac96e83ccb54d87871c74713246f5e2/users/4e2a7dc5cbda4fefa0fad3fa469e0cec/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:38.310422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632634-edd8-4cc2-b425-ee975104d630 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:38.322637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 956/1901] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:38 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:38.324524 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a137f29-b36d-4f24-b4ee-10efc8288141 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:38.346419 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a137f29-b36d-4f24-b4ee-10efc8288141 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:38.481227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0d4eb-a86e-4b9f-9505-86b8d5fd57e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:38.485518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632634-edd8-4cc2-b425-ee975104d630 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:38.487667 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0d4eb-a86e-4b9f-9505-86b8d5fd57e9 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:38.488720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0d4eb-a86e-4b9f-9505-86b8d5fd57e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:38.489610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0d4eb-a86e-4b9f-9505-86b8d5fd57e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:38.493626 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0d4eb-a86e-4b9f-9505-86b8d5fd57e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:38.496636 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0d4eb-a86e-4b9f-9505-86b8d5fd57e9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:38.498231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbc323-4bf5-4b61-812f-3a667a25d4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:38.498921 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbc323-4bf5-4b61-812f-3a667a25d4ba admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:38.499203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbc323-4bf5-4b61-812f-3a667a25d4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:38.499482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbc323-4bf5-4b61-812f-3a667a25d4ba admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:38.500191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbc323-4bf5-4b61-812f-3a667a25d4ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:38.502774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbc323-4bf5-4b61-812f-3a667a25d4ba admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:38.542483 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 957/1902] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:38.544140 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0d4eb-a86e-4b9f-9505-86b8d5fd57e9 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:38.558539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0d4eb-a86e-4b9f-9505-86b8d5fd57e9 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:38.566649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f7c59-559b-4042-abd4-b75041f18570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:38.567404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f7c59-559b-4042-abd4-b75041f18570 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:38.567726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f7c59-559b-4042-abd4-b75041f18570 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:38.568018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f7c59-559b-4042-abd4-b75041f18570 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:38.570787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f7c59-559b-4042-abd4-b75041f18570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:38.573959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f7c59-559b-4042-abd4-b75041f18570 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:38.590776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 958/1903] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:38.592174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f7c59-559b-4042-abd4-b75041f18570 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:38.607848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f7c59-559b-4042-abd4-b75041f18570 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:38.614527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5aea8-294c-433b-941e-998c87dd4bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:38.615607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5aea8-294c-433b-941e-998c87dd4bec admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:38.615888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5aea8-294c-433b-941e-998c87dd4bec admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:38.616170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5aea8-294c-433b-941e-998c87dd4bec admin admin] PATH_INFO: `/v3/projects/4ac96e83ccb54d87871c74713246f5e2/users/4e2a7dc5cbda4fefa0fad3fa469e0cec/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:38.621303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5aea8-294c-433b-941e-998c87dd4bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac96e83ccb54d87871c74713246f5e2, user_id=4e2a7dc5cbda4fefa0fad3fa469e0cec, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:38.629904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5aea8-294c-433b-941e-998c87dd4bec admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:38.652538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 959/1904] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:38 2022] PUT /identity/v3/projects/4ac96e83ccb54d87871c74713246f5e2/users/4e2a7dc5cbda4fefa0fad3fa469e0cec/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:38.653233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5aea8-294c-433b-941e-998c87dd4bec admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:38.667546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 946/1905] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:38 2022] POST /identity/v3/projects => generated 363 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:38.673863 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbc323-4bf5-4b61-812f-3a667a25d4ba admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:38.768107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5aea8-294c-433b-941e-998c87dd4bec admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:38.772601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbc323-4bf5-4b61-812f-3a667a25d4ba admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:38.773892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23179f3c-b4a9-4cc6-8b2b-930e785ada40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:38.774610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179f3c-b4a9-4cc6-8b2b-930e785ada40 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:38.774932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179f3c-b4a9-4cc6-8b2b-930e785ada40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:38.775180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179f3c-b4a9-4cc6-8b2b-930e785ada40 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:38.775928 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23179f3c-b4a9-4cc6-8b2b-930e785ada40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:38.777655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23179f3c-b4a9-4cc6-8b2b-930e785ada40 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:38.780404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13f6a6-59d9-4bfa-a21d-b058d22d1e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:38.782227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f6a6-59d9-4bfa-a21d-b058d22d1e6c admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:38.782745 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f6a6-59d9-4bfa-a21d-b058d22d1e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:38.783288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13f6a6-59d9-4bfa-a21d-b058d22d1e6c admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:38.784726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13f6a6-59d9-4bfa-a21d-b058d22d1e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:38.788856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13f6a6-59d9-4bfa-a21d-b058d22d1e6c admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:38.795027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 960/1906] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:38.795027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c223-240c-49bf-b8f7-706c25ac9c7e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:38.795027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c223-240c-49bf-b8f7-706c25ac9c7e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:38.795870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c223-240c-49bf-b8f7-706c25ac9c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:38.828868 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-6e49c223-240c-49bf-b8f7-706c25ac9c7e None None] MFA Rules not processed for user `4e2a7dc5cbda4fefa0fad3fa469e0cec`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:38.830119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6e49c223-240c-49bf-b8f7-706c25ac9c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:38.921825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 947/1907] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:38 2022] POST /identity/v3/users => generated 282 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:38.928001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13f6a6-59d9-4bfa-a21d-b058d22d1e6c admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:38.947078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13f6a6-59d9-4bfa-a21d-b058d22d1e6c admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:38.961817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3c374-82ae-4a04-a085-111cbc571149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:38.962801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3c374-82ae-4a04-a085-111cbc571149 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:38.968387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3c374-82ae-4a04-a085-111cbc571149 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:38.968387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3c374-82ae-4a04-a085-111cbc571149 admin admin] PATH_INFO: `/v3/projects/ccd14d1d41504eafa8320acfdce3f00f/users/9f59a79eadf84f5e992323b85d4afe05/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:38.970316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 961/1908] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:38.971592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49c223-240c-49bf-b8f7-706c25ac9c7e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:38.989045 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3c374-82ae-4a04-a085-111cbc571149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd14d1d41504eafa8320acfdce3f00f, user_id=9f59a79eadf84f5e992323b85d4afe05, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:38.993873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3c374-82ae-4a04-a085-111cbc571149 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:38.996169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49c223-240c-49bf-b8f7-706c25ac9c7e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:39.003281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91a425-923d-45dc-bff2-36aabcb245b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:39.004404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91a425-923d-45dc-bff2-36aabcb245b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:39.004859 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91a425-923d-45dc-bff2-36aabcb245b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:39.005281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91a425-923d-45dc-bff2-36aabcb245b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:39.006209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91a425-923d-45dc-bff2-36aabcb245b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:39.008893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91a425-923d-45dc-bff2-36aabcb245b4 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:39.022211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 962/1909] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:39.022211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91a425-923d-45dc-bff2-36aabcb245b4 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:39.028036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6f91a425-923d-45dc-bff2-36aabcb245b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:39.103539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91a425-923d-45dc-bff2-36aabcb245b4 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:39.108383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af825a06-b702-4c26-aa2c-4a66cc0011da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:39.109112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825a06-b702-4c26-aa2c-4a66cc0011da service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:39.109403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825a06-b702-4c26-aa2c-4a66cc0011da service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:39.109680 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825a06-b702-4c26-aa2c-4a66cc0011da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:39.121083 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af825a06-b702-4c26-aa2c-4a66cc0011da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:39.122636 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af825a06-b702-4c26-aa2c-4a66cc0011da service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:39.139097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 963/1910] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:39.140064 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af825a06-b702-4c26-aa2c-4a66cc0011da service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:39.150471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 948/1911] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:38 2022] PUT /identity/v3/projects/ccd14d1d41504eafa8320acfdce3f00f/users/9f59a79eadf84f5e992323b85d4afe05/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:39.154841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af825a06-b702-4c26-aa2c-4a66cc0011da service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:39.160999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0a737-cccc-4b38-abab-8e9e99ff4b5f None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:39.161748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0a737-cccc-4b38-abab-8e9e99ff4b5f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:39.162211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0a737-cccc-4b38-abab-8e9e99ff4b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:39.214735 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-1cf0a737-cccc-4b38-abab-8e9e99ff4b5f None None] MFA Rules not processed for user `9f59a79eadf84f5e992323b85d4afe05`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:39.216751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-1cf0a737-cccc-4b38-abab-8e9e99ff4b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:39.235387 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5ed26-fafb-49a8-a225-98a19098dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:39.235924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5ed26-fafb-49a8-a225-98a19098dfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:39.236215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5ed26-fafb-49a8-a225-98a19098dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:39.236509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5ed26-fafb-49a8-a225-98a19098dfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:39.237276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5ed26-fafb-49a8-a225-98a19098dfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:39.239249 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5ed26-fafb-49a8-a225-98a19098dfd4 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:39.253132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 964/1912] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:39.253962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5ed26-fafb-49a8-a225-98a19098dfd4 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:39.265573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5ed26-fafb-49a8-a225-98a19098dfd4 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:39.270336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d0761-4af6-4b3a-959d-1103cc40618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:39.271215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d0761-4af6-4b3a-959d-1103cc40618a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:39.271512 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d0761-4af6-4b3a-959d-1103cc40618a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:39.272195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d0761-4af6-4b3a-959d-1103cc40618a admin admin] PATH_INFO: `/v3/users/4020e5f4640143bca581998234427535` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:39.273171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d0761-4af6-4b3a-959d-1103cc40618a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4020e5f4640143bca581998234427535)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:39.275109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d0761-4af6-4b3a-959d-1103cc40618a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:39.338669 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 949/1913] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:39.346631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0a737-cccc-4b38-abab-8e9e99ff4b5f None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:39.352578 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0a737-cccc-4b38-abab-8e9e99ff4b5f None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:39.359404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd1fb-20ee-40e2-ad3b-707dff08ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:39.360334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd1fb-20ee-40e2-ad3b-707dff08ee9f admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:39.360657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd1fb-20ee-40e2-ad3b-707dff08ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:39.360944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcd1fb-20ee-40e2-ad3b-707dff08ee9f admin admin] PATH_INFO: `/v3/projects/c837c5f4b4174b50b70aa85696e7f518/users/aa7a79cd1ffa4e7faa3ad4ce4ebffcbb/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:39.381114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcd1fb-20ee-40e2-ad3b-707dff08ee9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c837c5f4b4174b50b70aa85696e7f518, user_id=aa7a79cd1ffa4e7faa3ad4ce4ebffcbb, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:39.385547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcd1fb-20ee-40e2-ad3b-707dff08ee9f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:39.546341 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 950/1914] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:39 2022] PUT /identity/v3/projects/c837c5f4b4174b50b70aa85696e7f518/users/aa7a79cd1ffa4e7faa3ad4ce4ebffcbb/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:39.547451 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd1fb-20ee-40e2-ad3b-707dff08ee9f admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:39.607261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cf4d0761-4af6-4b3a-959d-1103cc40618a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4020e5f4640143bca581998234427535'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:39.624289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcd1fb-20ee-40e2-ad3b-707dff08ee9f admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:39.626022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cf4d0761-4af6-4b3a-959d-1103cc40618a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4020e5f4640143bca581998234427535'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:39.631389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec86c52-5ab6-4355-a86a-795deca13dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:39.632397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec86c52-5ab6-4355-a86a-795deca13dca service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:39.632758 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec86c52-5ab6-4355-a86a-795deca13dca service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:39.633005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec86c52-5ab6-4355-a86a-795deca13dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:39.636748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cf4d0761-4af6-4b3a-959d-1103cc40618a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4020e5f4640143bca581998234427535'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:39.713853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec86c52-5ab6-4355-a86a-795deca13dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:39.715587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec86c52-5ab6-4355-a86a-795deca13dca service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:39.728857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 951/1915] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:39.729121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cf4d0761-4af6-4b3a-959d-1103cc40618a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4020e5f4640143bca581998234427535'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:39.730146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cf4d0761-4af6-4b3a-959d-1103cc40618a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4020e5f4640143bca581998234427535'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:39.730382 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb159f31-f588-4bda-9131-4d4cbf7993b3 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:39.730663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb159f31-f588-4bda-9131-4d4cbf7993b3 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:39.730949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb159f31-f588-4bda-9131-4d4cbf7993b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:39.742903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 965/1916] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:39 2022] DELETE /identity/v3/users/4020e5f4640143bca581998234427535 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:39.751639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8e536-b1bd-4749-9ba5-db7bc816a3e8 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:39.751639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8e536-b1bd-4749-9ba5-db7bc816a3e8 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:39.751639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8e536-b1bd-4749-9ba5-db7bc816a3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:39.771247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-bb159f31-f588-4bda-9131-4d4cbf7993b3 None None] MFA Rules not processed for user `aa7a79cd1ffa4e7faa3ad4ce4ebffcbb`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:39.774026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bb159f31-f588-4bda-9131-4d4cbf7993b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:39.800092 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-22f8e536-b1bd-4749-9ba5-db7bc816a3e8 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:39.801397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-22f8e536-b1bd-4749-9ba5-db7bc816a3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:39.923216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 952/1917] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:39.924622 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb159f31-f588-4bda-9131-4d4cbf7993b3 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:39.926656 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bb159f31-f588-4bda-9131-4d4cbf7993b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:39.980496 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:40.031235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb159f31-f588-4bda-9131-4d4cbf7993b3 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:40.032154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 966/1918] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:40.038938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8e536-b1bd-4749-9ba5-db7bc816a3e8 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:40.041653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-22f8e536-b1bd-4749-9ba5-db7bc816a3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:40.044355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:40.045390 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:40.045756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:40.046119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] PATH_INFO: `/v3/users/9f59a79eadf84f5e992323b85d4afe05` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:40.048512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f59a79eadf84f5e992323b85d4afe05)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:40.050896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:40.072511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8e536-b1bd-4749-9ba5-db7bc816a3e8 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:40.081348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:40.082778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:40.083068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:40.083355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] PATH_INFO: `/v3/users/c6ee8c4860cc48aca1f8a58a163af8f2` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:40.087619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ee8c4860cc48aca1f8a58a163af8f2)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:40.089820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:40.302314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:40.432734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f59a79eadf84f5e992323b85d4afe05'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:40.448577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f59a79eadf84f5e992323b85d4afe05'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:40.457020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f59a79eadf84f5e992323b85d4afe05'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:40.509994 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ee8c4860cc48aca1f8a58a163af8f2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:40.527460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ee8c4860cc48aca1f8a58a163af8f2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:40.535600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ee8c4860cc48aca1f8a58a163af8f2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:40.567436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f59a79eadf84f5e992323b85d4afe05'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:40.567436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f59a79eadf84f5e992323b85d4afe05'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:40.573609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 953/1919] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:39 2022] DELETE /identity/v3/users/9f59a79eadf84f5e992323b85d4afe05 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:40.575100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:40.578094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:40.657537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf7f68-9c35-4f7b-965f-8928f957b609 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:40.662580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456d8e9-3523-4e26-b91f-ce95c6e3c772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:40.664060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456d8e9-3523-4e26-b91f-ce95c6e3c772 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:40.664750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456d8e9-3523-4e26-b91f-ce95c6e3c772 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:40.664881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ee8c4860cc48aca1f8a58a163af8f2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:40.665057 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456d8e9-3523-4e26-b91f-ce95c6e3c772 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:40.665276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456d8e9-3523-4e26-b91f-ce95c6e3c772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:40.666327 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ee8c4860cc48aca1f8a58a163af8f2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:40.667504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456d8e9-3523-4e26-b91f-ce95c6e3c772 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:40.674717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 967/1920] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:40 2022] DELETE /identity/v3/users/c6ee8c4860cc48aca1f8a58a163af8f2 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:40.679591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:40.681371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:40.749503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c34ae7-f24f-4378-a898-33629f57a766 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:40.754505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0ba1e-fb04-4f93-9070-a07afde6975d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:40.756609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0ba1e-fb04-4f93-9070-a07afde6975d service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:40.756609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0ba1e-fb04-4f93-9070-a07afde6975d service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:40.756609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0ba1e-fb04-4f93-9070-a07afde6975d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:40.759405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-bcd0ba1e-fb04-4f93-9070-a07afde6975d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:40.798297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 954/1921] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:40 2022] POST /identity/v3/projects => generated 365 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:40.800515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35abebc-146a-492f-8b50-1364589b682d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:40.801050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35abebc-146a-492f-8b50-1364589b682d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:40.801545 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35abebc-146a-492f-8b50-1364589b682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:40.822551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c35abebc-146a-492f-8b50-1364589b682d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:40.823717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c35abebc-146a-492f-8b50-1364589b682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:40.839959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0ba1e-fb04-4f93-9070-a07afde6975d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:40.842055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0ba1e-fb04-4f93-9070-a07afde6975d service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:40.859655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 968/1922] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:40.862703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8e0c3-3efc-45d4-9fc3-b09c37123147 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:40.863118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8e0c3-3efc-45d4-9fc3-b09c37123147 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:40.863844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8e0c3-3efc-45d4-9fc3-b09c37123147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:40.900589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-3ec8e0c3-3efc-45d4-9fc3-b09c37123147 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:40.902755 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3ec8e0c3-3efc-45d4-9fc3-b09c37123147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:40.909568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 955/1923] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:40.910707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35abebc-146a-492f-8b50-1364589b682d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:40.912259 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c35abebc-146a-492f-8b50-1364589b682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:40.924663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 969/1924] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:40.934068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8e0c3-3efc-45d4-9fc3-b09c37123147 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:40.934722 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35abebc-146a-492f-8b50-1364589b682d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:40.935893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3ec8e0c3-3efc-45d4-9fc3-b09c37123147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:40.942970 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc472e85-dee4-4acb-a2bb-d712f02c8dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:40.944111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc472e85-dee4-4acb-a2bb-d712f02c8dbe admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:40.944695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc472e85-dee4-4acb-a2bb-d712f02c8dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:40.945169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc472e85-dee4-4acb-a2bb-d712f02c8dbe admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:40.946528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc472e85-dee4-4acb-a2bb-d712f02c8dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:40.950277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc472e85-dee4-4acb-a2bb-d712f02c8dbe admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:41.027829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8e0c3-3efc-45d4-9fc3-b09c37123147 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:41.033678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685db5b-23ae-448a-84b1-5521021873f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:41.034898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685db5b-23ae-448a-84b1-5521021873f0 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:41.035421 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685db5b-23ae-448a-84b1-5521021873f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:41.035937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685db5b-23ae-448a-84b1-5521021873f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:41.055778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685db5b-23ae-448a-84b1-5521021873f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:41.058742 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685db5b-23ae-448a-84b1-5521021873f0 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:41.082189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 956/1925] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:40 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:41.082189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc472e85-dee4-4acb-a2bb-d712f02c8dbe admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:41.082563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 970/1926] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:41.084003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685db5b-23ae-448a-84b1-5521021873f0 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:41.093067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc472e85-dee4-4acb-a2bb-d712f02c8dbe admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:41.096821 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685db5b-23ae-448a-84b1-5521021873f0 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:41.100307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6fb63-23bb-4e38-bd0a-44d5c117eb7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:41.100307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6fb63-23bb-4e38-bd0a-44d5c117eb7f service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:41.100891 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6fb63-23bb-4e38-bd0a-44d5c117eb7f service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:41.101482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6fb63-23bb-4e38-bd0a-44d5c117eb7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:41.102924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df3441-d5e5-4f65-984c-acfad0b17272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:41.103821 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df3441-d5e5-4f65-984c-acfad0b17272 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:41.104101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df3441-d5e5-4f65-984c-acfad0b17272 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:41.104375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df3441-d5e5-4f65-984c-acfad0b17272 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:41.105376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df3441-d5e5-4f65-984c-acfad0b17272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:41.107365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df3441-d5e5-4f65-984c-acfad0b17272 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:41.116017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6fb63-23bb-4e38-bd0a-44d5c117eb7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:41.118603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6fb63-23bb-4e38-bd0a-44d5c117eb7f service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:41.125645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 971/1927] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:41.141333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df3441-d5e5-4f65-984c-acfad0b17272 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:41.150718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 957/1928] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:41.163251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df3441-d5e5-4f65-984c-acfad0b17272 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:41.177543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c32b6-a1e0-4b1b-a453-e3bc8aad718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:41.179952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c32b6-a1e0-4b1b-a453-e3bc8aad718e admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:41.180407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c32b6-a1e0-4b1b-a453-e3bc8aad718e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:41.180905 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c32b6-a1e0-4b1b-a453-e3bc8aad718e admin admin] PATH_INFO: `/v3/projects/d420b2fc473347e9bf35e2e1b300dd90/users/4df54f6ef627460d86b4ff512ec9ffc3/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:41.209027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c32b6-a1e0-4b1b-a453-e3bc8aad718e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d420b2fc473347e9bf35e2e1b300dd90, user_id=4df54f6ef627460d86b4ff512ec9ffc3, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:41.212691 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c32b6-a1e0-4b1b-a453-e3bc8aad718e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:41.312213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 972/1929] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:41 2022] PUT /identity/v3/projects/d420b2fc473347e9bf35e2e1b300dd90/users/4df54f6ef627460d86b4ff512ec9ffc3/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:41.314355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6fb63-23bb-4e38-bd0a-44d5c117eb7f service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:41.334705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6fb63-23bb-4e38-bd0a-44d5c117eb7f service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:41.467006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50e396-6b70-48ae-b809-b7822e2004b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:41.467707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50e396-6b70-48ae-b809-b7822e2004b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:41.467994 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50e396-6b70-48ae-b809-b7822e2004b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:41.468274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50e396-6b70-48ae-b809-b7822e2004b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:41.469050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50e396-6b70-48ae-b809-b7822e2004b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:41.470716 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50e396-6b70-48ae-b809-b7822e2004b3 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:41.490391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 958/1930] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:41.492506 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c32b6-a1e0-4b1b-a453-e3bc8aad718e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:41.505966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c32b6-a1e0-4b1b-a453-e3bc8aad718e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:41.511929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c35c3-a693-4225-80b0-b3174e418ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:41.512891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c35c3-a693-4225-80b0-b3174e418ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:41.513172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c35c3-a693-4225-80b0-b3174e418ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:41.513448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c35c3-a693-4225-80b0-b3174e418ccf admin admin] PATH_INFO: `/v3/projects/d420b2fc473347e9bf35e2e1b300dd90/users/4df54f6ef627460d86b4ff512ec9ffc3/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:41.515462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c35c3-a693-4225-80b0-b3174e418ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d420b2fc473347e9bf35e2e1b300dd90, user_id=4df54f6ef627460d86b4ff512ec9ffc3, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:41.518354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c35c3-a693-4225-80b0-b3174e418ccf admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:41.530481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 973/1931] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:41 2022] PUT /identity/v3/projects/d420b2fc473347e9bf35e2e1b300dd90/users/4df54f6ef627460d86b4ff512ec9ffc3/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:41.551678 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd3135-f176-4e6f-8eaa-52203f540cf6 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:41.551860 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd3135-f176-4e6f-8eaa-52203f540cf6 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:41.552138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd3135-f176-4e6f-8eaa-52203f540cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:41.597279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-4fcd3135-f176-4e6f-8eaa-52203f540cf6 None None] MFA Rules not processed for user `4df54f6ef627460d86b4ff512ec9ffc3`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:41.601245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4fcd3135-f176-4e6f-8eaa-52203f540cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:41.619008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:41.621948 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c35c3-a693-4225-80b0-b3174e418ccf admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:41.623818 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-614c35c3-a693-4225-80b0-b3174e418ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:41.734713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c35c3-a693-4225-80b0-b3174e418ccf admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:41.742077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:41.742821 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:41.743101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:41.743374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] PATH_INFO: `/v3/projects/7cb9ffa3234b4ea4bdbc2e543adf4985` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:41.745685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb9ffa3234b4ea4bdbc2e543adf4985)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:41.747656 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:41.756090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 959/1932] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:41.770160 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd3135-f176-4e6f-8eaa-52203f540cf6 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:41.771815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4fcd3135-f176-4e6f-8eaa-52203f540cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:41.853952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd3135-f176-4e6f-8eaa-52203f540cf6 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:41.858021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac9c49-5194-4079-b9b3-c2c026c9a8b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:41.858697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac9c49-5194-4079-b9b3-c2c026c9a8b7 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:41.858984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac9c49-5194-4079-b9b3-c2c026c9a8b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:41.859266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac9c49-5194-4079-b9b3-c2c026c9a8b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:41.870573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac9c49-5194-4079-b9b3-c2c026c9a8b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:41.872058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac9c49-5194-4079-b9b3-c2c026c9a8b7 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:41.883145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 960/1933] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:41.884000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac9c49-5194-4079-b9b3-c2c026c9a8b7 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:41.885520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-04ac9c49-5194-4079-b9b3-c2c026c9a8b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:41.904586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac9c49-5194-4079-b9b3-c2c026c9a8b7 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:41.928067 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb9ffa3234b4ea4bdbc2e543adf4985', 'request_id': 'req-b81fa62e-1371-4e7f-a2d4-73865a4349e7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:41.937819 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb9ffa3234b4ea4bdbc2e543adf4985', 'request_id': 'req-b81fa62e-1371-4e7f-a2d4-73865a4349e7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:41.945493 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb9ffa3234b4ea4bdbc2e543adf4985', 'request_id': 'req-b81fa62e-1371-4e7f-a2d4-73865a4349e7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:41.985384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:41.986268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:41.986566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:41.987014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] PATH_INFO: `/v3/projects/ccd14d1d41504eafa8320acfdce3f00f` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:41.988176 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd14d1d41504eafa8320acfdce3f00f)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:41.990206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:42.052753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] The token cache is being invalidate because project 7cb9ffa3234b4ea4bdbc2e543adf4985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:42.053439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.054362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.056454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 974/1934] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:41 2022] DELETE /identity/v3/projects/7cb9ffa3234b4ea4bdbc2e543adf4985 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:42.057297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:42.058658 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:42.072182 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fa62e-1371-4e7f-a2d4-73865a4349e7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:42.078698 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:42.080203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:42.080753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:42.081309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] PATH_INFO: `/v3/projects/617b3818c8d349f8ad832df9c31f3893` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:42.083415 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=617b3818c8d349f8ad832df9c31f3893)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:42.085472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:42.133906 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd14d1d41504eafa8320acfdce3f00f', 'request_id': 'req-860bcd68-120f-434d-833e-78dabb1130be'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.139450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd14d1d41504eafa8320acfdce3f00f', 'request_id': 'req-860bcd68-120f-434d-833e-78dabb1130be'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.228395 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '617b3818c8d349f8ad832df9c31f3893', 'request_id': 'req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.238206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '617b3818c8d349f8ad832df9c31f3893', 'request_id': 'req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.247095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '617b3818c8d349f8ad832df9c31f3893', 'request_id': 'req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.279851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd14d1d41504eafa8320acfdce3f00f', 'request_id': 'req-860bcd68-120f-434d-833e-78dabb1130be'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.296465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] The token cache is being invalidate because project ccd14d1d41504eafa8320acfdce3f00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:42.296465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.296465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.302117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 961/1935] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:41 2022] DELETE /identity/v3/projects/ccd14d1d41504eafa8320acfdce3f00f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:42.302117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:42.302117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:42.374835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bcd68-120f-434d-833e-78dabb1130be admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:42.411172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] The token cache is being invalidate because project 617b3818c8d349f8ad832df9c31f3893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:42.411742 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.412723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.415380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 975/1936] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:42 2022] DELETE /identity/v3/projects/617b3818c8d349f8ad832df9c31f3893 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:42.416511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:42.420537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:42.455538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf696b4b-4aec-4849-9279-a040e57344b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:42.456707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf696b4b-4aec-4849-9279-a040e57344b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:42.457147 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf696b4b-4aec-4849-9279-a040e57344b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:42.457575 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf696b4b-4aec-4849-9279-a040e57344b9 admin admin] PATH_INFO: `/v3/users/4e2a7dc5cbda4fefa0fad3fa469e0cec` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:42.459161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf696b4b-4aec-4849-9279-a040e57344b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2a7dc5cbda4fefa0fad3fa469e0cec)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:42.461741 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf696b4b-4aec-4849-9279-a040e57344b9 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:42.503387 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fcdcb-4704-4407-ba1a-c195ff66fc2c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:42.508734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf5149-9e4c-4ccb-b9fd-e82f5268d347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:42.509412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf5149-9e4c-4ccb-b9fd-e82f5268d347 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:42.509691 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf5149-9e4c-4ccb-b9fd-e82f5268d347 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:42.509966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf5149-9e4c-4ccb-b9fd-e82f5268d347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:42.511991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-1ebf5149-9e4c-4ccb-b9fd-e82f5268d347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:42.589012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf5149-9e4c-4ccb-b9fd-e82f5268d347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:42.590531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf5149-9e4c-4ccb-b9fd-e82f5268d347 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:42.606243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 976/1937] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:42.607605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00c9d0-fbd5-4340-bb2e-4b49ead68361 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:42.608055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00c9d0-fbd5-4340-bb2e-4b49ead68361 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:42.608383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00c9d0-fbd5-4340-bb2e-4b49ead68361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:42.629773 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-bf00c9d0-fbd5-4340-bb2e-4b49ead68361 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:42.631944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-bf00c9d0-fbd5-4340-bb2e-4b49ead68361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:42.646786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 977/1938] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:42.649669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00c9d0-fbd5-4340-bb2e-4b49ead68361 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:42.652298 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-bf00c9d0-fbd5-4340-bb2e-4b49ead68361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:42.675445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00c9d0-fbd5-4340-bb2e-4b49ead68361 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:42.681682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:42.682659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:42.683011 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:42.683354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] PATH_INFO: `/v3/users/3e6e27457d2d417cb48ccf52054ec782` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:42.684967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6e27457d2d417cb48ccf52054ec782)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:42.686999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:42.874459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:42.919284 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-bf696b4b-4aec-4849-9279-a040e57344b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2a7dc5cbda4fefa0fad3fa469e0cec'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.934532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-bf696b4b-4aec-4849-9279-a040e57344b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2a7dc5cbda4fefa0fad3fa469e0cec'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:42.942257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-bf696b4b-4aec-4849-9279-a040e57344b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2a7dc5cbda4fefa0fad3fa469e0cec'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:43.064116 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6e27457d2d417cb48ccf52054ec782'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:43.068808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-bf696b4b-4aec-4849-9279-a040e57344b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2a7dc5cbda4fefa0fad3fa469e0cec'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:43.070245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-bf696b4b-4aec-4849-9279-a040e57344b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2a7dc5cbda4fefa0fad3fa469e0cec'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:43.079945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6e27457d2d417cb48ccf52054ec782'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:43.080735 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 962/1939] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:42 2022] DELETE /identity/v3/users/4e2a7dc5cbda4fefa0fad3fa469e0cec => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:43.083102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519ef8-ac5b-41e8-af6f-4f16465e9862 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:43.083610 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519ef8-ac5b-41e8-af6f-4f16465e9862 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:43.084085 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca519ef8-ac5b-41e8-af6f-4f16465e9862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:43.088840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6e27457d2d417cb48ccf52054ec782'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:43.115935 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-ca519ef8-ac5b-41e8-af6f-4f16465e9862 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:43.118016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ca519ef8-ac5b-41e8-af6f-4f16465e9862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:43.200525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6e27457d2d417cb48ccf52054ec782'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:43.202177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6e27457d2d417cb48ccf52054ec782'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:43.203633 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 963/1940] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:43.212264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca519ef8-ac5b-41e8-af6f-4f16465e9862 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:43.217338 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 978/1941] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:42 2022] DELETE /identity/v3/users/3e6e27457d2d417cb48ccf52054ec782 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:43.221630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca519ef8-ac5b-41e8-af6f-4f16465e9862 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:43.307099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423459b9-7684-4a5c-8bc7-8a910bee19ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:43.309285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423459b9-7684-4a5c-8bc7-8a910bee19ee admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:43.309802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423459b9-7684-4a5c-8bc7-8a910bee19ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:43.310688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423459b9-7684-4a5c-8bc7-8a910bee19ee admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:43.311905 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423459b9-7684-4a5c-8bc7-8a910bee19ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:43.312449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423459b9-7684-4a5c-8bc7-8a910bee19ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:43.316147 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423459b9-7684-4a5c-8bc7-8a910bee19ee admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:43.348180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 964/1942] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:58:43.354904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:43.356934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:43.387425 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb9fa0-5b62-4a58-97dd-003ea85fcb40 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:43.413348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046792d5-cc13-43eb-9b8e-56ada5668387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:43.415316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046792d5-cc13-43eb-9b8e-56ada5668387 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:43.416087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046792d5-cc13-43eb-9b8e-56ada5668387 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:43.416819 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046792d5-cc13-43eb-9b8e-56ada5668387 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:43.418209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046792d5-cc13-43eb-9b8e-56ada5668387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:43.427119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046792d5-cc13-43eb-9b8e-56ada5668387 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:43.611094 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 979/1943] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:43 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:43.612261 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423459b9-7684-4a5c-8bc7-8a910bee19ee admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:43.629570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423459b9-7684-4a5c-8bc7-8a910bee19ee admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:43.704773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b136d1-5ebc-4d65-9863-22fedce27369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:43.705073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b136d1-5ebc-4d65-9863-22fedce27369 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:43.705210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b136d1-5ebc-4d65-9863-22fedce27369 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:43.705469 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b136d1-5ebc-4d65-9863-22fedce27369 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:43.706632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b136d1-5ebc-4d65-9863-22fedce27369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:43.708376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b136d1-5ebc-4d65-9863-22fedce27369 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:43.832290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 965/1944] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:43 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:43.832978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046792d5-cc13-43eb-9b8e-56ada5668387 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:43.836646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-046792d5-cc13-43eb-9b8e-56ada5668387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:43.838758 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b136d1-5ebc-4d65-9863-22fedce27369 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:43.861444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b136d1-5ebc-4d65-9863-22fedce27369 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:43.870240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3141a-81ab-4220-aed8-4f1e7845152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:43.871410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3141a-81ab-4220-aed8-4f1e7845152a admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:43.872072 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3141a-81ab-4220-aed8-4f1e7845152a admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:43.872646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3141a-81ab-4220-aed8-4f1e7845152a admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:43.874087 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3141a-81ab-4220-aed8-4f1e7845152a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:43.879746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046792d5-cc13-43eb-9b8e-56ada5668387 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:43.892439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3141a-81ab-4220-aed8-4f1e7845152a admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:43.892679 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:43.894295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:43.894756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:43.895417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] PATH_INFO: `/v3/projects/4ac96e83ccb54d87871c74713246f5e2` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:43.898486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac96e83ccb54d87871c74713246f5e2)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:43.902585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:43.908871 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 966/1945] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:43.911086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3141a-81ab-4220-aed8-4f1e7845152a admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:43.913629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-25e3141a-81ab-4220-aed8-4f1e7845152a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:43.939683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3141a-81ab-4220-aed8-4f1e7845152a admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:43.961825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41141a4c-e430-4843-ad7c-7d36c9f37600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:43.965853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141a4c-e430-4843-ad7c-7d36c9f37600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:43.965853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141a4c-e430-4843-ad7c-7d36c9f37600 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:43.965853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141a4c-e430-4843-ad7c-7d36c9f37600 admin admin] PATH_INFO: `/v3/projects/e5859998cf984ba2b1ab1049f7273c2d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:43.965853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41141a4c-e430-4843-ad7c-7d36c9f37600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5859998cf984ba2b1ab1049f7273c2d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:43.966917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41141a4c-e430-4843-ad7c-7d36c9f37600 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:44.073485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac96e83ccb54d87871c74713246f5e2', 'request_id': 'req-bb9f3498-ee45-4dd7-ba53-1163eb59631d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.081206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac96e83ccb54d87871c74713246f5e2', 'request_id': 'req-bb9f3498-ee45-4dd7-ba53-1163eb59631d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.090249 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac96e83ccb54d87871c74713246f5e2', 'request_id': 'req-bb9f3498-ee45-4dd7-ba53-1163eb59631d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.119004 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-41141a4c-e430-4843-ad7c-7d36c9f37600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5859998cf984ba2b1ab1049f7273c2d', 'request_id': 'req-41141a4c-e430-4843-ad7c-7d36c9f37600'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.127046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-41141a4c-e430-4843-ad7c-7d36c9f37600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5859998cf984ba2b1ab1049f7273c2d', 'request_id': 'req-41141a4c-e430-4843-ad7c-7d36c9f37600'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.257546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] The token cache is being invalidate because project 4ac96e83ccb54d87871c74713246f5e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:44.257851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.258719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.266386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 980/1946] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:43 2022] DELETE /identity/v3/projects/4ac96e83ccb54d87871c74713246f5e2 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:44.266386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:44.266386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:44.291264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:44.320157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-41141a4c-e430-4843-ad7c-7d36c9f37600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5859998cf984ba2b1ab1049f7273c2d', 'request_id': 'req-41141a4c-e430-4843-ad7c-7d36c9f37600'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.343632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f3498-ee45-4dd7-ba53-1163eb59631d admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:44.346245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-41141a4c-e430-4843-ad7c-7d36c9f37600 admin admin] The token cache is being invalidate because project e5859998cf984ba2b1ab1049f7273c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:44.346841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-41141a4c-e430-4843-ad7c-7d36c9f37600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.348017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-41141a4c-e430-4843-ad7c-7d36c9f37600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.352227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 967/1947] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:43 2022] DELETE /identity/v3/projects/e5859998cf984ba2b1ab1049f7273c2d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:44.354609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2b53a-9b21-4797-ae95-cb6f205dbc55 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:44.355111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2b53a-9b21-4797-ae95-cb6f205dbc55 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:44.355607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2b53a-9b21-4797-ae95-cb6f205dbc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:44.386962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-57a2b53a-9b21-4797-ae95-cb6f205dbc55 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:44.395884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-57a2b53a-9b21-4797-ae95-cb6f205dbc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:44.423045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80003e9-8deb-4086-82d4-a064d96ed0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:44.423757 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80003e9-8deb-4086-82d4-a064d96ed0cb admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:44.423955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80003e9-8deb-4086-82d4-a064d96ed0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:44.424316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80003e9-8deb-4086-82d4-a064d96ed0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:44.425281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80003e9-8deb-4086-82d4-a064d96ed0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:44.427829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80003e9-8deb-4086-82d4-a064d96ed0cb admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:44.444583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 981/1948] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:44.444583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80003e9-8deb-4086-82d4-a064d96ed0cb admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:44.447147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b80003e9-8deb-4086-82d4-a064d96ed0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:44.463007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80003e9-8deb-4086-82d4-a064d96ed0cb admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:44.470541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:44.472422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:44.472855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:44.473325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] PATH_INFO: `/v3/users/f69b3328cfb54d36a6d8a3e035021fe3` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:44.476184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69b3328cfb54d36a6d8a3e035021fe3)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:44.480004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:44.494747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 968/1949] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:44.495651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2b53a-9b21-4797-ae95-cb6f205dbc55 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:44.497215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-57a2b53a-9b21-4797-ae95-cb6f205dbc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:44.512620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2b53a-9b21-4797-ae95-cb6f205dbc55 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:44.517713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475cf4e-3ab9-4f9f-9d16-e5717e95ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:44.523050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475cf4e-3ab9-4f9f-9d16-e5717e95ef8d admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:44.523050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475cf4e-3ab9-4f9f-9d16-e5717e95ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:44.523050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475cf4e-3ab9-4f9f-9d16-e5717e95ef8d admin admin] PATH_INFO: `/v3/projects/b8968bec13ae4ccfa6698f243daacd93/users/119fd021bfa248e18dd5536c70b4d446/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:44.537615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475cf4e-3ab9-4f9f-9d16-e5717e95ef8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8968bec13ae4ccfa6698f243daacd93, user_id=119fd021bfa248e18dd5536c70b4d446, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:44.541641 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475cf4e-3ab9-4f9f-9d16-e5717e95ef8d admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:44.642593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 969/1950] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:44 2022] PUT /identity/v3/projects/b8968bec13ae4ccfa6698f243daacd93/users/119fd021bfa248e18dd5536c70b4d446/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:44.645146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64cb9c-d1c8-4d8a-a17f-108abee79608 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:44.645658 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64cb9c-d1c8-4d8a-a17f-108abee79608 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:44.646160 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64cb9c-d1c8-4d8a-a17f-108abee79608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:44.669009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-2b64cb9c-d1c8-4d8a-a17f-108abee79608 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:44.670238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2b64cb9c-d1c8-4d8a-a17f-108abee79608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:44.719438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69b3328cfb54d36a6d8a3e035021fe3'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.734779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69b3328cfb54d36a6d8a3e035021fe3'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.744777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69b3328cfb54d36a6d8a3e035021fe3'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.761782 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 970/1951] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:44.766417 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51344b4-568d-40d7-acc6-81d3c6db99b9 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:44.766417 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51344b4-568d-40d7-acc6-81d3c6db99b9 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:44.766417 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51344b4-568d-40d7-acc6-81d3c6db99b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:44.812115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d51344b4-568d-40d7-acc6-81d3c6db99b9 None None] MFA Rules not processed for user `119fd021bfa248e18dd5536c70b4d446`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:44.813396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d51344b4-568d-40d7-acc6-81d3c6db99b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:44.822539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69b3328cfb54d36a6d8a3e035021fe3'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.823172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69b3328cfb54d36a6d8a3e035021fe3'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:44.833217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 982/1952] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:44 2022] DELETE /identity/v3/users/f69b3328cfb54d36a6d8a3e035021fe3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:44.833217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:44.833217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:44.902561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 971/1953] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:44.916655 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51344b4-568d-40d7-acc6-81d3c6db99b9 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:44.918523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d51344b4-568d-40d7-acc6-81d3c6db99b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:44.930273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989df4d-5c37-4901-95e0-2307a8f101fc admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:44.938789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909f40b-b804-4171-8ac3-64f037d14bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:44.939661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909f40b-b804-4171-8ac3-64f037d14bfd admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:44.940056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909f40b-b804-4171-8ac3-64f037d14bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:44.940341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909f40b-b804-4171-8ac3-64f037d14bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:44.941163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909f40b-b804-4171-8ac3-64f037d14bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:44.941485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909f40b-b804-4171-8ac3-64f037d14bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:44.943140 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909f40b-b804-4171-8ac3-64f037d14bfd admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:44.964530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 983/1954] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:58:44.967043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909f40b-b804-4171-8ac3-64f037d14bfd admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:44.980433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909f40b-b804-4171-8ac3-64f037d14bfd admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:44.987575 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167e032-2f25-454a-8afe-9006c56075f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:44.988343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167e032-2f25-454a-8afe-9006c56075f8 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:44.989203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167e032-2f25-454a-8afe-9006c56075f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:44.989203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167e032-2f25-454a-8afe-9006c56075f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:44.989614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167e032-2f25-454a-8afe-9006c56075f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:44.992255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167e032-2f25-454a-8afe-9006c56075f8 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:44.999571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51344b4-568d-40d7-acc6-81d3c6db99b9 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:45.069937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32cbf6-fd2b-46c8-b3db-d3b3f66cb150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:45.070650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32cbf6-fd2b-46c8-b3db-d3b3f66cb150 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:45.070935 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32cbf6-fd2b-46c8-b3db-d3b3f66cb150 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:45.071213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32cbf6-fd2b-46c8-b3db-d3b3f66cb150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:45.138005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:45.147040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 984/1955] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:44 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:45.153191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167e032-2f25-454a-8afe-9006c56075f8 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:45.199185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32cbf6-fd2b-46c8-b3db-d3b3f66cb150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:45.202165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32cbf6-fd2b-46c8-b3db-d3b3f66cb150 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:45.227469 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 972/1956] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:45.234393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167e032-2f25-454a-8afe-9006c56075f8 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:45.240195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3def9c-7c6c-43ce-bd94-34eca7fc460b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:45.241778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3def9c-7c6c-43ce-bd94-34eca7fc460b admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:45.241778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3def9c-7c6c-43ce-bd94-34eca7fc460b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:45.242281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3def9c-7c6c-43ce-bd94-34eca7fc460b admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:45.242874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3def9c-7c6c-43ce-bd94-34eca7fc460b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:45.245082 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3def9c-7c6c-43ce-bd94-34eca7fc460b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:45.379807 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 985/1957] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:45 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:45.382928 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32cbf6-fd2b-46c8-b3db-d3b3f66cb150 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:45.415375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32cbf6-fd2b-46c8-b3db-d3b3f66cb150 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:45.423672 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bd000-99a1-4412-96aa-e4065ce613c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:45.424815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bd000-99a1-4412-96aa-e4065ce613c9 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:45.425085 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bd000-99a1-4412-96aa-e4065ce613c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:45.425327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bd000-99a1-4412-96aa-e4065ce613c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:45.426083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bd000-99a1-4412-96aa-e4065ce613c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:45.429097 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bd000-99a1-4412-96aa-e4065ce613c9 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:45.445659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 973/1958] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:45.446690 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3def9c-7c6c-43ce-bd94-34eca7fc460b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:45.457616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3def9c-7c6c-43ce-bd94-34eca7fc460b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:45.463210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c26e3-241f-4166-b797-6091184ff685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:45.463919 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c26e3-241f-4166-b797-6091184ff685 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:45.464200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c26e3-241f-4166-b797-6091184ff685 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:45.464524 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c26e3-241f-4166-b797-6091184ff685 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:45.465258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c26e3-241f-4166-b797-6091184ff685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:45.466923 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c26e3-241f-4166-b797-6091184ff685 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:45.478298 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 986/1959] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:45.482689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bd000-99a1-4412-96aa-e4065ce613c9 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:45.493780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bd000-99a1-4412-96aa-e4065ce613c9 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:45.498891 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbbb62-12e0-452e-8768-d60bea5685e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:45.499811 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbbb62-12e0-452e-8768-d60bea5685e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:45.500094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbbb62-12e0-452e-8768-d60bea5685e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:45.500377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbbb62-12e0-452e-8768-d60bea5685e9 admin admin] PATH_INFO: `/v3/projects/67102803a5d24bfc828efa38e5610eee/users/da6fffad00254cde92126c1d5cae6da5/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:45.524117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbbb62-12e0-452e-8768-d60bea5685e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67102803a5d24bfc828efa38e5610eee, user_id=da6fffad00254cde92126c1d5cae6da5, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:45.529341 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbbb62-12e0-452e-8768-d60bea5685e9 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:45.564269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c26e3-241f-4166-b797-6091184ff685 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:45.568337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-833c26e3-241f-4166-b797-6091184ff685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:45.596623 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c26e3-241f-4166-b797-6091184ff685 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:45.607648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70df6c4-eb2e-4242-a4dc-c9b78967e420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:45.610098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70df6c4-eb2e-4242-a4dc-c9b78967e420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:45.610505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70df6c4-eb2e-4242-a4dc-c9b78967e420 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:45.611059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70df6c4-eb2e-4242-a4dc-c9b78967e420 admin admin] PATH_INFO: `/v3/projects/85b4e8c212fc40a78bf71f97267da97b` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:45.613520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70df6c4-eb2e-4242-a4dc-c9b78967e420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b4e8c212fc40a78bf71f97267da97b)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:45.618801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70df6c4-eb2e-4242-a4dc-c9b78967e420 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:45.675348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 974/1960] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:45 2022] PUT /identity/v3/projects/67102803a5d24bfc828efa38e5610eee/users/da6fffad00254cde92126c1d5cae6da5/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:45.690415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32695cee-6e40-4422-8e96-28f570edb5a2 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:45.690944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32695cee-6e40-4422-8e96-28f570edb5a2 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:45.691415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32695cee-6e40-4422-8e96-28f570edb5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:45.723566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-32695cee-6e40-4422-8e96-28f570edb5a2 None None] MFA Rules not processed for user `da6fffad00254cde92126c1d5cae6da5`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:45.724829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-32695cee-6e40-4422-8e96-28f570edb5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:45.802593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 975/1961] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:45.809776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32695cee-6e40-4422-8e96-28f570edb5a2 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:45.811944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a70df6c4-eb2e-4242-a4dc-c9b78967e420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b4e8c212fc40a78bf71f97267da97b', 'request_id': 'req-a70df6c4-eb2e-4242-a4dc-c9b78967e420'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:45.822814 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a70df6c4-eb2e-4242-a4dc-c9b78967e420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b4e8c212fc40a78bf71f97267da97b', 'request_id': 'req-a70df6c4-eb2e-4242-a4dc-c9b78967e420'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:45.834777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a70df6c4-eb2e-4242-a4dc-c9b78967e420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b4e8c212fc40a78bf71f97267da97b', 'request_id': 'req-a70df6c4-eb2e-4242-a4dc-c9b78967e420'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:45.883887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32695cee-6e40-4422-8e96-28f570edb5a2 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:45.954562 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c364a7-3e7d-47fd-b3b6-d22282aac35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:45.955464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c364a7-3e7d-47fd-b3b6-d22282aac35d admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:45.955773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c364a7-3e7d-47fd-b3b6-d22282aac35d admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:45.956056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c364a7-3e7d-47fd-b3b6-d22282aac35d admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:45.956815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c364a7-3e7d-47fd-b3b6-d22282aac35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:45.958767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c364a7-3e7d-47fd-b3b6-d22282aac35d admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:46.026332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a70df6c4-eb2e-4242-a4dc-c9b78967e420 admin admin] The token cache is being invalidate because project 85b4e8c212fc40a78bf71f97267da97b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:46.026619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a70df6c4-eb2e-4242-a4dc-c9b78967e420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:46.027407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a70df6c4-eb2e-4242-a4dc-c9b78967e420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:46.030193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 987/1962] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:45 2022] DELETE /identity/v3/projects/85b4e8c212fc40a78bf71f97267da97b => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:46.036420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fd3d0-3b8f-4eb5-8516-3067d12bec17 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:46.036673 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fd3d0-3b8f-4eb5-8516-3067d12bec17 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:46.036938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fd3d0-3b8f-4eb5-8516-3067d12bec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:46.056712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-9b9fd3d0-3b8f-4eb5-8516-3067d12bec17 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:46.057939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9b9fd3d0-3b8f-4eb5-8516-3067d12bec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:46.065927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 988/1963] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:46.074799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd100a-2f3f-4f7c-b945-c4b370558812 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:46.075089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd100a-2f3f-4f7c-b945-c4b370558812 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:46.075367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd100a-2f3f-4f7c-b945-c4b370558812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:46.093776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f5bd100a-2f3f-4f7c-b945-c4b370558812 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:46.095047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f5bd100a-2f3f-4f7c-b945-c4b370558812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:46.103903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 989/1964] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:46.105151 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 976/1965] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:45 2022] POST /identity/v3/projects => generated 381 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:46.108193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd100a-2f3f-4f7c-b945-c4b370558812 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:46.108765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c364a7-3e7d-47fd-b3b6-d22282aac35d admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:46.110324 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-03c364a7-3e7d-47fd-b3b6-d22282aac35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:46.117529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd100a-2f3f-4f7c-b945-c4b370558812 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:46.187733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c364a7-3e7d-47fd-b3b6-d22282aac35d admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:46.192511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebc154-cf74-421e-a03b-75fcead1a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:46.193203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebc154-cf74-421e-a03b-75fcead1a2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:46.193490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebc154-cf74-421e-a03b-75fcead1a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:46.193769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebc154-cf74-421e-a03b-75fcead1a2b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:46.194541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebc154-cf74-421e-a03b-75fcead1a2b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:46.194854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebc154-cf74-421e-a03b-75fcead1a2b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:46.195738 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377780c7-b895-4822-be43-dcb77b91c7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:46.196457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebc154-cf74-421e-a03b-75fcead1a2b9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:46.196962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377780c7-b895-4822-be43-dcb77b91c7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:46.197468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377780c7-b895-4822-be43-dcb77b91c7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:46.198109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377780c7-b895-4822-be43-dcb77b91c7a2 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:46.199386 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377780c7-b895-4822-be43-dcb77b91c7a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:46.202939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377780c7-b895-4822-be43-dcb77b91c7a2 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:46.209222 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 990/1966] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:58:46.214095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebc154-cf74-421e-a03b-75fcead1a2b9 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:46.224081 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebc154-cf74-421e-a03b-75fcead1a2b9 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:46.229768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951c70-2506-4547-a5b9-fe3c1f2bd2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:46.230443 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951c70-2506-4547-a5b9-fe3c1f2bd2ff admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:46.230731 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951c70-2506-4547-a5b9-fe3c1f2bd2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:46.231010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7951c70-2506-4547-a5b9-fe3c1f2bd2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:46.231714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7951c70-2506-4547-a5b9-fe3c1f2bd2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:46.233787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7951c70-2506-4547-a5b9-fe3c1f2bd2ff admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:46.421401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 977/1967] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:46 2022] POST /identity/v3/users => generated 297 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:46.422965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377780c7-b895-4822-be43-dcb77b91c7a2 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:46.427724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 991/1968] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:46 2022] POST /identity/v3/projects => generated 393 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:46.436562 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377780c7-b895-4822-be43-dcb77b91c7a2 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:46.443716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951c70-2506-4547-a5b9-fe3c1f2bd2ff admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:46.533085 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3fb40-61a7-4893-8f69-fcc039dbb61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:46.533777 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3fb40-61a7-4893-8f69-fcc039dbb61d admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:46.534094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3fb40-61a7-4893-8f69-fcc039dbb61d admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:46.534329 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3fb40-61a7-4893-8f69-fcc039dbb61d admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:46.535319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3fb40-61a7-4893-8f69-fcc039dbb61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:46.537412 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3fb40-61a7-4893-8f69-fcc039dbb61d admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:46.550703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7951c70-2506-4547-a5b9-fe3c1f2bd2ff admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:46.556453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 978/1969] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:46.560796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3fb40-61a7-4893-8f69-fcc039dbb61d admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:46.563541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b89e8-9f16-41e4-a100-ce0f036c0ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:46.564248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b89e8-9f16-41e4-a100-ce0f036c0ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:46.564572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b89e8-9f16-41e4-a100-ce0f036c0ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:46.564856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b89e8-9f16-41e4-a100-ce0f036c0ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:46.565583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b89e8-9f16-41e4-a100-ce0f036c0ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:46.569207 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b89e8-9f16-41e4-a100-ce0f036c0ce5 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:46.573910 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3fb40-61a7-4893-8f69-fcc039dbb61d admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:46.583172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:46.590456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bd583-eac7-4b08-a684-de0a82190825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:46.591419 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bd583-eac7-4b08-a684-de0a82190825 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:46.591765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bd583-eac7-4b08-a684-de0a82190825 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:46.592264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bd583-eac7-4b08-a684-de0a82190825 admin admin] PATH_INFO: `/v3/projects/0e674354fca14cdeaf83305a0e2242c5/users/184e47846d9e4271a3e5e57091fdd684/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:46.622882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bd583-eac7-4b08-a684-de0a82190825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e674354fca14cdeaf83305a0e2242c5, user_id=184e47846d9e4271a3e5e57091fdd684, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:46.625696 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bd583-eac7-4b08-a684-de0a82190825 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:46.870775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 992/1970] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:46 2022] POST /identity/v3/users => generated 297 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:46.877011 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b89e8-9f16-41e4-a100-ce0f036c0ce5 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:46.888536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b89e8-9f16-41e4-a100-ce0f036c0ce5 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:46.893921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce8790-af1a-41c2-a703-767e4a8eddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:46.894696 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce8790-af1a-41c2-a703-767e4a8eddf1 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:46.898847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce8790-af1a-41c2-a703-767e4a8eddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:46.936678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce8790-af1a-41c2-a703-767e4a8eddf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:46.936678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce8790-af1a-41c2-a703-767e4a8eddf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:46.936678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce8790-af1a-41c2-a703-767e4a8eddf1 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:46.937444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 979/1971] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:46 2022] PUT /identity/v3/projects/0e674354fca14cdeaf83305a0e2242c5/users/184e47846d9e4271a3e5e57091fdd684/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:46.937567 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 993/1972] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:46.945777 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bd583-eac7-4b08-a684-de0a82190825 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:46.947308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce8790-af1a-41c2-a703-767e4a8eddf1 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:46.960243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce8790-af1a-41c2-a703-767e4a8eddf1 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:47.033920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bd583-eac7-4b08-a684-de0a82190825 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:47.040146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7445e1-c1f6-47a3-b484-8ed7473e164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:47.041133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7445e1-c1f6-47a3-b484-8ed7473e164d admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:47.041407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7445e1-c1f6-47a3-b484-8ed7473e164d admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:47.041682 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7445e1-c1f6-47a3-b484-8ed7473e164d admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:47.042553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7445e1-c1f6-47a3-b484-8ed7473e164d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:47.044534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7445e1-c1f6-47a3-b484-8ed7473e164d admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:47.045230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c452f2-2626-4de7-876d-4761f066700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:47.046251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c452f2-2626-4de7-876d-4761f066700e admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:47.046629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c452f2-2626-4de7-876d-4761f066700e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:47.047129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c452f2-2626-4de7-876d-4761f066700e admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:47.048587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c452f2-2626-4de7-876d-4761f066700e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:47.051541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c452f2-2626-4de7-876d-4761f066700e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:47.063726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 980/1973] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:47.068174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7445e1-c1f6-47a3-b484-8ed7473e164d admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:47.069079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 994/1974] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:47.074670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c452f2-2626-4de7-876d-4761f066700e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:47.081679 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7445e1-c1f6-47a3-b484-8ed7473e164d admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:47.086795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c452f2-2626-4de7-876d-4761f066700e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:47.089653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1c83f-0f64-4e96-8523-2edc9b262561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:47.091063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1c83f-0f64-4e96-8523-2edc9b262561 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:47.091572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1c83f-0f64-4e96-8523-2edc9b262561 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:47.091979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1c83f-0f64-4e96-8523-2edc9b262561 admin admin] PATH_INFO: `/v3/projects/296e117f96784347b25af1e5bba626b3/users/a35dfcfa6bf14549ba7d99cbd8deef94/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:47.092333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d18218-5c08-42c7-8af6-f093b2057b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:47.093450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d18218-5c08-42c7-8af6-f093b2057b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:47.093871 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d18218-5c08-42c7-8af6-f093b2057b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:47.094234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d18218-5c08-42c7-8af6-f093b2057b4e admin admin] PATH_INFO: `/v3/projects/0e674354fca14cdeaf83305a0e2242c5/users/184e47846d9e4271a3e5e57091fdd684/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:47.096571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d18218-5c08-42c7-8af6-f093b2057b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e674354fca14cdeaf83305a0e2242c5, user_id=184e47846d9e4271a3e5e57091fdd684, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:47.099368 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d18218-5c08-42c7-8af6-f093b2057b4e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:47.114360 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 995/1975] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:47 2022] PUT /identity/v3/projects/0e674354fca14cdeaf83305a0e2242c5/users/184e47846d9e4271a3e5e57091fdd684/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:47.121980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1c83f-0f64-4e96-8523-2edc9b262561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=296e117f96784347b25af1e5bba626b3, user_id=a35dfcfa6bf14549ba7d99cbd8deef94, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:47.125518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1c83f-0f64-4e96-8523-2edc9b262561 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:47.134484 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e39d08-3719-4e09-92c2-a16af107b65d None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:47.136341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e39d08-3719-4e09-92c2-a16af107b65d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:47.136920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e39d08-3719-4e09-92c2-a16af107b65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:47.193233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-86e39d08-3719-4e09-92c2-a16af107b65d None None] MFA Rules not processed for user `184e47846d9e4271a3e5e57091fdd684`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:47.195990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-86e39d08-3719-4e09-92c2-a16af107b65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:47.244387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 981/1976] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:47 2022] PUT /identity/v3/projects/296e117f96784347b25af1e5bba626b3/users/a35dfcfa6bf14549ba7d99cbd8deef94/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:47.252056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1c83f-0f64-4e96-8523-2edc9b262561 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:47.255186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-27e1c83f-0f64-4e96-8523-2edc9b262561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:47.329045 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1c83f-0f64-4e96-8523-2edc9b262561 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:47.333328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 996/1977] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:47.333328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638807e-56c1-4b38-a6a9-2ab7a92fdf9e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:47.333328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638807e-56c1-4b38-a6a9-2ab7a92fdf9e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:47.333999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638807e-56c1-4b38-a6a9-2ab7a92fdf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:47.334614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd84ba-372d-4d71-9664-0843776e9eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:47.336130 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd84ba-372d-4d71-9664-0843776e9eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:47.336523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd84ba-372d-4d71-9664-0843776e9eac admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:47.337010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd84ba-372d-4d71-9664-0843776e9eac admin admin] PATH_INFO: `/v3/users/aa7a79cd1ffa4e7faa3ad4ce4ebffcbb` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:47.338493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd84ba-372d-4d71-9664-0843776e9eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7a79cd1ffa4e7faa3ad4ce4ebffcbb)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:47.340811 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd84ba-372d-4d71-9664-0843776e9eac admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:47.385038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-2638807e-56c1-4b38-a6a9-2ab7a92fdf9e None None] MFA Rules not processed for user `a35dfcfa6bf14549ba7d99cbd8deef94`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:47.385038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2638807e-56c1-4b38-a6a9-2ab7a92fdf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:47.465340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 997/1978] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:47.466469 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638807e-56c1-4b38-a6a9-2ab7a92fdf9e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:47.467925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2638807e-56c1-4b38-a6a9-2ab7a92fdf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:47.541676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638807e-56c1-4b38-a6a9-2ab7a92fdf9e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:47.545735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861b18a-4781-4a6c-a6bd-71c3db34d59a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:47.546423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861b18a-4781-4a6c-a6bd-71c3db34d59a service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:47.546708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861b18a-4781-4a6c-a6bd-71c3db34d59a service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:47.546985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861b18a-4781-4a6c-a6bd-71c3db34d59a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:47.618754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861b18a-4781-4a6c-a6bd-71c3db34d59a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:47.622279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861b18a-4781-4a6c-a6bd-71c3db34d59a service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:47.635229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-b6bd84ba-372d-4d71-9664-0843776e9eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7a79cd1ffa4e7faa3ad4ce4ebffcbb'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:47.636470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 998/1979] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:47.637652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861b18a-4781-4a6c-a6bd-71c3db34d59a service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:47.661253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861b18a-4781-4a6c-a6bd-71c3db34d59a service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:47.664589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-b6bd84ba-372d-4d71-9664-0843776e9eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7a79cd1ffa4e7faa3ad4ce4ebffcbb'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:47.670130 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94b28b-0059-4fb0-a874-755f757e0848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:47.671468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94b28b-0059-4fb0-a874-755f757e0848 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:47.672043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94b28b-0059-4fb0-a874-755f757e0848 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:47.672724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94b28b-0059-4fb0-a874-755f757e0848 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:47.674486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94b28b-0059-4fb0-a874-755f757e0848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:47.678852 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94b28b-0059-4fb0-a874-755f757e0848 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:47.688764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-b6bd84ba-372d-4d71-9664-0843776e9eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7a79cd1ffa4e7faa3ad4ce4ebffcbb'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:47.794642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-b6bd84ba-372d-4d71-9664-0843776e9eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7a79cd1ffa4e7faa3ad4ce4ebffcbb'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:47.795371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-b6bd84ba-372d-4d71-9664-0843776e9eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7a79cd1ffa4e7faa3ad4ce4ebffcbb'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:47.804013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 982/1980] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:47 2022] DELETE /identity/v3/users/aa7a79cd1ffa4e7faa3ad4ce4ebffcbb => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:47.809155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc6b01-3858-4a1e-b177-88a3de71cd8d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:47.809444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc6b01-3858-4a1e-b177-88a3de71cd8d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:47.810002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc6b01-3858-4a1e-b177-88a3de71cd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:47.834496 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-9bcc6b01-3858-4a1e-b177-88a3de71cd8d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:47.846148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9bcc6b01-3858-4a1e-b177-88a3de71cd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:47.846816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 999/1981] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:47 2022] POST /identity/v3/projects => generated 391 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:47.849814 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94b28b-0059-4fb0-a874-755f757e0848 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:47.854879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8e94b28b-0059-4fb0-a874-755f757e0848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:47.945790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:48.046726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 983/1982] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:48.068547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc6b01-3858-4a1e-b177-88a3de71cd8d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:48.068547 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9bcc6b01-3858-4a1e-b177-88a3de71cd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:48.068729 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94b28b-0059-4fb0-a874-755f757e0848 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:48.072929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c0b7a-9eec-4899-9588-258babeeab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:48.073699 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c0b7a-9eec-4899-9588-258babeeab5d admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:48.074065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c0b7a-9eec-4899-9588-258babeeab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:48.074411 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c0b7a-9eec-4899-9588-258babeeab5d admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:48.075190 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c0b7a-9eec-4899-9588-258babeeab5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:48.077420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c0b7a-9eec-4899-9588-258babeeab5d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:48.136751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc6b01-3858-4a1e-b177-88a3de71cd8d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:48.194187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fa4ee-fc74-421d-8bb1-20e00d066082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:48.194533 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fa4ee-fc74-421d-8bb1-20e00d066082 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:48.194916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fa4ee-fc74-421d-8bb1-20e00d066082 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:48.195204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fa4ee-fc74-421d-8bb1-20e00d066082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:48.204881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fa4ee-fc74-421d-8bb1-20e00d066082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:48.206343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fa4ee-fc74-421d-8bb1-20e00d066082 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:48.217445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 984/1983] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:48.229822 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1000/1984] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:47 2022] POST /identity/v3/users => generated 302 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:58:48.233614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fa4ee-fc74-421d-8bb1-20e00d066082 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:48.244907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fa4ee-fc74-421d-8bb1-20e00d066082 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:48.250438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e876d-1240-4483-8226-553fd3c8585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:48.251661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e876d-1240-4483-8226-553fd3c8585b admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:48.251973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e876d-1240-4483-8226-553fd3c8585b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:48.252222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e876d-1240-4483-8226-553fd3c8585b admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:48.253140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e876d-1240-4483-8226-553fd3c8585b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:48.255481 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e876d-1240-4483-8226-553fd3c8585b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:48.276330 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 985/1985] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:48.277720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c0b7a-9eec-4899-9588-258babeeab5d admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:48.291874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c0b7a-9eec-4899-9588-258babeeab5d admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:48.298259 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84170fcf-ec50-4b9e-a4a3-195df4cc454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:48.299803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84170fcf-ec50-4b9e-a4a3-195df4cc454e admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:48.300172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84170fcf-ec50-4b9e-a4a3-195df4cc454e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:48.300568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84170fcf-ec50-4b9e-a4a3-195df4cc454e admin admin] PATH_INFO: `/v3/projects/afb1f457c20d45aab8490acb9e494f44/users/e384b89f1a05424b8bf8f69d5f26e282/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:48.319863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84170fcf-ec50-4b9e-a4a3-195df4cc454e admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb1f457c20d45aab8490acb9e494f44, user_id=e384b89f1a05424b8bf8f69d5f26e282, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:48.323713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84170fcf-ec50-4b9e-a4a3-195df4cc454e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:48.491413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e876d-1240-4483-8226-553fd3c8585b admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:48.493500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a05e876d-1240-4483-8226-553fd3c8585b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:48.517249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e876d-1240-4483-8226-553fd3c8585b admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:48.524586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:48.525459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:48.525459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:48.526173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] PATH_INFO: `/v3/users/da6fffad00254cde92126c1d5cae6da5` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:48.527434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6fffad00254cde92126c1d5cae6da5)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:48.529671 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:48.592862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1001/1986] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:48 2022] PUT /identity/v3/projects/afb1f457c20d45aab8490acb9e494f44/users/e384b89f1a05424b8bf8f69d5f26e282/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:48.598774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84170fcf-ec50-4b9e-a4a3-195df4cc454e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:48.710455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84170fcf-ec50-4b9e-a4a3-195df4cc454e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:48.717737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc47c3-5021-4c7f-bda2-d6597c431319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:48.719266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc47c3-5021-4c7f-bda2-d6597c431319 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:48.720012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc47c3-5021-4c7f-bda2-d6597c431319 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:48.720263 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc47c3-5021-4c7f-bda2-d6597c431319 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:48.721779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc47c3-5021-4c7f-bda2-d6597c431319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:48.724995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc47c3-5021-4c7f-bda2-d6597c431319 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:48.746085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1002/1987] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:48.751608 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc47c3-5021-4c7f-bda2-d6597c431319 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:48.770786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc47c3-5021-4c7f-bda2-d6597c431319 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:48.779400 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3230a-d0c1-4686-9c9a-729eccf26bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:48.781056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3230a-d0c1-4686-9c9a-729eccf26bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:48.781568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3230a-d0c1-4686-9c9a-729eccf26bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:48.782061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3230a-d0c1-4686-9c9a-729eccf26bdd admin admin] PATH_INFO: `/v3/projects/afb1f457c20d45aab8490acb9e494f44/users/e384b89f1a05424b8bf8f69d5f26e282/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:48.785817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3230a-d0c1-4686-9c9a-729eccf26bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb1f457c20d45aab8490acb9e494f44, user_id=e384b89f1a05424b8bf8f69d5f26e282, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:48.792030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3230a-d0c1-4686-9c9a-729eccf26bdd admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:48.810346 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1003/1988] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:48 2022] PUT /identity/v3/projects/afb1f457c20d45aab8490acb9e494f44/users/e384b89f1a05424b8bf8f69d5f26e282/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:48.820462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:48.822898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715f357-60bb-4825-b5be-bee526987bb0 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:48.823187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715f357-60bb-4825-b5be-bee526987bb0 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:48.824876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715f357-60bb-4825-b5be-bee526987bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:48.853062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6fffad00254cde92126c1d5cae6da5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:48.863922 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-9715f357-60bb-4825-b5be-bee526987bb0 None None] MFA Rules not processed for user `e384b89f1a05424b8bf8f69d5f26e282`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:48.869310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9715f357-60bb-4825-b5be-bee526987bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:48.869945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6fffad00254cde92126c1d5cae6da5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:48.876508 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6fffad00254cde92126c1d5cae6da5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:48.967434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1004/1989] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:48.968344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715f357-60bb-4825-b5be-bee526987bb0 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:48.969877 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9715f357-60bb-4825-b5be-bee526987bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:48.994037 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6fffad00254cde92126c1d5cae6da5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:48.995503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6fffad00254cde92126c1d5cae6da5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:49.010944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 986/1990] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:48 2022] DELETE /identity/v3/users/da6fffad00254cde92126c1d5cae6da5 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:49.012455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:49.014126 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:49.058118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715f357-60bb-4825-b5be-bee526987bb0 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:49.107491 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32008c-f781-4baf-9d7e-90b536c1ebc6 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:49.111772 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092813b-6996-4091-83b7-bce62f85fafb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:49.112502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092813b-6996-4091-83b7-bce62f85fafb service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:49.112823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092813b-6996-4091-83b7-bce62f85fafb service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:49.113104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092813b-6996-4091-83b7-bce62f85fafb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:49.128189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e092813b-6996-4091-83b7-bce62f85fafb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:49.178622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:49.180091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:49.180383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:49.182276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] PATH_INFO: `/v3/projects/c837c5f4b4174b50b70aa85696e7f518` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:49.190915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:49.190915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c837c5f4b4174b50b70aa85696e7f518)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:49.190915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:49.241173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092813b-6996-4091-83b7-bce62f85fafb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:49.242637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092813b-6996-4091-83b7-bce62f85fafb service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:49.254081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 987/1991] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:49.255559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6903c9-059c-4de3-9d28-e4f7c00a9604 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:49.255843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6903c9-059c-4de3-9d28-e4f7c00a9604 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:49.256178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6903c9-059c-4de3-9d28-e4f7c00a9604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:49.281928 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-de6903c9-059c-4de3-9d28-e4f7c00a9604 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:49.283234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-de6903c9-059c-4de3-9d28-e4f7c00a9604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:49.299168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 988/1992] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:49.312932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6903c9-059c-4de3-9d28-e4f7c00a9604 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:49.314840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-de6903c9-059c-4de3-9d28-e4f7c00a9604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:49.342515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c837c5f4b4174b50b70aa85696e7f518', 'request_id': 'req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:49.349458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c837c5f4b4174b50b70aa85696e7f518', 'request_id': 'req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:49.356774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c837c5f4b4174b50b70aa85696e7f518', 'request_id': 'req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:49.387714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6903c9-059c-4de3-9d28-e4f7c00a9604 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:49.451786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] The token cache is being invalidate because project c837c5f4b4174b50b70aa85696e7f518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:49.452205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:49.453774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:49.458257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45595-b489-41f3-b0f6-ad685fe63b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:49.459134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45595-b489-41f3-b0f6-ad685fe63b80 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:49.459523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45595-b489-41f3-b0f6-ad685fe63b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:49.459864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45595-b489-41f3-b0f6-ad685fe63b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:49.461990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1005/1993] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:48 2022] DELETE /identity/v3/projects/c837c5f4b4174b50b70aa85696e7f518 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:49.462144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-7cf45595-b489-41f3-b0f6-ad685fe63b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:49.463775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:49.466528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:49.549784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e3ea6-547d-4c0b-98c4-e53c811e89e8 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:49.555285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60133efc-d6ee-4443-b1f3-01b9e3eb631b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:49.555854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60133efc-d6ee-4443-b1f3-01b9e3eb631b service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:49.556136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60133efc-d6ee-4443-b1f3-01b9e3eb631b service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:49.556413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60133efc-d6ee-4443-b1f3-01b9e3eb631b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:49.559190 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-60133efc-d6ee-4443-b1f3-01b9e3eb631b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:49.584448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45595-b489-41f3-b0f6-ad685fe63b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:49.586423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45595-b489-41f3-b0f6-ad685fe63b80 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:49.598915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 989/1994] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:49.599789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45595-b489-41f3-b0f6-ad685fe63b80 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:49.602474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-7cf45595-b489-41f3-b0f6-ad685fe63b80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:49.615009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45595-b489-41f3-b0f6-ad685fe63b80 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:49.626108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:49.627021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:49.627294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:49.627629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] PATH_INFO: `/v3/users/4df54f6ef627460d86b4ff512ec9ffc3` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:49.628963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df54f6ef627460d86b4ff512ec9ffc3)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:49.630989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:49.638023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60133efc-d6ee-4443-b1f3-01b9e3eb631b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:49.640510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60133efc-d6ee-4443-b1f3-01b9e3eb631b service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:49.656731 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1006/1995] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:49.933562 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df54f6ef627460d86b4ff512ec9ffc3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:49.947915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df54f6ef627460d86b4ff512ec9ffc3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:49.958088 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df54f6ef627460d86b4ff512ec9ffc3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:50.102420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df54f6ef627460d86b4ff512ec9ffc3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:50.103061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df54f6ef627460d86b4ff512ec9ffc3'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:50.109716 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 990/1996] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:49 2022] DELETE /identity/v3/users/4df54f6ef627460d86b4ff512ec9ffc3 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:50.278468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60133efc-d6ee-4443-b1f3-01b9e3eb631b service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:50.284192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-60133efc-d6ee-4443-b1f3-01b9e3eb631b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:50.330992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60133efc-d6ee-4443-b1f3-01b9e3eb631b service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:50.424724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:50.425774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:50.426332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:50.426551 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] PATH_INFO: `/v3/projects/67102803a5d24bfc828efa38e5610eee` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:50.428119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67102803a5d24bfc828efa38e5610eee)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:50.431095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:50.581003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67102803a5d24bfc828efa38e5610eee', 'request_id': 'req-cfc60367-0d73-4320-9cea-48312758b712'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:50.589555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67102803a5d24bfc828efa38e5610eee', 'request_id': 'req-cfc60367-0d73-4320-9cea-48312758b712'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:50.601603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67102803a5d24bfc828efa38e5610eee', 'request_id': 'req-cfc60367-0d73-4320-9cea-48312758b712'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:50.723394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:50.731308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] The token cache is being invalidate because project 67102803a5d24bfc828efa38e5610eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:50.731697 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:50.732416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:50.735868 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1007/1997] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:50 2022] DELETE /identity/v3/projects/67102803a5d24bfc828efa38e5610eee => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:50.741153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:50.743068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:50.767004 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79708fc7-2d71-4e2e-845c-3bf67b1f2070 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:50.862866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da1424-0d2e-4b41-8387-c162343182a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:50.863764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da1424-0d2e-4b41-8387-c162343182a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:50.864048 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da1424-0d2e-4b41-8387-c162343182a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:50.864380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da1424-0d2e-4b41-8387-c162343182a2 admin admin] PATH_INFO: `/v3/users/184e47846d9e4271a3e5e57091fdd684` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:50.866736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da1424-0d2e-4b41-8387-c162343182a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=184e47846d9e4271a3e5e57091fdd684)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:50.868758 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da1424-0d2e-4b41-8387-c162343182a2 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:50.906126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:50.915952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:50.946113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc60367-0d73-4320-9cea-48312758b712 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:50.951779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabf0b0-1089-404a-a014-7a74676144cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:50.953003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabf0b0-1089-404a-a014-7a74676144cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:50.953291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabf0b0-1089-404a-a014-7a74676144cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:50.953577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabf0b0-1089-404a-a014-7a74676144cb admin admin] PATH_INFO: `/v3/projects/d420b2fc473347e9bf35e2e1b300dd90` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:50.955270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabf0b0-1089-404a-a014-7a74676144cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d420b2fc473347e9bf35e2e1b300dd90)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:50.957685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabf0b0-1089-404a-a014-7a74676144cb admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:51.211660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-55da1424-0d2e-4b41-8387-c162343182a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '184e47846d9e4271a3e5e57091fdd684'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:51.212875 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7cabf0b0-1089-404a-a014-7a74676144cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd420b2fc473347e9bf35e2e1b300dd90', 'request_id': 'req-7cabf0b0-1089-404a-a014-7a74676144cb'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:51.219505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7cabf0b0-1089-404a-a014-7a74676144cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd420b2fc473347e9bf35e2e1b300dd90', 'request_id': 'req-7cabf0b0-1089-404a-a014-7a74676144cb'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:51.226514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7cabf0b0-1089-404a-a014-7a74676144cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd420b2fc473347e9bf35e2e1b300dd90', 'request_id': 'req-7cabf0b0-1089-404a-a014-7a74676144cb'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:51.230402 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-55da1424-0d2e-4b41-8387-c162343182a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '184e47846d9e4271a3e5e57091fdd684'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:51.238202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-55da1424-0d2e-4b41-8387-c162343182a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '184e47846d9e4271a3e5e57091fdd684'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:51.371102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7cabf0b0-1089-404a-a014-7a74676144cb admin admin] The token cache is being invalidate because project d420b2fc473347e9bf35e2e1b300dd90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:51.371398 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7cabf0b0-1089-404a-a014-7a74676144cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:51.372270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7cabf0b0-1089-404a-a014-7a74676144cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:51.373933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1008/1998] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:50 2022] DELETE /identity/v3/projects/d420b2fc473347e9bf35e2e1b300dd90 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:51.378929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fa535-d812-4b58-979d-3f87ce888065 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:51.379350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fa535-d812-4b58-979d-3f87ce888065 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:51.379522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fa535-d812-4b58-979d-3f87ce888065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:51.408395 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e97fa535-d812-4b58-979d-3f87ce888065 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:51.409461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e97fa535-d812-4b58-979d-3f87ce888065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:51.468058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-55da1424-0d2e-4b41-8387-c162343182a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '184e47846d9e4271a3e5e57091fdd684'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:51.468761 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-55da1424-0d2e-4b41-8387-c162343182a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '184e47846d9e4271a3e5e57091fdd684'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:51.476161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 991/1999] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:50 2022] DELETE /identity/v3/users/184e47846d9e4271a3e5e57091fdd684 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:51.480514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1009/2000] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:51.488931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0107a5-9531-4af0-a418-a49bcb4db6bc None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:51.489217 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0107a5-9531-4af0-a418-a49bcb4db6bc None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:51.489577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0107a5-9531-4af0-a418-a49bcb4db6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:51.513189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-0e0107a5-9531-4af0-a418-a49bcb4db6bc None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:51.514602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0e0107a5-9531-4af0-a418-a49bcb4db6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:51.592328 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 992/2001] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:51.597187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fa535-d812-4b58-979d-3f87ce888065 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:51.608701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fa535-d812-4b58-979d-3f87ce888065 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:51.613623 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d42a1-7919-409a-a023-70ecb688226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:51.614305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d42a1-7919-409a-a023-70ecb688226d admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:51.614586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d42a1-7919-409a-a023-70ecb688226d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:51.614862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d42a1-7919-409a-a023-70ecb688226d admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:51.615704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d42a1-7919-409a-a023-70ecb688226d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:51.616031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d42a1-7919-409a-a023-70ecb688226d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:51.617682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d42a1-7919-409a-a023-70ecb688226d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:51.630667 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1010/2002] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:58:51.635608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0107a5-9531-4af0-a418-a49bcb4db6bc None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:51.650564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0107a5-9531-4af0-a418-a49bcb4db6bc None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:51.655656 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9396567-a3b5-4d79-a24b-b50d2db12408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:51.656322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9396567-a3b5-4d79-a24b-b50d2db12408 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:51.656643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9396567-a3b5-4d79-a24b-b50d2db12408 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:51.656927 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9396567-a3b5-4d79-a24b-b50d2db12408 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:51.657631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9396567-a3b5-4d79-a24b-b50d2db12408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:51.659619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9396567-a3b5-4d79-a24b-b50d2db12408 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:51.785345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 993/2003] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:51 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:51.789850 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d42a1-7919-409a-a023-70ecb688226d admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:51.801161 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d42a1-7919-409a-a023-70ecb688226d admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:51.873524 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7a1f1-8e66-445e-acd5-5a9911686488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:51.874327 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7a1f1-8e66-445e-acd5-5a9911686488 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:51.874617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7a1f1-8e66-445e-acd5-5a9911686488 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:51.874894 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7a1f1-8e66-445e-acd5-5a9911686488 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:51.875725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7a1f1-8e66-445e-acd5-5a9911686488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:51.879613 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7a1f1-8e66-445e-acd5-5a9911686488 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:52.019515 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9396567-a3b5-4d79-a24b-b50d2db12408 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:52.021343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a9396567-a3b5-4d79-a24b-b50d2db12408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:52.045148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9396567-a3b5-4d79-a24b-b50d2db12408 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:52.051824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e78189-3d36-42ad-a3c0-b4b08b659005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:52.052210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e78189-3d36-42ad-a3c0-b4b08b659005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:52.054683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e78189-3d36-42ad-a3c0-b4b08b659005 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:52.055054 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e78189-3d36-42ad-a3c0-b4b08b659005 admin admin] PATH_INFO: `/v3/projects/0e674354fca14cdeaf83305a0e2242c5` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:52.056966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1011/2004] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:51 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:52.057347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e78189-3d36-42ad-a3c0-b4b08b659005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e674354fca14cdeaf83305a0e2242c5)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:52.058796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e78189-3d36-42ad-a3c0-b4b08b659005 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:52.062658 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7a1f1-8e66-445e-acd5-5a9911686488 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:52.075956 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7a1f1-8e66-445e-acd5-5a9911686488 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:52.082402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fabc8-14d3-48b9-b8ea-19e31460d6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:52.083180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fabc8-14d3-48b9-b8ea-19e31460d6bc admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:52.083538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fabc8-14d3-48b9-b8ea-19e31460d6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:52.083867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fabc8-14d3-48b9-b8ea-19e31460d6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:52.084700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fabc8-14d3-48b9-b8ea-19e31460d6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:52.086418 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fabc8-14d3-48b9-b8ea-19e31460d6bc admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:52.097946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1012/2005] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:52.106520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fabc8-14d3-48b9-b8ea-19e31460d6bc admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:52.119739 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fabc8-14d3-48b9-b8ea-19e31460d6bc admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:52.125828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06802f-0dc1-4f6a-8f46-0c3906863a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:52.126571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06802f-0dc1-4f6a-8f46-0c3906863a9c admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:52.126894 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06802f-0dc1-4f6a-8f46-0c3906863a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:52.127206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06802f-0dc1-4f6a-8f46-0c3906863a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:52.128352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06802f-0dc1-4f6a-8f46-0c3906863a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:52.130538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06802f-0dc1-4f6a-8f46-0c3906863a9c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:52.143065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1013/2006] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:52.149491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06802f-0dc1-4f6a-8f46-0c3906863a9c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:52.160027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06802f-0dc1-4f6a-8f46-0c3906863a9c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:52.166002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c1f20-82ff-4756-b142-34e0ce61fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:52.167165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c1f20-82ff-4756-b142-34e0ce61fec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:52.167533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c1f20-82ff-4756-b142-34e0ce61fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:52.167862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c1f20-82ff-4756-b142-34e0ce61fec9 admin admin] PATH_INFO: `/v3/projects/cacd35525d534a01976ff51836fcb4e8/users/02e0232fed30433b9d4e90304211fe56/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:52.201209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c1f20-82ff-4756-b142-34e0ce61fec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cacd35525d534a01976ff51836fcb4e8, user_id=02e0232fed30433b9d4e90304211fe56, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:52.206600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c1f20-82ff-4756-b142-34e0ce61fec9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:52.291565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:52.355770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1014/2007] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:52 2022] PUT /identity/v3/projects/cacd35525d534a01976ff51836fcb4e8/users/02e0232fed30433b9d4e90304211fe56/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:52.365989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-58e78189-3d36-42ad-a3c0-b4b08b659005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e674354fca14cdeaf83305a0e2242c5', 'request_id': 'req-58e78189-3d36-42ad-a3c0-b4b08b659005'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:52.367778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba5316-8f67-47ca-899b-6ae0c3a1aa0b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:52.368206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba5316-8f67-47ca-899b-6ae0c3a1aa0b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:52.368869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba5316-8f67-47ca-899b-6ae0c3a1aa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:52.372458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-58e78189-3d36-42ad-a3c0-b4b08b659005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e674354fca14cdeaf83305a0e2242c5', 'request_id': 'req-58e78189-3d36-42ad-a3c0-b4b08b659005'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:52.412609 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-21ba5316-8f67-47ca-899b-6ae0c3a1aa0b None None] MFA Rules not processed for user `02e0232fed30433b9d4e90304211fe56`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:52.414309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-21ba5316-8f67-47ca-899b-6ae0c3a1aa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:52.483489 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-58e78189-3d36-42ad-a3c0-b4b08b659005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e674354fca14cdeaf83305a0e2242c5', 'request_id': 'req-58e78189-3d36-42ad-a3c0-b4b08b659005'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:52.508384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-58e78189-3d36-42ad-a3c0-b4b08b659005 admin admin] The token cache is being invalidate because project 0e674354fca14cdeaf83305a0e2242c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:52.508908 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-58e78189-3d36-42ad-a3c0-b4b08b659005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:52.509418 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1015/2008] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:52.509912 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-58e78189-3d36-42ad-a3c0-b4b08b659005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:52.511631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 994/2009] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:52 2022] DELETE /identity/v3/projects/0e674354fca14cdeaf83305a0e2242c5 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:52.516358 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba5316-8f67-47ca-899b-6ae0c3a1aa0b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:52.518739 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018286d8-3876-492c-98a1-0c26e01158d5 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:52.519258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018286d8-3876-492c-98a1-0c26e01158d5 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:52.519737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018286d8-3876-492c-98a1-0c26e01158d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:52.550904 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-018286d8-3876-492c-98a1-0c26e01158d5 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:52.552190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-018286d8-3876-492c-98a1-0c26e01158d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:52.643403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba5316-8f67-47ca-899b-6ae0c3a1aa0b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:52.649704 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec730e4b-d5c7-45f9-b03f-36577391e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:52.650624 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec730e4b-d5c7-45f9-b03f-36577391e7be admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:52.651048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec730e4b-d5c7-45f9-b03f-36577391e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:52.651454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec730e4b-d5c7-45f9-b03f-36577391e7be admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:52.652681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec730e4b-d5c7-45f9-b03f-36577391e7be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:52.655895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec730e4b-d5c7-45f9-b03f-36577391e7be admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:52.676566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 995/2010] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:52.682038 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60836ca-8f7d-4c7f-8283-3d26a08ee778 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:52.682328 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60836ca-8f7d-4c7f-8283-3d26a08ee778 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:52.682603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60836ca-8f7d-4c7f-8283-3d26a08ee778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:52.703928 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-a60836ca-8f7d-4c7f-8283-3d26a08ee778 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:52.705255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a60836ca-8f7d-4c7f-8283-3d26a08ee778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:52.714733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 996/2011] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:52.719651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60836ca-8f7d-4c7f-8283-3d26a08ee778 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:52.732738 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60836ca-8f7d-4c7f-8283-3d26a08ee778 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:52.737969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc442b5a-0f1a-4348-83c1-c39b310b54c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:52.738905 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc442b5a-0f1a-4348-83c1-c39b310b54c4 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:52.739226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc442b5a-0f1a-4348-83c1-c39b310b54c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:52.739520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc442b5a-0f1a-4348-83c1-c39b310b54c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:52.741495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc442b5a-0f1a-4348-83c1-c39b310b54c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:52.742124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc442b5a-0f1a-4348-83c1-c39b310b54c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:52.743989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc442b5a-0f1a-4348-83c1-c39b310b54c4 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:52.759595 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 997/2012] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:58:52.762860 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1016/2013] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:52 2022] POST /identity/v3/projects => generated 369 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:52.778680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc442b5a-0f1a-4348-83c1-c39b310b54c4 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:52.778680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc442b5a-0f1a-4348-83c1-c39b310b54c4 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:52.779955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec730e4b-d5c7-45f9-b03f-36577391e7be admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:52.783008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ec730e4b-d5c7-45f9-b03f-36577391e7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:52.892331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bcfeb-7632-4a53-bfc9-d64c5d09b41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:52.893128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bcfeb-7632-4a53-bfc9-d64c5d09b41f admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:52.893416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bcfeb-7632-4a53-bfc9-d64c5d09b41f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:52.893689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bcfeb-7632-4a53-bfc9-d64c5d09b41f admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:52.894527 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bcfeb-7632-4a53-bfc9-d64c5d09b41f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:52.896605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bcfeb-7632-4a53-bfc9-d64c5d09b41f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:52.929689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec730e4b-d5c7-45f9-b03f-36577391e7be admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:52.934200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0139a7a-9fe4-447c-aaa2-d1d3a1057a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:52.935103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0139a7a-9fe4-447c-aaa2-d1d3a1057a4c admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:52.935481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0139a7a-9fe4-447c-aaa2-d1d3a1057a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:52.935867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0139a7a-9fe4-447c-aaa2-d1d3a1057a4c admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:52.936708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0139a7a-9fe4-447c-aaa2-d1d3a1057a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:52.938876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0139a7a-9fe4-447c-aaa2-d1d3a1057a4c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:53.040695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 998/2014] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:52 2022] POST /identity/v3/projects => generated 373 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:53.046108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bcfeb-7632-4a53-bfc9-d64c5d09b41f admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:53.112776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1017/2015] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:52 2022] POST /identity/v3/users => generated 291 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:53.117947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0139a7a-9fe4-447c-aaa2-d1d3a1057a4c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:53.130326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0139a7a-9fe4-447c-aaa2-d1d3a1057a4c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:53.137743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a62aa-207b-4eb5-8e2b-c2114302afa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:53.138792 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a62aa-207b-4eb5-8e2b-c2114302afa6 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:53.139169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a62aa-207b-4eb5-8e2b-c2114302afa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:53.139539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a62aa-207b-4eb5-8e2b-c2114302afa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:53.141300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a62aa-207b-4eb5-8e2b-c2114302afa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:53.144934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a62aa-207b-4eb5-8e2b-c2114302afa6 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:53.145313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bcfeb-7632-4a53-bfc9-d64c5d09b41f admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:53.154861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51131645-4e06-4665-9465-0e04db214ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:53.156269 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51131645-4e06-4665-9465-0e04db214ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:53.156916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51131645-4e06-4665-9465-0e04db214ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:53.157717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51131645-4e06-4665-9465-0e04db214ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:53.159189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51131645-4e06-4665-9465-0e04db214ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:53.164216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51131645-4e06-4665-9465-0e04db214ff4 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:53.169449 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1018/2016] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:53.170494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a62aa-207b-4eb5-8e2b-c2114302afa6 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:53.190123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a62aa-207b-4eb5-8e2b-c2114302afa6 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:53.198773 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61314567-497d-42a3-b6ab-a6aedeaae1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:53.200373 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61314567-497d-42a3-b6ab-a6aedeaae1b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:53.200907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61314567-497d-42a3-b6ab-a6aedeaae1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:53.202250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61314567-497d-42a3-b6ab-a6aedeaae1b7 admin admin] PATH_INFO: `/v3/projects/0033cf80de6a46ddb46668fd347dc43b/users/18c1b09ffb6c4272811c36ac61e7476d/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:53.231688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61314567-497d-42a3-b6ab-a6aedeaae1b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0033cf80de6a46ddb46668fd347dc43b, user_id=18c1b09ffb6c4272811c36ac61e7476d, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:53.237549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61314567-497d-42a3-b6ab-a6aedeaae1b7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:53.354986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 999/2017] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:53 2022] POST /identity/v3/users => generated 287 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:53.359850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51131645-4e06-4665-9465-0e04db214ff4 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:53.374723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51131645-4e06-4665-9465-0e04db214ff4 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:53.386476 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbeb71-ddd9-4bfe-b744-c82bd0478e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:53.387181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbeb71-ddd9-4bfe-b744-c82bd0478e32 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:53.387610 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbeb71-ddd9-4bfe-b744-c82bd0478e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:53.388053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbeb71-ddd9-4bfe-b744-c82bd0478e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:53.389118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbeb71-ddd9-4bfe-b744-c82bd0478e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:53.391425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbeb71-ddd9-4bfe-b744-c82bd0478e32 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:53.405414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1000/2018] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:53.410256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbeb71-ddd9-4bfe-b744-c82bd0478e32 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:53.421029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1019/2019] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:53 2022] PUT /identity/v3/projects/0033cf80de6a46ddb46668fd347dc43b/users/18c1b09ffb6c4272811c36ac61e7476d/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:53.424700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbeb71-ddd9-4bfe-b744-c82bd0478e32 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:53.425572 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61314567-497d-42a3-b6ab-a6aedeaae1b7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:53.511196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417339eb-aedb-4dd7-b88c-79170d4c1e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:53.512852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417339eb-aedb-4dd7-b88c-79170d4c1e72 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:53.513324 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417339eb-aedb-4dd7-b88c-79170d4c1e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:53.513613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417339eb-aedb-4dd7-b88c-79170d4c1e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:53.514579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417339eb-aedb-4dd7-b88c-79170d4c1e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:53.517164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417339eb-aedb-4dd7-b88c-79170d4c1e72 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:53.531561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1001/2020] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:53.542124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417339eb-aedb-4dd7-b88c-79170d4c1e72 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:53.546445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61314567-497d-42a3-b6ab-a6aedeaae1b7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:53.553318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad19e05-65ee-4112-9206-e22b0f8bb526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:53.554616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad19e05-65ee-4112-9206-e22b0f8bb526 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:53.554802 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad19e05-65ee-4112-9206-e22b0f8bb526 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:53.555084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad19e05-65ee-4112-9206-e22b0f8bb526 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:53.555896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad19e05-65ee-4112-9206-e22b0f8bb526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:53.557687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad19e05-65ee-4112-9206-e22b0f8bb526 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:53.561022 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417339eb-aedb-4dd7-b88c-79170d4c1e72 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:53.569886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4b6f1-3d5d-4643-a25a-35cb5e6f75f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:53.570637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1020/2021] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:58:53.572907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4b6f1-3d5d-4643-a25a-35cb5e6f75f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:53.573660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4b6f1-3d5d-4643-a25a-35cb5e6f75f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:53.573827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4b6f1-3d5d-4643-a25a-35cb5e6f75f0 admin admin] PATH_INFO: `/v3/projects/6c02bca06ed043edb7e5b72747b03aa9/users/d336323ba8ab4de29016dbcc4d04c270/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:53.577090 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad19e05-65ee-4112-9206-e22b0f8bb526 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:53.608084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4b6f1-3d5d-4643-a25a-35cb5e6f75f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c02bca06ed043edb7e5b72747b03aa9, user_id=d336323ba8ab4de29016dbcc4d04c270, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:53.608084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4b6f1-3d5d-4643-a25a-35cb5e6f75f0 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:53.622127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad19e05-65ee-4112-9206-e22b0f8bb526 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:53.628127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a334e49-7663-45c2-bdc6-05db3c0ba778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:53.629244 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a334e49-7663-45c2-bdc6-05db3c0ba778 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:53.629600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a334e49-7663-45c2-bdc6-05db3c0ba778 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:53.629990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a334e49-7663-45c2-bdc6-05db3c0ba778 admin admin] PATH_INFO: `/v3/projects/0033cf80de6a46ddb46668fd347dc43b/users/18c1b09ffb6c4272811c36ac61e7476d/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:53.632935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a334e49-7663-45c2-bdc6-05db3c0ba778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0033cf80de6a46ddb46668fd347dc43b, user_id=18c1b09ffb6c4272811c36ac61e7476d, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:53.635533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a334e49-7663-45c2-bdc6-05db3c0ba778 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:53.649771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1021/2022] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:53 2022] PUT /identity/v3/projects/0033cf80de6a46ddb46668fd347dc43b/users/18c1b09ffb6c4272811c36ac61e7476d/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:53.672963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da943-b216-4f24-b5ab-29aaf475f3ad None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:53.673270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da943-b216-4f24-b5ab-29aaf475f3ad None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:53.673557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6da943-b216-4f24-b5ab-29aaf475f3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:53.715286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-de6da943-b216-4f24-b5ab-29aaf475f3ad None None] MFA Rules not processed for user `18c1b09ffb6c4272811c36ac61e7476d`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:53.716728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-de6da943-b216-4f24-b5ab-29aaf475f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:53.741605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1002/2023] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:53 2022] PUT /identity/v3/projects/6c02bca06ed043edb7e5b72747b03aa9/users/d336323ba8ab4de29016dbcc4d04c270/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:53.753999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbf2f8-e730-44db-8819-cd5f398766e7 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:53.754287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbf2f8-e730-44db-8819-cd5f398766e7 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:53.754663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbf2f8-e730-44db-8819-cd5f398766e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:53.786522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-54cbf2f8-e730-44db-8819-cd5f398766e7 None None] MFA Rules not processed for user `d336323ba8ab4de29016dbcc4d04c270`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:53.788657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-54cbf2f8-e730-44db-8819-cd5f398766e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:53.810865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1022/2024] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:53 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:53.816764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:53.824218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da943-b216-4f24-b5ab-29aaf475f3ad None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:53.825749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-de6da943-b216-4f24-b5ab-29aaf475f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:53.887408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1003/2025] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:53.889580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6da943-b216-4f24-b5ab-29aaf475f3ad None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:53.955069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e0a08-c281-44e2-82cb-ff92f29786a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:53.955911 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e0a08-c281-44e2-82cb-ff92f29786a3 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:53.956287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e0a08-c281-44e2-82cb-ff92f29786a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:53.956709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e0a08-c281-44e2-82cb-ff92f29786a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:53.964135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbf2f8-e730-44db-8819-cd5f398766e7 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:53.965906 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-54cbf2f8-e730-44db-8819-cd5f398766e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:53.978001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbf2f8-e730-44db-8819-cd5f398766e7 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:53.981859 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefda6fa-da2f-4367-bedb-b0e3c022ed2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:53.982519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefda6fa-da2f-4367-bedb-b0e3c022ed2c service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:53.982807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefda6fa-da2f-4367-bedb-b0e3c022ed2c service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:53.983079 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefda6fa-da2f-4367-bedb-b0e3c022ed2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:54.000680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefda6fa-da2f-4367-bedb-b0e3c022ed2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:54.002221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefda6fa-da2f-4367-bedb-b0e3c022ed2c service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:54.013364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1004/2026] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:54.041790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefda6fa-da2f-4367-bedb-b0e3c022ed2c service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:54.054393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e0a08-c281-44e2-82cb-ff92f29786a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:54.057646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e0a08-c281-44e2-82cb-ff92f29786a3 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:54.080384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1023/2027] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:53 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:54.150312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefda6fa-da2f-4367-bedb-b0e3c022ed2c service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:54.156251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:54.157835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:54.157835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:54.158043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] PATH_INFO: `/v3/users/d336323ba8ab4de29016dbcc4d04c270` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:54.159339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d336323ba8ab4de29016dbcc4d04c270)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:54.161460 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:54.461977 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd336323ba8ab4de29016dbcc4d04c270'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:54.479688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd336323ba8ab4de29016dbcc4d04c270'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:54.487919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd336323ba8ab4de29016dbcc4d04c270'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:54.616561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd336323ba8ab4de29016dbcc4d04c270'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:54.617189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd336323ba8ab4de29016dbcc4d04c270'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:54.624006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1005/2028] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:54 2022] DELETE /identity/v3/users/d336323ba8ab4de29016dbcc4d04c270 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:54.628942 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175979c-7247-4a55-b0f4-94ec36855bc8 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:54.629516 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175979c-7247-4a55-b0f4-94ec36855bc8 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:54.629516 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175979c-7247-4a55-b0f4-94ec36855bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:54.666585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-4175979c-7247-4a55-b0f4-94ec36855bc8 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:54.670173 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4175979c-7247-4a55-b0f4-94ec36855bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:54.784715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1024/2029] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:54.798725 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:54.800369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:54.914370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d58cf-1d55-4d82-96d0-1f3016659080 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:54.921759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a026b25-093b-4fa2-a5ea-477840ea8640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:54.922896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a026b25-093b-4fa2-a5ea-477840ea8640 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:54.923460 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a026b25-093b-4fa2-a5ea-477840ea8640 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:54.924302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a026b25-093b-4fa2-a5ea-477840ea8640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:54.944364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a026b25-093b-4fa2-a5ea-477840ea8640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:54.946313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a026b25-093b-4fa2-a5ea-477840ea8640 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:54.966818 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1006/2030] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:55.015468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:55.847861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175979c-7247-4a55-b0f4-94ec36855bc8 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:55.849844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4175979c-7247-4a55-b0f4-94ec36855bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:55.870853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175979c-7247-4a55-b0f4-94ec36855bc8 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:55.876528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904f8d9-939f-402a-8bf7-acc650f258e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:55.877724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904f8d9-939f-402a-8bf7-acc650f258e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:55.877916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904f8d9-939f-402a-8bf7-acc650f258e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:55.878197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904f8d9-939f-402a-8bf7-acc650f258e7 admin admin] PATH_INFO: `/v3/projects/6c02bca06ed043edb7e5b72747b03aa9` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:55.881638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904f8d9-939f-402a-8bf7-acc650f258e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c02bca06ed043edb7e5b72747b03aa9)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:55.884053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904f8d9-939f-402a-8bf7-acc650f258e7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:56.031544 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6904f8d9-939f-402a-8bf7-acc650f258e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c02bca06ed043edb7e5b72747b03aa9', 'request_id': 'req-6904f8d9-939f-402a-8bf7-acc650f258e7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:56.043740 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6904f8d9-939f-402a-8bf7-acc650f258e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c02bca06ed043edb7e5b72747b03aa9', 'request_id': 'req-6904f8d9-939f-402a-8bf7-acc650f258e7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:56.051747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6904f8d9-939f-402a-8bf7-acc650f258e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c02bca06ed043edb7e5b72747b03aa9', 'request_id': 'req-6904f8d9-939f-402a-8bf7-acc650f258e7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:56.167996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6904f8d9-939f-402a-8bf7-acc650f258e7 admin admin] The token cache is being invalidate because project 6c02bca06ed043edb7e5b72747b03aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:56.167996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6904f8d9-939f-402a-8bf7-acc650f258e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:56.167996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6904f8d9-939f-402a-8bf7-acc650f258e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:56.170690 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1025/2031] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:55 2022] DELETE /identity/v3/projects/6c02bca06ed043edb7e5b72747b03aa9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:56.177933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2c5d5-ee9e-4160-8423-e704040f6ddc None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:56.179275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2c5d5-ee9e-4160-8423-e704040f6ddc None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:56.179892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2c5d5-ee9e-4160-8423-e704040f6ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:56.220365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c0b2c5d5-ee9e-4160-8423-e704040f6ddc None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:56.221994 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c0b2c5d5-ee9e-4160-8423-e704040f6ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:56.321503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1007/2032] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:56.329795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd90bdb-b380-47f0-9234-61991c2e083c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:56.330185 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd90bdb-b380-47f0-9234-61991c2e083c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:56.330706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd90bdb-b380-47f0-9234-61991c2e083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:56.375079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-0bd90bdb-b380-47f0-9234-61991c2e083c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:56.375079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0bd90bdb-b380-47f0-9234-61991c2e083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:56.385051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1026/2033] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:56.389708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2c5d5-ee9e-4160-8423-e704040f6ddc None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:56.410808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2c5d5-ee9e-4160-8423-e704040f6ddc None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:56.419974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40654206-c869-4cd7-b570-c93b144341de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:56.421193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654206-c869-4cd7-b570-c93b144341de admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:56.421693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654206-c869-4cd7-b570-c93b144341de admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:56.422187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654206-c869-4cd7-b570-c93b144341de admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:56.423597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40654206-c869-4cd7-b570-c93b144341de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:58:56.424156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40654206-c869-4cd7-b570-c93b144341de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:56.427708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40654206-c869-4cd7-b570-c93b144341de admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:56.457757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1008/2034] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:58:56.462531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd90bdb-b380-47f0-9234-61991c2e083c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:56.475330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd90bdb-b380-47f0-9234-61991c2e083c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:56.481295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa1345-d918-49c5-875e-b2448e06a4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:56.482603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa1345-d918-49c5-875e-b2448e06a4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:56.482745 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa1345-d918-49c5-875e-b2448e06a4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:56.483031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa1345-d918-49c5-875e-b2448e06a4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:56.483878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa1345-d918-49c5-875e-b2448e06a4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:56.486199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa1345-d918-49c5-875e-b2448e06a4f3 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:56.626784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1027/2035] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:58:56 2022] POST /identity/v3/projects => generated 359 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:56.634146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40654206-c869-4cd7-b570-c93b144341de admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:56.658584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40654206-c869-4cd7-b570-c93b144341de admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:56.689530 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:56.817197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d64e66-9618-409a-aff7-1690148ca7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:56.818619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d64e66-9618-409a-aff7-1690148ca7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:56.819106 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d64e66-9618-409a-aff7-1690148ca7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:56.819609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d64e66-9618-409a-aff7-1690148ca7c6 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:56.820983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d64e66-9618-409a-aff7-1690148ca7c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:56.824892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d64e66-9618-409a-aff7-1690148ca7c6 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:57.000216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1009/2036] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:58:56 2022] POST /identity/v3/users => generated 280 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:58:57.007838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa1345-d918-49c5-875e-b2448e06a4f3 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:57.019745 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa1345-d918-49c5-875e-b2448e06a4f3 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:57.027038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3586d-157d-484a-a514-ae8c4b0ef368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:57.028376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3586d-157d-484a-a514-ae8c4b0ef368 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:57.028847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3586d-157d-484a-a514-ae8c4b0ef368 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:57.029285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3586d-157d-484a-a514-ae8c4b0ef368 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:57.039798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3586d-157d-484a-a514-ae8c4b0ef368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:57.043827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3586d-157d-484a-a514-ae8c4b0ef368 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:57.074972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d64e66-9618-409a-aff7-1690148ca7c6 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:57.082919 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1028/2037] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:57.088891 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d64e66-9618-409a-aff7-1690148ca7c6 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:57.095821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372099b-c620-4e0d-be15-d743264f4aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:57.096553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372099b-c620-4e0d-be15-d743264f4aac admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:57.096879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372099b-c620-4e0d-be15-d743264f4aac admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:57.097164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372099b-c620-4e0d-be15-d743264f4aac admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:57.097947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372099b-c620-4e0d-be15-d743264f4aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:57.100535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372099b-c620-4e0d-be15-d743264f4aac admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:57.119247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1010/2038] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:58:57.123869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3586d-157d-484a-a514-ae8c4b0ef368 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:57.135929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3586d-157d-484a-a514-ae8c4b0ef368 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:57.142592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc41673-5091-47f8-8adf-1d3a5e71bfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:57.143592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc41673-5091-47f8-8adf-1d3a5e71bfaa admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:57.143880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc41673-5091-47f8-8adf-1d3a5e71bfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:57.144159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc41673-5091-47f8-8adf-1d3a5e71bfaa admin admin] PATH_INFO: `/v3/projects/248fe82f3d9c467d8891a6749765304a/users/05ea3b7a703549e4b373985e3c3cabb5/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:57.169532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc41673-5091-47f8-8adf-1d3a5e71bfaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=248fe82f3d9c467d8891a6749765304a, user_id=05ea3b7a703549e4b373985e3c3cabb5, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:57.176624 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc41673-5091-47f8-8adf-1d3a5e71bfaa admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:57.360208 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1029/2039] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:58:57 2022] PUT /identity/v3/projects/248fe82f3d9c467d8891a6749765304a/users/05ea3b7a703549e4b373985e3c3cabb5/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:57.372829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a55d44-329a-454a-ad9a-525071963837 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:57.372829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a55d44-329a-454a-ad9a-525071963837 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:57.373829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a55d44-329a-454a-ad9a-525071963837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:57.418957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-61a55d44-329a-454a-ad9a-525071963837 None None] MFA Rules not processed for user `05ea3b7a703549e4b373985e3c3cabb5`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:57.418957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-61a55d44-329a-454a-ad9a-525071963837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:57.433957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc41673-5091-47f8-8adf-1d3a5e71bfaa admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:57.435961 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ffc41673-5091-47f8-8adf-1d3a5e71bfaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:57.562732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc41673-5091-47f8-8adf-1d3a5e71bfaa admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:57.568749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36c27d-858b-4d97-8164-44e2abbb520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:57.570046 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36c27d-858b-4d97-8164-44e2abbb520e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:57.570671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36c27d-858b-4d97-8164-44e2abbb520e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:57.571159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36c27d-858b-4d97-8164-44e2abbb520e admin admin] PATH_INFO: `/v3/users/a35dfcfa6bf14549ba7d99cbd8deef94` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:57.573107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36c27d-858b-4d97-8164-44e2abbb520e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35dfcfa6bf14549ba7d99cbd8deef94)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:57.574623 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1011/2040] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:57 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:57.576171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36c27d-858b-4d97-8164-44e2abbb520e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:57.588016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:57.623896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a55d44-329a-454a-ad9a-525071963837 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:57.627549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-61a55d44-329a-454a-ad9a-525071963837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:57.726918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a55d44-329a-454a-ad9a-525071963837 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:57.730984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1cb5d-b2f5-4a44-b8a5-93698af01e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:57.731686 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1cb5d-b2f5-4a44-b8a5-93698af01e24 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:57.732069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1cb5d-b2f5-4a44-b8a5-93698af01e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:57.732352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1cb5d-b2f5-4a44-b8a5-93698af01e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:57.742675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1cb5d-b2f5-4a44-b8a5-93698af01e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:57.744191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1cb5d-b2f5-4a44-b8a5-93698af01e24 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:57.754453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1012/2041] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:57 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:57.772226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1cb5d-b2f5-4a44-b8a5-93698af01e24 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:57.792870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1cb5d-b2f5-4a44-b8a5-93698af01e24 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:57.800603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4689c-e148-4297-9a22-4624c799c915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:57.801492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4689c-e148-4297-9a22-4624c799c915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:57.801850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4689c-e148-4297-9a22-4624c799c915 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:57.802144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4689c-e148-4297-9a22-4624c799c915 admin admin] PATH_INFO: `/v3/users/05ea3b7a703549e4b373985e3c3cabb5` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:57.803688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4689c-e148-4297-9a22-4624c799c915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ea3b7a703549e4b373985e3c3cabb5)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:57.806170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4689c-e148-4297-9a22-4624c799c915 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:57.889317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1b36c27d-858b-4d97-8164-44e2abbb520e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35dfcfa6bf14549ba7d99cbd8deef94'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:57.940437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1b36c27d-858b-4d97-8164-44e2abbb520e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35dfcfa6bf14549ba7d99cbd8deef94'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:57.949540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1b36c27d-858b-4d97-8164-44e2abbb520e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35dfcfa6bf14549ba7d99cbd8deef94'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:58.085437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1b36c27d-858b-4d97-8164-44e2abbb520e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35dfcfa6bf14549ba7d99cbd8deef94'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:58.087820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1b36c27d-858b-4d97-8164-44e2abbb520e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35dfcfa6bf14549ba7d99cbd8deef94'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:58.095619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1030/2042] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:57 2022] DELETE /identity/v3/users/a35dfcfa6bf14549ba7d99cbd8deef94 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:58.101011 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9296a25-5911-4da3-96d3-c384e7d8c64a None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:58.101298 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9296a25-5911-4da3-96d3-c384e7d8c64a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:58.101579 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9296a25-5911-4da3-96d3-c384e7d8c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:58.128397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:58:58.133031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f9296a25-5911-4da3-96d3-c384e7d8c64a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:58.135691 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f9296a25-5911-4da3-96d3-c384e7d8c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:58.145528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e0d4689c-e148-4297-9a22-4624c799c915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ea3b7a703549e4b373985e3c3cabb5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:58.166870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e0d4689c-e148-4297-9a22-4624c799c915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ea3b7a703549e4b373985e3c3cabb5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:58.188096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e0d4689c-e148-4297-9a22-4624c799c915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ea3b7a703549e4b373985e3c3cabb5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:58.256622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1031/2043] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:58:58.259953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab595d-b8e2-4a3a-b832-b4cb4b83b012 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:58.266127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab595d-b8e2-4a3a-b832-b4cb4b83b012 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:58.266127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab595d-b8e2-4a3a-b832-b4cb4b83b012 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:58.266127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1032/2044] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 17:58:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 17:58:58.267337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab595d-b8e2-4a3a-b832-b4cb4b83b012 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:58.270039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-bdab595d-b8e2-4a3a-b832-b4cb4b83b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:58.347072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab595d-b8e2-4a3a-b832-b4cb4b83b012 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:58.353314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4a82d-b912-4013-93c8-742cdd350b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:58.354037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4a82d-b912-4013-93c8-742cdd350b87 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:58.354312 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4a82d-b912-4013-93c8-742cdd350b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:58.354582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4a82d-b912-4013-93c8-742cdd350b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:58.366098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4a82d-b912-4013-93c8-742cdd350b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:58.367601 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4a82d-b912-4013-93c8-742cdd350b87 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:58.378076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1033/2045] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:58.379596 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525001-e750-464d-b70a-5bce4bbb3bb3 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:58.379888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525001-e750-464d-b70a-5bce4bbb3bb3 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:58.380164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3525001-e750-464d-b70a-5bce4bbb3bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:58.402494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e0d4689c-e148-4297-9a22-4624c799c915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ea3b7a703549e4b373985e3c3cabb5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:58.403762 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e0d4689c-e148-4297-9a22-4624c799c915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ea3b7a703549e4b373985e3c3cabb5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:58.413292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b3525001-e750-464d-b70a-5bce4bbb3bb3 None None] MFA Rules not processed for user `b218402abe6540d8b81295676199f6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:58.415660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1013/2046] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:57 2022] DELETE /identity/v3/users/05ea3b7a703549e4b373985e3c3cabb5 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:58:58.417147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b3525001-e750-464d-b70a-5bce4bbb3bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:58.422015 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136744f-c876-4a9b-98ec-7066a7f985b5 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:58.422609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136744f-c876-4a9b-98ec-7066a7f985b5 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:58.423111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136744f-c876-4a9b-98ec-7066a7f985b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:58.450089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-a136744f-c876-4a9b-98ec-7066a7f985b5 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:58:58.452239 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a136744f-c876-4a9b-98ec-7066a7f985b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:58.496545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1034/2047] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 17:58:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:58.509595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3525001-e750-464d-b70a-5bce4bbb3bb3 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:58.512314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b3525001-e750-464d-b70a-5bce4bbb3bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:58.527694 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3525001-e750-464d-b70a-5bce4bbb3bb3 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:58.536556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d829a1-4c14-4726-89ed-01ec1137f39f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b218402abe6540d8b81295676199f6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:58.538563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d829a1-4c14-4726-89ed-01ec1137f39f service placement] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:58.539121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d829a1-4c14-4726-89ed-01ec1137f39f service placement] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:58.539586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d829a1-4c14-4726-89ed-01ec1137f39f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:58.547055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1014/2048] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:58:58.559040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d829a1-4c14-4726-89ed-01ec1137f39f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:58.560912 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d829a1-4c14-4726-89ed-01ec1137f39f service placement] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:58.570769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136744f-c876-4a9b-98ec-7066a7f985b5 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:58.574175 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a136744f-c876-4a9b-98ec-7066a7f985b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:58.579191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1035/2049] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:58:58.593922 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d829a1-4c14-4726-89ed-01ec1137f39f service placement] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:58.595204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e8d829a1-4c14-4726-89ed-01ec1137f39f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:58.631844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d829a1-4c14-4726-89ed-01ec1137f39f service placement] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:58.638445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:58.639323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:58.639986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:58.640269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] PATH_INFO: `/v3/users/2b14df3870114a00bd98291eb17d64ce` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:58.643302 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b14df3870114a00bd98291eb17d64ce)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:58.645818 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:58.699280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136744f-c876-4a9b-98ec-7066a7f985b5 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:58.708766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5c30c-f8ae-499d-a2df-e66aca0c0009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:58.709974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5c30c-f8ae-499d-a2df-e66aca0c0009 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:58.710604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5c30c-f8ae-499d-a2df-e66aca0c0009 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:58.711025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5c30c-f8ae-499d-a2df-e66aca0c0009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:58.735030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5c30c-f8ae-499d-a2df-e66aca0c0009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:58.737990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5c30c-f8ae-499d-a2df-e66aca0c0009 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:58.754159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1015/2050] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:58:59.041431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b14df3870114a00bd98291eb17d64ce'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.058830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b14df3870114a00bd98291eb17d64ce'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.067740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5c30c-f8ae-499d-a2df-e66aca0c0009 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:59.070329 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-38e5c30c-f8ae-499d-a2df-e66aca0c0009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:59.076251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b14df3870114a00bd98291eb17d64ce'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.098953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5c30c-f8ae-499d-a2df-e66aca0c0009 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:59.110474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:59.110474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:59.110474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:59.110474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] PATH_INFO: `/v3/projects/296e117f96784347b25af1e5bba626b3` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:59.121833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=296e117f96784347b25af1e5bba626b3)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:59.126007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:59.186258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b14df3870114a00bd98291eb17d64ce'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.194136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b14df3870114a00bd98291eb17d64ce'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.200552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1036/2051] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:58 2022] DELETE /identity/v3/users/2b14df3870114a00bd98291eb17d64ce => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:59.230615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:59.232216 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:59.352703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296e117f96784347b25af1e5bba626b3', 'request_id': 'req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.378059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296e117f96784347b25af1e5bba626b3', 'request_id': 'req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.380355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cecf38-c0be-47ac-bdd2-bbe04704d0f2 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:59.478476 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296e117f96784347b25af1e5bba626b3', 'request_id': 'req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.518501 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] The token cache is being invalidate because project 296e117f96784347b25af1e5bba626b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:58:59.520457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.522420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.525872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1016/2052] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:59 2022] DELETE /identity/v3/projects/296e117f96784347b25af1e5bba626b3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:59.526471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:59.527605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:59.528104 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:59.528448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] PATH_INFO: `/v3/users/02e0232fed30433b9d4e90304211fe56` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:59.530776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e0232fed30433b9d4e90304211fe56)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:59.532042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:59.533925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:59.534489 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:59.559514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d35f7-7c0d-4fe0-865f-1fa28d2cef56 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:58:59.567918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:58:59.569874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:58:59.570690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:58:59.573347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] PATH_INFO: `/v3/users/e384b89f1a05424b8bf8f69d5f26e282` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:58:59.575342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e384b89f1a05424b8bf8f69d5f26e282)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:58:59.577365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:58:59.713336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e0232fed30433b9d4e90304211fe56'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.727862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e0232fed30433b9d4e90304211fe56'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.735483 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e0232fed30433b9d4e90304211fe56'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.783830 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e384b89f1a05424b8bf8f69d5f26e282'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.796170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e384b89f1a05424b8bf8f69d5f26e282'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.803564 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e384b89f1a05424b8bf8f69d5f26e282'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.855896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e0232fed30433b9d4e90304211fe56'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.856717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e0232fed30433b9d4e90304211fe56'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.863838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1037/2053] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:59 2022] DELETE /identity/v3/users/02e0232fed30433b9d4e90304211fe56 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:59.864788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:59.866846 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:59.917450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e384b89f1a05424b8bf8f69d5f26e282'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.918154 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e384b89f1a05424b8bf8f69d5f26e282'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:58:59.925610 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1017/2054] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:58:59 2022] DELETE /identity/v3/users/e384b89f1a05424b8bf8f69d5f26e282 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:58:59.926623 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:58:59.928778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:58:59.941804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1ec78-a5a4-4a65-9c5e-657b465566ca admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:00.013156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0db98-e13d-4da9-94af-04d9d9c13f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:00.014062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0db98-e13d-4da9-94af-04d9d9c13f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:00.014335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0db98-e13d-4da9-94af-04d9d9c13f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:00.014592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0db98-e13d-4da9-94af-04d9d9c13f64 admin admin] PATH_INFO: `/v3/projects/61b7362c35c349308550f613cf8fcc39` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:00.015828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0db98-e13d-4da9-94af-04d9d9c13f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b7362c35c349308550f613cf8fcc39)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:00.018112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0db98-e13d-4da9-94af-04d9d9c13f64 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:00.027736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eccac-4099-4382-823c-1828e1e92a00 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:00.034104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:00.035171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:00.035621 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:00.036066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed admin admin] PATH_INFO: `/v3/projects/248fe82f3d9c467d8891a6749765304a` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:00.038864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=248fe82f3d9c467d8891a6749765304a)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:00.041462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:00.183320 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248fe82f3d9c467d8891a6749765304a', 'request_id': 'req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.184697 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-eab0db98-e13d-4da9-94af-04d9d9c13f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b7362c35c349308550f613cf8fcc39', 'request_id': 'req-eab0db98-e13d-4da9-94af-04d9d9c13f64'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.190884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248fe82f3d9c467d8891a6749765304a', 'request_id': 'req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.199414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-eab0db98-e13d-4da9-94af-04d9d9c13f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b7362c35c349308550f613cf8fcc39', 'request_id': 'req-eab0db98-e13d-4da9-94af-04d9d9c13f64'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.214665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-eab0db98-e13d-4da9-94af-04d9d9c13f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b7362c35c349308550f613cf8fcc39', 'request_id': 'req-eab0db98-e13d-4da9-94af-04d9d9c13f64'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.331360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248fe82f3d9c467d8891a6749765304a', 'request_id': 'req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.347916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed admin admin] The token cache is being invalidate because project 248fe82f3d9c467d8891a6749765304a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:00.348410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.349352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9333e550-2a42-4adf-8510-2c1ca1b3a3ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.352316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1018/2055] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:59 2022] DELETE /identity/v3/projects/248fe82f3d9c467d8891a6749765304a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:00.354198 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2137-cad9-4a6c-9add-5a8083ca72fe None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:00.354506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2137-cad9-4a6c-9add-5a8083ca72fe None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:00.354952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2137-cad9-4a6c-9add-5a8083ca72fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:00.379546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-529a2137-cad9-4a6c-9add-5a8083ca72fe None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:00.381454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-529a2137-cad9-4a6c-9add-5a8083ca72fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:00.477488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-eab0db98-e13d-4da9-94af-04d9d9c13f64 admin admin] The token cache is being invalidate because project 61b7362c35c349308550f613cf8fcc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:00.479134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-eab0db98-e13d-4da9-94af-04d9d9c13f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.480881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-eab0db98-e13d-4da9-94af-04d9d9c13f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.482510 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1019/2056] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:00.496311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1038/2057] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:58:59 2022] DELETE /identity/v3/projects/61b7362c35c349308550f613cf8fcc39 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:00.500227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a2137-cad9-4a6c-9add-5a8083ca72fe None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:00.502366 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-529a2137-cad9-4a6c-9add-5a8083ca72fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:00.504782 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1377fc8-9370-4bbe-a011-a90f2ffcd3cc None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:00.505400 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1377fc8-9370-4bbe-a011-a90f2ffcd3cc None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:00.506684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1377fc8-9370-4bbe-a011-a90f2ffcd3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:00.548294 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b1377fc8-9370-4bbe-a011-a90f2ffcd3cc None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:00.551278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b1377fc8-9370-4bbe-a011-a90f2ffcd3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:00.571568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1039/2058] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:00.573439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cb7ea-5f6e-45e8-b57e-40335a35dd1f None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:00.573739 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cb7ea-5f6e-45e8-b57e-40335a35dd1f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:00.574264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cb7ea-5f6e-45e8-b57e-40335a35dd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:00.593802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a2137-cad9-4a6c-9add-5a8083ca72fe None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:00.594112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-774cb7ea-5f6e-45e8-b57e-40335a35dd1f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:00.595337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-774cb7ea-5f6e-45e8-b57e-40335a35dd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:00.597577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ac47c-28a4-4092-8a0b-a145c090e1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:00.598257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ac47c-28a4-4092-8a0b-a145c090e1df service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:00.598545 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ac47c-28a4-4092-8a0b-a145c090e1df service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:00.598838 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ac47c-28a4-4092-8a0b-a145c090e1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:00.601327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-792ac47c-28a4-4092-8a0b-a145c090e1df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:00.604634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1040/2059] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:00.608845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cb7ea-5f6e-45e8-b57e-40335a35dd1f None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:00.615757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ac47c-28a4-4092-8a0b-a145c090e1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:00.617595 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ac47c-28a4-4092-8a0b-a145c090e1df service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:00.624610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cb7ea-5f6e-45e8-b57e-40335a35dd1f None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:00.629762 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1020/2060] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:00.633469 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c212d-b48b-47f0-adb4-0490da7dafe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:00.634649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c212d-b48b-47f0-adb4-0490da7dafe5 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:00.635169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c212d-b48b-47f0-adb4-0490da7dafe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:00.635689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c212d-b48b-47f0-adb4-0490da7dafe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:00.637352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c212d-b48b-47f0-adb4-0490da7dafe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:59:00.637916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c212d-b48b-47f0-adb4-0490da7dafe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:00.642960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c212d-b48b-47f0-adb4-0490da7dafe5 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:00.655109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ac47c-28a4-4092-8a0b-a145c090e1df service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:00.656769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-792ac47c-28a4-4092-8a0b-a145c090e1df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:00.658807 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:00.672664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1041/2061] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:59:00.678073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c212d-b48b-47f0-adb4-0490da7dafe5 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:00.696113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ac47c-28a4-4092-8a0b-a145c090e1df service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:00.707329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c212d-b48b-47f0-adb4-0490da7dafe5 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:00.717793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6986a-c4f8-4393-a9bf-edef8b763963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:00.717793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6986a-c4f8-4393-a9bf-edef8b763963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:00.717793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6986a-c4f8-4393-a9bf-edef8b763963 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:00.717793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6986a-c4f8-4393-a9bf-edef8b763963 admin admin] PATH_INFO: `/v3/projects/afb1f457c20d45aab8490acb9e494f44` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:00.718088 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6986a-c4f8-4393-a9bf-edef8b763963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb1f457c20d45aab8490acb9e494f44)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:00.718884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6986a-c4f8-4393-a9bf-edef8b763963 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:00.720320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ae026-cf6b-4556-bebc-0aa41d6ed714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:00.721053 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ae026-cf6b-4556-bebc-0aa41d6ed714 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:00.721340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ae026-cf6b-4556-bebc-0aa41d6ed714 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:00.721620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ae026-cf6b-4556-bebc-0aa41d6ed714 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:00.723078 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ae026-cf6b-4556-bebc-0aa41d6ed714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:00.725868 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ae026-cf6b-4556-bebc-0aa41d6ed714 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:00.861528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1042/2062] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:00 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:00.865837 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ae026-cf6b-4556-bebc-0aa41d6ed714 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:00.877647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c3b6986a-c4f8-4393-a9bf-edef8b763963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb1f457c20d45aab8490acb9e494f44', 'request_id': 'req-c3b6986a-c4f8-4393-a9bf-edef8b763963'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.885801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c3b6986a-c4f8-4393-a9bf-edef8b763963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb1f457c20d45aab8490acb9e494f44', 'request_id': 'req-c3b6986a-c4f8-4393-a9bf-edef8b763963'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.966028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ae026-cf6b-4556-bebc-0aa41d6ed714 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:00.971094 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c25feb-be5b-4b56-89a3-3c472d2f89c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:00.971784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c25feb-be5b-4b56-89a3-3c472d2f89c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:00.972061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c25feb-be5b-4b56-89a3-3c472d2f89c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:00.972337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c25feb-be5b-4b56-89a3-3c472d2f89c4 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:00.973077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c25feb-be5b-4b56-89a3-3c472d2f89c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:00.973376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:00.974876 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c3b6986a-c4f8-4393-a9bf-edef8b763963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb1f457c20d45aab8490acb9e494f44', 'request_id': 'req-c3b6986a-c4f8-4393-a9bf-edef8b763963'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:00.975529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c25feb-be5b-4b56-89a3-3c472d2f89c4 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:01.007682 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c3b6986a-c4f8-4393-a9bf-edef8b763963 admin admin] The token cache is being invalidate because project afb1f457c20d45aab8490acb9e494f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:01.007991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c3b6986a-c4f8-4393-a9bf-edef8b763963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:01.008834 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c3b6986a-c4f8-4393-a9bf-edef8b763963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:01.011629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1021/2063] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:00 2022] DELETE /identity/v3/projects/afb1f457c20d45aab8490acb9e494f44 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:01.019883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ce44-771a-43c3-9242-b6a56d912a9c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:01.020405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ce44-771a-43c3-9242-b6a56d912a9c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:01.021101 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747ce44-771a-43c3-9242-b6a56d912a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:01.058253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-6747ce44-771a-43c3-9242-b6a56d912a9c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:01.060687 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6747ce44-771a-43c3-9242-b6a56d912a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:01.084335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1022/2064] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:01.091812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dd729-ad9f-469f-b57b-c575ac2d375d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:01.092151 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dd729-ad9f-469f-b57b-c575ac2d375d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:01.092839 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dd729-ad9f-469f-b57b-c575ac2d375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:01.117879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-960dd729-ad9f-469f-b57b-c575ac2d375d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:01.122122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1043/2065] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:00 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:01.122939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-960dd729-ad9f-469f-b57b-c575ac2d375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:01.124552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c25feb-be5b-4b56-89a3-3c472d2f89c4 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:01.126076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f0c25feb-be5b-4b56-89a3-3c472d2f89c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:01.132338 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1023/2066] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:01.136531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dd729-ad9f-469f-b57b-c575ac2d375d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:01.147465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dd729-ad9f-469f-b57b-c575ac2d375d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:01.152142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c25feb-be5b-4b56-89a3-3c472d2f89c4 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:01.152616 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc622ac-eb87-415a-a7ce-feced2a353f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:01.153306 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc622ac-eb87-415a-a7ce-feced2a353f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:01.153586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc622ac-eb87-415a-a7ce-feced2a353f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:01.153862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc622ac-eb87-415a-a7ce-feced2a353f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:01.154607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc622ac-eb87-415a-a7ce-feced2a353f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:59:01.154937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc622ac-eb87-415a-a7ce-feced2a353f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:01.156659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc622ac-eb87-415a-a7ce-feced2a353f7 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:01.164289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0046e5d-8857-4570-bbdb-57c111c93401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:01.165838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0046e5d-8857-4570-bbdb-57c111c93401 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:01.166350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0046e5d-8857-4570-bbdb-57c111c93401 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:01.166930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0046e5d-8857-4570-bbdb-57c111c93401 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:01.175981 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0046e5d-8857-4570-bbdb-57c111c93401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:01.176138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1024/2067] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:59:01.176233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0046e5d-8857-4570-bbdb-57c111c93401 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:01.176985 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc622ac-eb87-415a-a7ce-feced2a353f7 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:01.188440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc622ac-eb87-415a-a7ce-feced2a353f7 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:01.192662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1044/2068] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:59:01.195189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56551e94-5307-4d9e-99e8-635d8609fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:01.195189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56551e94-5307-4d9e-99e8-635d8609fcdb admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:01.195526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56551e94-5307-4d9e-99e8-635d8609fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:01.195526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56551e94-5307-4d9e-99e8-635d8609fcdb admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:01.196233 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56551e94-5307-4d9e-99e8-635d8609fcdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:01.198214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56551e94-5307-4d9e-99e8-635d8609fcdb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:01.198786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0046e5d-8857-4570-bbdb-57c111c93401 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:01.215355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0046e5d-8857-4570-bbdb-57c111c93401 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:01.221510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f0dce-d41f-45d0-8818-693fcf4ba399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:01.224631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f0dce-d41f-45d0-8818-693fcf4ba399 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:01.224631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f0dce-d41f-45d0-8818-693fcf4ba399 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:01.224631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f0dce-d41f-45d0-8818-693fcf4ba399 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:01.224631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f0dce-d41f-45d0-8818-693fcf4ba399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:01.225420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f0dce-d41f-45d0-8818-693fcf4ba399 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:01.237693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1045/2069] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:59:01.242596 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f0dce-d41f-45d0-8818-693fcf4ba399 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:01.253615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f0dce-d41f-45d0-8818-693fcf4ba399 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:01.259386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1197c0-39ee-4d25-8dfa-6750a7ed4c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:01.260294 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1197c0-39ee-4d25-8dfa-6750a7ed4c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:01.260836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1197c0-39ee-4d25-8dfa-6750a7ed4c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:01.261126 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1197c0-39ee-4d25-8dfa-6750a7ed4c65 admin admin] PATH_INFO: `/v3/projects/757021b9a86a4f1f83d2ea277f92bcb8/users/cf6703e385c2404796d6e485aae3371c/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:01.278460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1197c0-39ee-4d25-8dfa-6750a7ed4c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=757021b9a86a4f1f83d2ea277f92bcb8, user_id=cf6703e385c2404796d6e485aae3371c, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:01.281442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1197c0-39ee-4d25-8dfa-6750a7ed4c65 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:01.420113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1025/2070] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:01 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:01.425116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56551e94-5307-4d9e-99e8-635d8609fcdb admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:01.449164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1046/2071] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:01 2022] PUT /identity/v3/projects/757021b9a86a4f1f83d2ea277f92bcb8/users/cf6703e385c2404796d6e485aae3371c/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:01.454819 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1197c0-39ee-4d25-8dfa-6750a7ed4c65 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:01.457975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ea1197c0-39ee-4d25-8dfa-6750a7ed4c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:01.533111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56551e94-5307-4d9e-99e8-635d8609fcdb admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:01.561603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1197c0-39ee-4d25-8dfa-6750a7ed4c65 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:01.568734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:01.569907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:01.570347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:01.570731 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] PATH_INFO: `/v3/projects/cacd35525d534a01976ff51836fcb4e8` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:01.572535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cacd35525d534a01976ff51836fcb4e8)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:01.574844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:01.607921 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff32a29-6fd2-4057-8ed5-a9a8c0019e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:01.609218 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff32a29-6fd2-4057-8ed5-a9a8c0019e91 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:01.609749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff32a29-6fd2-4057-8ed5-a9a8c0019e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:01.610292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff32a29-6fd2-4057-8ed5-a9a8c0019e91 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:01.611593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff32a29-6fd2-4057-8ed5-a9a8c0019e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:01.614954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff32a29-6fd2-4057-8ed5-a9a8c0019e91 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:01.727259 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cacd35525d534a01976ff51836fcb4e8', 'request_id': 'req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:01.734654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cacd35525d534a01976ff51836fcb4e8', 'request_id': 'req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:01.737329 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1026/2072] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:01 2022] POST /identity/v3/users => generated 292 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:01.738876 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20734474-ef0b-4fdc-85be-fa3b22787a3c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:01.739167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20734474-ef0b-4fdc-85be-fa3b22787a3c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:01.741139 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20734474-ef0b-4fdc-85be-fa3b22787a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:01.742830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cacd35525d534a01976ff51836fcb4e8', 'request_id': 'req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:01.769938 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-20734474-ef0b-4fdc-85be-fa3b22787a3c None None] MFA Rules not processed for user `cf6703e385c2404796d6e485aae3371c`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:01.771242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-20734474-ef0b-4fdc-85be-fa3b22787a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:01.846995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1027/2073] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:01.847931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20734474-ef0b-4fdc-85be-fa3b22787a3c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:01.923227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20734474-ef0b-4fdc-85be-fa3b22787a3c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:01.926639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] The token cache is being invalidate because project cacd35525d534a01976ff51836fcb4e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:01.927349 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:01.929262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:01.932427 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1047/2074] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:01 2022] DELETE /identity/v3/projects/cacd35525d534a01976ff51836fcb4e8 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:01.932869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325f242-c37a-451b-bbd4-f9abe2be7058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:01.933751 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325f242-c37a-451b-bbd4-f9abe2be7058 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:01.934169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325f242-c37a-451b-bbd4-f9abe2be7058 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:01.934579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325f242-c37a-451b-bbd4-f9abe2be7058 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:01.934825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:01.935693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325f242-c37a-451b-bbd4-f9abe2be7058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:01.937560 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325f242-c37a-451b-bbd4-f9abe2be7058 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:01.937682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:01.948933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1028/2075] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:01.949813 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325f242-c37a-451b-bbd4-f9abe2be7058 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:01.951578 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2325f242-c37a-451b-bbd4-f9abe2be7058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:01.965625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325f242-c37a-451b-bbd4-f9abe2be7058 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:01.981709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:01.982961 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:01.983477 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:01.983980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] PATH_INFO: `/v3/users/18c1b09ffb6c4272811c36ac61e7476d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:01.985633 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c1b09ffb6c4272811c36ac61e7476d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:01.988616 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:02.050923 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4a330-3948-4606-bbfe-7f3f1ba80db9 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:02.057979 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6860c-d801-48ad-b0e4-3bfd533f23e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:02.058713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6860c-d801-48ad-b0e4-3bfd533f23e8 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:02.058995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6860c-d801-48ad-b0e4-3bfd533f23e8 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:02.059270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6860c-d801-48ad-b0e4-3bfd533f23e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:02.061305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c9d6860c-d801-48ad-b0e4-3bfd533f23e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:02.073349 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6860c-d801-48ad-b0e4-3bfd533f23e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:02.075710 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6860c-d801-48ad-b0e4-3bfd533f23e8 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:02.092165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1048/2076] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:02.103296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6860c-d801-48ad-b0e4-3bfd533f23e8 service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:02.109624 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c9d6860c-d801-48ad-b0e4-3bfd533f23e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:02.126778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6860c-d801-48ad-b0e4-3bfd533f23e8 service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:02.133485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451d7d1-f54c-4ee6-b01a-afe5b52c7029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:02.137634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d7d1-f54c-4ee6-b01a-afe5b52c7029 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:02.137634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d7d1-f54c-4ee6-b01a-afe5b52c7029 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:02.137634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451d7d1-f54c-4ee6-b01a-afe5b52c7029 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:02.137634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451d7d1-f54c-4ee6-b01a-afe5b52c7029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:02.137634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451d7d1-f54c-4ee6-b01a-afe5b52c7029 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:02.149989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1049/2077] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:02.154976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451d7d1-f54c-4ee6-b01a-afe5b52c7029 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:02.172243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451d7d1-f54c-4ee6-b01a-afe5b52c7029 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:02.186828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486f236-79cc-4558-afe6-f150811ce308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:02.186828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486f236-79cc-4558-afe6-f150811ce308 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:02.186828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486f236-79cc-4558-afe6-f150811ce308 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:02.186828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486f236-79cc-4558-afe6-f150811ce308 admin admin] PATH_INFO: `/v3/projects/bb37335a4cd74085a131aa720fc7e798/users/2686073c98594394974a3551e1f363d0/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:02.217160 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486f236-79cc-4558-afe6-f150811ce308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb37335a4cd74085a131aa720fc7e798, user_id=2686073c98594394974a3551e1f363d0, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:02.219735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486f236-79cc-4558-afe6-f150811ce308 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:02.319134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c1b09ffb6c4272811c36ac61e7476d'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:02.340053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c1b09ffb6c4272811c36ac61e7476d'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:02.353761 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c1b09ffb6c4272811c36ac61e7476d'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:02.364614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:02.375734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1050/2078] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:02 2022] PUT /identity/v3/projects/bb37335a4cd74085a131aa720fc7e798/users/2686073c98594394974a3551e1f363d0/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:02.388287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f64949-f483-47ff-b6bd-8a160927404e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:02.388711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f64949-f483-47ff-b6bd-8a160927404e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:02.388991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f64949-f483-47ff-b6bd-8a160927404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:02.425663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-d7f64949-f483-47ff-b6bd-8a160927404e None None] MFA Rules not processed for user `2686073c98594394974a3551e1f363d0`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:02.426983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d7f64949-f483-47ff-b6bd-8a160927404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:02.433098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c1b09ffb6c4272811c36ac61e7476d'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:02.434304 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c1b09ffb6c4272811c36ac61e7476d'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:02.446619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1029/2079] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:01 2022] DELETE /identity/v3/users/18c1b09ffb6c4272811c36ac61e7476d => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:02.448136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:02.450487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:02.544787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1051/2080] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:02.549269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f64949-f483-47ff-b6bd-8a160927404e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:02.551389 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d7f64949-f483-47ff-b6bd-8a160927404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:02.552150 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd550e-8e27-45a7-85b4-3cec4efd5b9c admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:02.560384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:02.561348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:02.561798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:02.562080 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] PATH_INFO: `/v3/users/cf6703e385c2404796d6e485aae3371c` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:02.565051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6703e385c2404796d6e485aae3371c)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:02.567050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:02.666537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f64949-f483-47ff-b6bd-8a160927404e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:02.674123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76233938-ceff-48b6-93a1-b843034d77e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:02.674819 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76233938-ceff-48b6-93a1-b843034d77e9 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:02.675105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76233938-ceff-48b6-93a1-b843034d77e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:02.675382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76233938-ceff-48b6-93a1-b843034d77e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:02.676095 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76233938-ceff-48b6-93a1-b843034d77e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:02.678662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76233938-ceff-48b6-93a1-b843034d77e9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:02.832672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1052/2081] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:02 2022] POST /identity/v3/projects => generated 383 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:02.834532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76233938-ceff-48b6-93a1-b843034d77e9 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:02.868240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:02.892707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6703e385c2404796d6e485aae3371c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:02.921158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6703e385c2404796d6e485aae3371c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:02.924267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76233938-ceff-48b6-93a1-b843034d77e9 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:02.932744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1849a-12e9-48d8-be47-728b6163fa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:02.934114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1849a-12e9-48d8-be47-728b6163fa19 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:02.934502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6703e385c2404796d6e485aae3371c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:02.934636 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1849a-12e9-48d8-be47-728b6163fa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:02.934984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1849a-12e9-48d8-be47-728b6163fa19 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:02.936186 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1849a-12e9-48d8-be47-728b6163fa19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:02.940404 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1849a-12e9-48d8-be47-728b6163fa19 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:03.072848 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6703e385c2404796d6e485aae3371c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:03.073584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6703e385c2404796d6e485aae3371c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:03.083444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1030/2082] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:02 2022] DELETE /identity/v3/users/cf6703e385c2404796d6e485aae3371c => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:03.084388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1053/2083] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:02 2022] POST /identity/v3/users => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:03.084623 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:03.087660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1849a-12e9-48d8-be47-728b6163fa19 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:03.089667 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:03.092666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9cd1849a-12e9-48d8-be47-728b6163fa19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:03.114496 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1849a-12e9-48d8-be47-728b6163fa19 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:03.191710 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd634b5a-73e8-4623-9f97-016d78641667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:03.192409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd634b5a-73e8-4623-9f97-016d78641667 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:03.192726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd634b5a-73e8-4623-9f97-016d78641667 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:03.193007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd634b5a-73e8-4623-9f97-016d78641667 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:03.194433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd634b5a-73e8-4623-9f97-016d78641667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:03.196106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd634b5a-73e8-4623-9f97-016d78641667 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:03.197896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deeb2f-cdd8-49e0-9484-70a288178251 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:03.207429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:03.208412 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:03.209760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:03.210748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1054/2084] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:59:03.212221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c31ce-63a4-4522-94c8-ac38dae51af0 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:03.212531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c31ce-63a4-4522-94c8-ac38dae51af0 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:03.212817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c31ce-63a4-4522-94c8-ac38dae51af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:03.216516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] PATH_INFO: `/v3/projects/0033cf80de6a46ddb46668fd347dc43b` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:03.218769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0033cf80de6a46ddb46668fd347dc43b)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:03.226060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:03.235121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f08c31ce-63a4-4522-94c8-ac38dae51af0 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:03.236550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f08c31ce-63a4-4522-94c8-ac38dae51af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:03.245870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1055/2085] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:03.247185 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c31ce-63a4-4522-94c8-ac38dae51af0 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:03.260772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c31ce-63a4-4522-94c8-ac38dae51af0 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:03.267469 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e8855-8513-4de3-ad61-cd705ab02f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:03.268396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e8855-8513-4de3-ad61-cd705ab02f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:03.268719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e8855-8513-4de3-ad61-cd705ab02f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:03.268988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e8855-8513-4de3-ad61-cd705ab02f1a admin admin] PATH_INFO: `/v3/projects/714bcb270dae4da088d2b0ce544ff04f/users/54c59ae1ccf7471d8fa5a04bab8b156f/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:03.296219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e8855-8513-4de3-ad61-cd705ab02f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=714bcb270dae4da088d2b0ce544ff04f, user_id=54c59ae1ccf7471d8fa5a04bab8b156f, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:03.299255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e8855-8513-4de3-ad61-cd705ab02f1a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:03.479313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1056/2086] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:03 2022] PUT /identity/v3/projects/714bcb270dae4da088d2b0ce544ff04f/users/54c59ae1ccf7471d8fa5a04bab8b156f/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:03.480246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e8855-8513-4de3-ad61-cd705ab02f1a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:03.483045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e49e8855-8513-4de3-ad61-cd705ab02f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:03.495293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0033cf80de6a46ddb46668fd347dc43b', 'request_id': 'req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:03.504877 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0033cf80de6a46ddb46668fd347dc43b', 'request_id': 'req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:03.550659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e8855-8513-4de3-ad61-cd705ab02f1a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:03.592541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0033cf80de6a46ddb46668fd347dc43b', 'request_id': 'req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:03.608735 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] The token cache is being invalidate because project 0033cf80de6a46ddb46668fd347dc43b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:03.609295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:03.610133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:03.611806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1031/2087] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:03 2022] DELETE /identity/v3/projects/0033cf80de6a46ddb46668fd347dc43b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:03.612663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:03.618064 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6411f-a8f4-45dc-b871-42a5d4e41b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:03.622034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:03.622174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6411f-a8f4-45dc-b871-42a5d4e41b9c service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:03.622174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6411f-a8f4-45dc-b871-42a5d4e41b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:03.622174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6411f-a8f4-45dc-b871-42a5d4e41b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:03.622174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-abe6411f-a8f4-45dc-b871-42a5d4e41b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:03.702906 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9c6cd-cfc5-4f38-b687-7b6bcf243090 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:03.711859 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7d3b4-4b10-4a05-b95b-e0be79bc30bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:03.713565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7d3b4-4b10-4a05-b95b-e0be79bc30bd admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:03.713940 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7d3b4-4b10-4a05-b95b-e0be79bc30bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:03.714285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7d3b4-4b10-4a05-b95b-e0be79bc30bd admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:03.715312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7d3b4-4b10-4a05-b95b-e0be79bc30bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:03.718507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7d3b4-4b10-4a05-b95b-e0be79bc30bd admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:03.726271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6411f-a8f4-45dc-b871-42a5d4e41b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:03.728278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6411f-a8f4-45dc-b871-42a5d4e41b9c service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:03.735759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1032/2088] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:03.737352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66e70c-9f45-42b3-8bea-4bdaf8c46f4e None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:03.737794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66e70c-9f45-42b3-8bea-4bdaf8c46f4e None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:03.738211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66e70c-9f45-42b3-8bea-4bdaf8c46f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:03.747362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1057/2089] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:03.749098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6411f-a8f4-45dc-b871-42a5d4e41b9c service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:03.764576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6411f-a8f4-45dc-b871-42a5d4e41b9c service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:03.764835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-dd66e70c-9f45-42b3-8bea-4bdaf8c46f4e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:03.766222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-dd66e70c-9f45-42b3-8bea-4bdaf8c46f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:03.782143 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1033/2090] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:03.782347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107cf9e-6be5-4392-b572-5619823c10af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:03.782347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107cf9e-6be5-4392-b572-5619823c10af admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:03.782347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107cf9e-6be5-4392-b572-5619823c10af admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:03.782347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107cf9e-6be5-4392-b572-5619823c10af admin admin] PATH_INFO: `/v3/projects/714bcb270dae4da088d2b0ce544ff04f/users/54c59ae1ccf7471d8fa5a04bab8b156f/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:03.783028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107cf9e-6be5-4392-b572-5619823c10af admin admin] RBAC: Authorizing `identity:create_grant(project_id=714bcb270dae4da088d2b0ce544ff04f, user_id=54c59ae1ccf7471d8fa5a04bab8b156f, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:03.785156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fe8c3-0708-4853-a393-b410a8ecc246 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:03.785635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fe8c3-0708-4853-a393-b410a8ecc246 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:03.785931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fe8c3-0708-4853-a393-b410a8ecc246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:03.789187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107cf9e-6be5-4392-b572-5619823c10af admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:03.808197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1058/2091] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:03 2022] PUT /identity/v3/projects/714bcb270dae4da088d2b0ce544ff04f/users/54c59ae1ccf7471d8fa5a04bab8b156f/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:03.809422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-b23fe8c3-0708-4853-a393-b410a8ecc246 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:03.810668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b23fe8c3-0708-4853-a393-b410a8ecc246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:03.820527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08424960-68b0-4a38-b91f-b0417a263eee None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:03.825892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08424960-68b0-4a38-b91f-b0417a263eee None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:03.825892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08424960-68b0-4a38-b91f-b0417a263eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:03.853775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-08424960-68b0-4a38-b91f-b0417a263eee None None] MFA Rules not processed for user `54c59ae1ccf7471d8fa5a04bab8b156f`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:03.854882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-08424960-68b0-4a38-b91f-b0417a263eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:03.881666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1034/2092] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:03.886319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fe8c3-0708-4853-a393-b410a8ecc246 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:03.897362 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fe8c3-0708-4853-a393-b410a8ecc246 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:03.903207 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700fc01-5b31-44a5-97e4-03a11b7abe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:03.903879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700fc01-5b31-44a5-97e4-03a11b7abe91 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:03.904158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700fc01-5b31-44a5-97e4-03a11b7abe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:03.904429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700fc01-5b31-44a5-97e4-03a11b7abe91 admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:03.905206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700fc01-5b31-44a5-97e4-03a11b7abe91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:59:03.905594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700fc01-5b31-44a5-97e4-03a11b7abe91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:03.907329 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700fc01-5b31-44a5-97e4-03a11b7abe91 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:03.923869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1035/2093] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:59:03.933943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700fc01-5b31-44a5-97e4-03a11b7abe91 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:03.949136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700fc01-5b31-44a5-97e4-03a11b7abe91 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:03.953659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1059/2094] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:03.962656 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73359319-02af-40ac-a7da-a03625b69c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:03.965064 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359319-02af-40ac-a7da-a03625b69c65 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:03.965064 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359319-02af-40ac-a7da-a03625b69c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:03.965064 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359319-02af-40ac-a7da-a03625b69c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:03.965778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73359319-02af-40ac-a7da-a03625b69c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:03.969408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73359319-02af-40ac-a7da-a03625b69c65 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:03.973431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08424960-68b0-4a38-b91f-b0417a263eee None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:03.976428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-08424960-68b0-4a38-b91f-b0417a263eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:04.079271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08424960-68b0-4a38-b91f-b0417a263eee None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:04.086539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e3bab-c1e4-4492-a896-243d5d72c92b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:04.087660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e3bab-c1e4-4492-a896-243d5d72c92b service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:04.088159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e3bab-c1e4-4492-a896-243d5d72c92b service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:04.088694 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e3bab-c1e4-4492-a896-243d5d72c92b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:04.108211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e3bab-c1e4-4492-a896-243d5d72c92b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:04.110136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e3bab-c1e4-4492-a896-243d5d72c92b service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:04.122337 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1036/2095] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:03 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:04.126283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73359319-02af-40ac-a7da-a03625b69c65 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:04.131037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1060/2096] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:04.213897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73359319-02af-40ac-a7da-a03625b69c65 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:04.219759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a8b1d-b71f-423d-a7ae-2ac8ef479089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:04.220671 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a8b1d-b71f-423d-a7ae-2ac8ef479089 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:04.221106 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a8b1d-b71f-423d-a7ae-2ac8ef479089 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:04.221468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a8b1d-b71f-423d-a7ae-2ac8ef479089 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:04.222648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a8b1d-b71f-423d-a7ae-2ac8ef479089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:04.226939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a8b1d-b71f-423d-a7ae-2ac8ef479089 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:04.440736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e3bab-c1e4-4492-a896-243d5d72c92b service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:04.442946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-100e3bab-c1e4-4492-a896-243d5d72c92b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:04.447147 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1037/2097] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:04 2022] POST /identity/v3/users => generated 287 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:04.452756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a8b1d-b71f-423d-a7ae-2ac8ef479089 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:04.468698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a8b1d-b71f-423d-a7ae-2ac8ef479089 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:04.476175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e3bab-c1e4-4492-a896-243d5d72c92b service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:04.481786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac22f70-b85e-4696-a58a-2eb204523144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:04.482591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac22f70-b85e-4696-a58a-2eb204523144 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:04.492187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac22f70-b85e-4696-a58a-2eb204523144 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:04.492187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac22f70-b85e-4696-a58a-2eb204523144 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:04.492187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac22f70-b85e-4696-a58a-2eb204523144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:04.492187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac22f70-b85e-4696-a58a-2eb204523144 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:04.492967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:04.492967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:04.492967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:04.493369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89 admin admin] PATH_INFO: `/v3/projects/757021b9a86a4f1f83d2ea277f92bcb8` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:04.495195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=757021b9a86a4f1f83d2ea277f92bcb8)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:04.497189 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:04.501579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1038/2098] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:59:04.502852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac22f70-b85e-4696-a58a-2eb204523144 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:04.578570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac22f70-b85e-4696-a58a-2eb204523144 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:04.584558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafab3d3-581c-4dbb-ac54-6de944a79507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:04.585344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafab3d3-581c-4dbb-ac54-6de944a79507 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:04.585617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafab3d3-581c-4dbb-ac54-6de944a79507 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:04.585889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafab3d3-581c-4dbb-ac54-6de944a79507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:04.588116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-fafab3d3-581c-4dbb-ac54-6de944a79507 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:04.654867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafab3d3-581c-4dbb-ac54-6de944a79507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:04.656310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafab3d3-581c-4dbb-ac54-6de944a79507 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:04.666486 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1039/2099] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:04.667347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafab3d3-581c-4dbb-ac54-6de944a79507 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:04.681986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafab3d3-581c-4dbb-ac54-6de944a79507 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:04.692348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '757021b9a86a4f1f83d2ea277f92bcb8', 'request_id': 'req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:04.702910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '757021b9a86a4f1f83d2ea277f92bcb8', 'request_id': 'req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:04.707322 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:04.717178 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '757021b9a86a4f1f83d2ea277f92bcb8', 'request_id': 'req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:04.758122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262be367-b5c0-4c89-946a-239f078db486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:04.758985 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262be367-b5c0-4c89-946a-239f078db486 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:04.759252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262be367-b5c0-4c89-946a-239f078db486 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:04.760030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262be367-b5c0-4c89-946a-239f078db486 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:04.760348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262be367-b5c0-4c89-946a-239f078db486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:04.762270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262be367-b5c0-4c89-946a-239f078db486 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:04.774540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1040/2100] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:04.780375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262be367-b5c0-4c89-946a-239f078db486 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:04.792021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262be367-b5c0-4c89-946a-239f078db486 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:04.803285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d7f80-a1f0-48bc-b809-1d0ddc9d93da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:04.804851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d7f80-a1f0-48bc-b809-1d0ddc9d93da admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:04.805250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d7f80-a1f0-48bc-b809-1d0ddc9d93da admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:04.805612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d7f80-a1f0-48bc-b809-1d0ddc9d93da admin admin] PATH_INFO: `/v3/projects/61aa95d0c4c4424c8abebd31cdbf73b9/users/c6362ec1a7544263a63bcbf415083400/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:04.824052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d7f80-a1f0-48bc-b809-1d0ddc9d93da admin admin] RBAC: Authorizing `identity:create_grant(project_id=61aa95d0c4c4424c8abebd31cdbf73b9, user_id=c6362ec1a7544263a63bcbf415083400, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:04.826827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d7f80-a1f0-48bc-b809-1d0ddc9d93da admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:04.850119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89 admin admin] The token cache is being invalidate because project 757021b9a86a4f1f83d2ea277f92bcb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:04.850702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:04.851839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bbcfff19-ccd1-4e8e-94e7-ee5e90b60e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:04.854804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1061/2101] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:04 2022] DELETE /identity/v3/projects/757021b9a86a4f1f83d2ea277f92bcb8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:04.861535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090f452-a73c-459c-ba66-4dede1756ff4 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:04.864155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090f452-a73c-459c-ba66-4dede1756ff4 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:04.864155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090f452-a73c-459c-ba66-4dede1756ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:04.884685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e090f452-a73c-459c-ba66-4dede1756ff4 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:04.885919 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e090f452-a73c-459c-ba66-4dede1756ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:04.894477 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1062/2102] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:04.903021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496217e-d37a-4208-8e1b-47621d0f7981 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:04.910184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496217e-d37a-4208-8e1b-47621d0f7981 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:04.910184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496217e-d37a-4208-8e1b-47621d0f7981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:04.933199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-2496217e-d37a-4208-8e1b-47621d0f7981 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:04.934690 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2496217e-d37a-4208-8e1b-47621d0f7981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:04.941942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1041/2103] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:04 2022] PUT /identity/v3/projects/61aa95d0c4c4424c8abebd31cdbf73b9/users/c6362ec1a7544263a63bcbf415083400/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:04.955956 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74e93-1df3-4ecf-b1cf-773772c9afe9 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:04.956446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74e93-1df3-4ecf-b1cf-773772c9afe9 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:04.957602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74e93-1df3-4ecf-b1cf-773772c9afe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:04.991047 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-b8e74e93-1df3-4ecf-b1cf-773772c9afe9 None None] MFA Rules not processed for user `c6362ec1a7544263a63bcbf415083400`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:04.992288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b8e74e93-1df3-4ecf-b1cf-773772c9afe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:05.027413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1063/2104] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:05.028634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496217e-d37a-4208-8e1b-47621d0f7981 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:05.039043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496217e-d37a-4208-8e1b-47621d0f7981 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:05.044583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1145097-72fa-4287-b355-b228d6f18711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:05.045303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1145097-72fa-4287-b355-b228d6f18711 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:05.045980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1145097-72fa-4287-b355-b228d6f18711 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:05.046272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1145097-72fa-4287-b355-b228d6f18711 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:05.047695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1145097-72fa-4287-b355-b228d6f18711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:59:05.048269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1145097-72fa-4287-b355-b228d6f18711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:05.051458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1145097-72fa-4287-b355-b228d6f18711 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:05.071892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1064/2105] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:59:05.079136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1145097-72fa-4287-b355-b228d6f18711 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:05.082651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1042/2106] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:05.089789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1145097-72fa-4287-b355-b228d6f18711 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:05.094751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc55505-f3c1-4246-9cfb-f7b72042314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:05.095440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc55505-f3c1-4246-9cfb-f7b72042314e admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:05.095753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc55505-f3c1-4246-9cfb-f7b72042314e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:05.096031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc55505-f3c1-4246-9cfb-f7b72042314e admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:05.096772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc55505-f3c1-4246-9cfb-f7b72042314e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:05.098764 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc55505-f3c1-4246-9cfb-f7b72042314e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:05.101623 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e74e93-1df3-4ecf-b1cf-773772c9afe9 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:05.103250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b8e74e93-1df3-4ecf-b1cf-773772c9afe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:05.117747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e74e93-1df3-4ecf-b1cf-773772c9afe9 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:05.125344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99b082-d7ab-4d75-8e45-656e8e3b2a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:05.126391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99b082-d7ab-4d75-8e45-656e8e3b2a74 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:05.132021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99b082-d7ab-4d75-8e45-656e8e3b2a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:05.132021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99b082-d7ab-4d75-8e45-656e8e3b2a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:05.132021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99b082-d7ab-4d75-8e45-656e8e3b2a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:05.133119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99b082-d7ab-4d75-8e45-656e8e3b2a74 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:05.192028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:05.258000 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1065/2107] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:05 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:05.262483 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc55505-f3c1-4246-9cfb-f7b72042314e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:05.328872 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc55505-f3c1-4246-9cfb-f7b72042314e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:05.334142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f310c-e85d-4314-9817-6c1b7b743e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:05.334831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f310c-e85d-4314-9817-6c1b7b743e0b admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:05.335115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f310c-e85d-4314-9817-6c1b7b743e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:05.335393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f310c-e85d-4314-9817-6c1b7b743e0b admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:05.336093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f310c-e85d-4314-9817-6c1b7b743e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:05.338072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f310c-e85d-4314-9817-6c1b7b743e0b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:05.388871 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1043/2108] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:05 2022] POST /identity/v3/projects => generated 375 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:05.393954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99b082-d7ab-4d75-8e45-656e8e3b2a74 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:05.475621 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99b082-d7ab-4d75-8e45-656e8e3b2a74 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:05.482009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af55a96-7fe1-4e1b-b7f4-1a7f6d284f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:05.482698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55a96-7fe1-4e1b-b7f4-1a7f6d284f23 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:05.482981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55a96-7fe1-4e1b-b7f4-1a7f6d284f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:05.483283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55a96-7fe1-4e1b-b7f4-1a7f6d284f23 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:05.487350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1066/2109] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:05 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:05.487885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af55a96-7fe1-4e1b-b7f4-1a7f6d284f23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:05.487988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f310c-e85d-4314-9817-6c1b7b743e0b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:05.488069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af55a96-7fe1-4e1b-b7f4-1a7f6d284f23 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:05.488158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-235f310c-e85d-4314-9817-6c1b7b743e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:05.502470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f310c-e85d-4314-9817-6c1b7b743e0b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:05.507976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:05.508930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:05.509329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:05.509606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] PATH_INFO: `/v3/users/2686073c98594394974a3551e1f363d0` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:05.510968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2686073c98594394974a3551e1f363d0)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:05.513004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:05.657191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1044/2110] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:05 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:05.660467 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af55a96-7fe1-4e1b-b7f4-1a7f6d284f23 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:05.672027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af55a96-7fe1-4e1b-b7f4-1a7f6d284f23 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:05.676863 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae502cd9-6b60-425c-8a3b-ce1638275786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:05.677770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae502cd9-6b60-425c-8a3b-ce1638275786 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:05.678058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae502cd9-6b60-425c-8a3b-ce1638275786 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:05.678596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae502cd9-6b60-425c-8a3b-ce1638275786 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:05.679102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae502cd9-6b60-425c-8a3b-ce1638275786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:05.680892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae502cd9-6b60-425c-8a3b-ce1638275786 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:05.691950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1045/2111] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:05.693349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae502cd9-6b60-425c-8a3b-ce1638275786 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:05.704084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae502cd9-6b60-425c-8a3b-ce1638275786 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:05.709784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8112db-e0d6-4af1-a4e1-1544f41488b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:05.710498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8112db-e0d6-4af1-a4e1-1544f41488b5 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:05.710795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8112db-e0d6-4af1-a4e1-1544f41488b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:05.711080 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8112db-e0d6-4af1-a4e1-1544f41488b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:05.711874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8112db-e0d6-4af1-a4e1-1544f41488b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:05.713518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8112db-e0d6-4af1-a4e1-1544f41488b5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:05.726738 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1046/2112] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:05.727713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8112db-e0d6-4af1-a4e1-1544f41488b5 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:05.738593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8112db-e0d6-4af1-a4e1-1544f41488b5 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:05.744095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19c7fe-84f2-43e9-b5a2-1c0f0ec3c2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:05.744590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19c7fe-84f2-43e9-b5a2-1c0f0ec3c2ac admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:05.744793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19c7fe-84f2-43e9-b5a2-1c0f0ec3c2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:05.745076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19c7fe-84f2-43e9-b5a2-1c0f0ec3c2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:05.745812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19c7fe-84f2-43e9-b5a2-1c0f0ec3c2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:05.747889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19c7fe-84f2-43e9-b5a2-1c0f0ec3c2ac admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:05.758331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1047/2113] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:05.759179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19c7fe-84f2-43e9-b5a2-1c0f0ec3c2ac admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:05.769537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19c7fe-84f2-43e9-b5a2-1c0f0ec3c2ac admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:05.776302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d39488-cb2b-469e-bbdc-76a6d5408939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:05.777238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d39488-cb2b-469e-bbdc-76a6d5408939 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:05.777524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d39488-cb2b-469e-bbdc-76a6d5408939 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:05.777837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d39488-cb2b-469e-bbdc-76a6d5408939 admin admin] PATH_INFO: `/v3/projects/b7bf7a5fc9d642f6a065ba13c189d751/users/8c3a4527f75a4038824c961322704157/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:05.786809 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2686073c98594394974a3551e1f363d0'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:05.798589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d39488-cb2b-469e-bbdc-76a6d5408939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7bf7a5fc9d642f6a065ba13c189d751, user_id=8c3a4527f75a4038824c961322704157, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:05.800265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2686073c98594394974a3551e1f363d0'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:05.801655 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d39488-cb2b-469e-bbdc-76a6d5408939 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:05.807788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2686073c98594394974a3551e1f363d0'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:05.948214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1048/2114] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:05 2022] PUT /identity/v3/projects/b7bf7a5fc9d642f6a065ba13c189d751/users/8c3a4527f75a4038824c961322704157/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:05.949191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d39488-cb2b-469e-bbdc-76a6d5408939 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:05.970071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2686073c98594394974a3551e1f363d0'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:05.970627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2686073c98594394974a3551e1f363d0'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:05.977648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1067/2115] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:05 2022] DELETE /identity/v3/users/2686073c98594394974a3551e1f363d0 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:05.978472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:05.980005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:06.014027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d39488-cb2b-469e-bbdc-76a6d5408939 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:06.048432 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265297fb-fa50-4635-9d4c-6a8853e6516a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:06.055002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea082aa2-c728-4729-af19-4a09b40a6425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:06.055765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea082aa2-c728-4729-af19-4a09b40a6425 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:06.056066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea082aa2-c728-4729-af19-4a09b40a6425 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:06.056342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea082aa2-c728-4729-af19-4a09b40a6425 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:06.057142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea082aa2-c728-4729-af19-4a09b40a6425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:06.058801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea082aa2-c728-4729-af19-4a09b40a6425 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:06.069976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1068/2116] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:06.071316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95e7e-7172-4dfc-91f2-f2ae0db10557 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:06.071607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95e7e-7172-4dfc-91f2-f2ae0db10557 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:06.071886 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf95e7e-7172-4dfc-91f2-f2ae0db10557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:06.075769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c688d-eab1-4415-be6e-683ddcf0fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:06.076826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c688d-eab1-4415-be6e-683ddcf0fe64 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:06.077119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c688d-eab1-4415-be6e-683ddcf0fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:06.077389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c688d-eab1-4415-be6e-683ddcf0fe64 admin admin] PATH_INFO: `/v3/projects/25389f415ace49948bbebbde1c204f67/users/47a22ccbb4c940eca9545b9fdbd894a9/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:06.090635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-bdf95e7e-7172-4dfc-91f2-f2ae0db10557 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:06.091882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-bdf95e7e-7172-4dfc-91f2-f2ae0db10557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:06.095437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c688d-eab1-4415-be6e-683ddcf0fe64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25389f415ace49948bbebbde1c204f67, user_id=47a22ccbb4c940eca9545b9fdbd894a9, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:06.098700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c688d-eab1-4415-be6e-683ddcf0fe64 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:06.099997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1069/2117] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:06.100652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf95e7e-7172-4dfc-91f2-f2ae0db10557 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:06.110491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf95e7e-7172-4dfc-91f2-f2ae0db10557 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:06.115879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15729f2-748d-4587-a0a0-57e40f7c8dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:06.116966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15729f2-748d-4587-a0a0-57e40f7c8dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:06.117248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15729f2-748d-4587-a0a0-57e40f7c8dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:06.117526 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15729f2-748d-4587-a0a0-57e40f7c8dfd admin admin] PATH_INFO: `/v3/projects/b7bf7a5fc9d642f6a065ba13c189d751/users/8c3a4527f75a4038824c961322704157/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:06.119589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15729f2-748d-4587-a0a0-57e40f7c8dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7bf7a5fc9d642f6a065ba13c189d751, user_id=8c3a4527f75a4038824c961322704157, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:06.122297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15729f2-748d-4587-a0a0-57e40f7c8dfd admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:06.134817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1070/2118] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:06 2022] PUT /identity/v3/projects/b7bf7a5fc9d642f6a065ba13c189d751/users/8c3a4527f75a4038824c961322704157/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:06.135831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15729f2-748d-4587-a0a0-57e40f7c8dfd admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:06.137676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c15729f2-748d-4587-a0a0-57e40f7c8dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:06.202413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15729f2-748d-4587-a0a0-57e40f7c8dfd admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:06.207757 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e72df4-b17d-44d8-bd40-e9fff9213a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:06.210245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e72df4-b17d-44d8-bd40-e9fff9213a95 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:06.210626 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e72df4-b17d-44d8-bd40-e9fff9213a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:06.210908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e72df4-b17d-44d8-bd40-e9fff9213a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:06.248379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1049/2119] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:05 2022] PUT /identity/v3/projects/25389f415ace49948bbebbde1c204f67/users/47a22ccbb4c940eca9545b9fdbd894a9/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:06.259188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee228b-a32e-42ec-be1f-a70183f8238c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:06.259188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee228b-a32e-42ec-be1f-a70183f8238c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:06.259188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee228b-a32e-42ec-be1f-a70183f8238c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:06.283605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-b1ee228b-a32e-42ec-be1f-a70183f8238c None None] MFA Rules not processed for user `8c3a4527f75a4038824c961322704157`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:06.285235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b1ee228b-a32e-42ec-be1f-a70183f8238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:06.293037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e72df4-b17d-44d8-bd40-e9fff9213a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:06.296114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e72df4-b17d-44d8-bd40-e9fff9213a95 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:06.315880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1071/2120] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:06.318829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff46b66-8e3e-45c1-9225-09960baadb89 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:06.319330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff46b66-8e3e-45c1-9225-09960baadb89 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:06.319827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff46b66-8e3e-45c1-9225-09960baadb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:06.365776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-cff46b66-8e3e-45c1-9225-09960baadb89 None None] MFA Rules not processed for user `47a22ccbb4c940eca9545b9fdbd894a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:06.367861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-cff46b66-8e3e-45c1-9225-09960baadb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:06.416867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1050/2121] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:06.435486 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee228b-a32e-42ec-be1f-a70183f8238c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:06.437576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b1ee228b-a32e-42ec-be1f-a70183f8238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:06.484592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1072/2122] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:06.484592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff46b66-8e3e-45c1-9225-09960baadb89 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:06.485898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-cff46b66-8e3e-45c1-9225-09960baadb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:06.512592 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee228b-a32e-42ec-be1f-a70183f8238c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:06.516684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abbbcb-b991-43ba-be8f-84222835b48c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:06.517365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abbbcb-b991-43ba-be8f-84222835b48c service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:06.517702 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abbbcb-b991-43ba-be8f-84222835b48c service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:06.517939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abbbcb-b991-43ba-be8f-84222835b48c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:06.519779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e7abbbcb-b991-43ba-be8f-84222835b48c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:06.565105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff46b66-8e3e-45c1-9225-09960baadb89 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:06.570944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78cb6b-e590-4239-a18a-a327828521c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:06.571738 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78cb6b-e590-4239-a18a-a327828521c2 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:06.572096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78cb6b-e590-4239-a18a-a327828521c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:06.572451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78cb6b-e590-4239-a18a-a327828521c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:06.573271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78cb6b-e590-4239-a18a-a327828521c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:06.575337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78cb6b-e590-4239-a18a-a327828521c2 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:06.603497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abbbcb-b991-43ba-be8f-84222835b48c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:06.605665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abbbcb-b991-43ba-be8f-84222835b48c service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:06.619790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1051/2123] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:59:06.720045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1073/2124] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:06 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:06.726654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abbbcb-b991-43ba-be8f-84222835b48c service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:06.753377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abbbcb-b991-43ba-be8f-84222835b48c service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:06.858523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4ee10-8257-497f-ae1b-cf2c0abe6a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:06.859251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4ee10-8257-497f-ae1b-cf2c0abe6a7e admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:06.859528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4ee10-8257-497f-ae1b-cf2c0abe6a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:06.859812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4ee10-8257-497f-ae1b-cf2c0abe6a7e admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:06.861214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4ee10-8257-497f-ae1b-cf2c0abe6a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:06.864054 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4ee10-8257-497f-ae1b-cf2c0abe6a7e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:07.041884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1052/2125] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:06 2022] POST /identity/v3/users => generated 295 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:07.043230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78cb6b-e590-4239-a18a-a327828521c2 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:07.047152 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4ee10-8257-497f-ae1b-cf2c0abe6a7e admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:07.048662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3e78cb6b-e590-4239-a18a-a327828521c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:07.064003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4ee10-8257-497f-ae1b-cf2c0abe6a7e admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:07.068280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78cb6b-e590-4239-a18a-a327828521c2 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:07.072509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:07.073814 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:07.074098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aa396-656f-45b5-b94a-b61b3af9f6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:07.074225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:07.074445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] PATH_INFO: `/v3/projects/bb37335a4cd74085a131aa720fc7e798` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:07.075476 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aa396-656f-45b5-b94a-b61b3af9f6bb admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:07.075693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb37335a4cd74085a131aa720fc7e798)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:07.075984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aa396-656f-45b5-b94a-b61b3af9f6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:07.076686 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aa396-656f-45b5-b94a-b61b3af9f6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:07.077939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:07.078227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66aa396-656f-45b5-b94a-b61b3af9f6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:07.081631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66aa396-656f-45b5-b94a-b61b3af9f6bb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:07.098365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1053/2126] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:07.102820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aa396-656f-45b5-b94a-b61b3af9f6bb admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:07.114427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aa396-656f-45b5-b94a-b61b3af9f6bb admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:07.122172 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad761712-a974-41ff-97cb-d053bb19a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:07.123171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761712-a974-41ff-97cb-d053bb19a9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:07.123171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761712-a974-41ff-97cb-d053bb19a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:07.128071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761712-a974-41ff-97cb-d053bb19a9e8 admin admin] PATH_INFO: `/v3/projects/dbbdbd23ac38443299e97530ec7d3064/users/8c0d5cbcdde54217983665c2bc331930/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:07.144277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad761712-a974-41ff-97cb-d053bb19a9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbdbd23ac38443299e97530ec7d3064, user_id=8c0d5cbcdde54217983665c2bc331930, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:07.149883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad761712-a974-41ff-97cb-d053bb19a9e8 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:07.285591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1054/2127] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:07 2022] PUT /identity/v3/projects/dbbdbd23ac38443299e97530ec7d3064/users/8c0d5cbcdde54217983665c2bc331930/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:07.288934 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad761712-a974-41ff-97cb-d053bb19a9e8 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:07.299194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb37335a4cd74085a131aa720fc7e798', 'request_id': 'req-ea7c0075-4286-4751-913e-4b5925cd4ff7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:07.312986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb37335a4cd74085a131aa720fc7e798', 'request_id': 'req-ea7c0075-4286-4751-913e-4b5925cd4ff7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:07.327061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb37335a4cd74085a131aa720fc7e798', 'request_id': 'req-ea7c0075-4286-4751-913e-4b5925cd4ff7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:07.414894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad761712-a974-41ff-97cb-d053bb19a9e8 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:07.492464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] The token cache is being invalidate because project bb37335a4cd74085a131aa720fc7e798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:07.493550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:07.493956 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:07.496107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1074/2128] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:07 2022] DELETE /identity/v3/projects/bb37335a4cd74085a131aa720fc7e798 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:07.497157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:07.499456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:07.507869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd384f4-026e-4ac7-b4c9-f9fdcb3385ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:07.508931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd384f4-026e-4ac7-b4c9-f9fdcb3385ae admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:07.509119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd384f4-026e-4ac7-b4c9-f9fdcb3385ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:07.509391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd384f4-026e-4ac7-b4c9-f9fdcb3385ae admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:07.510130 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd384f4-026e-4ac7-b4c9-f9fdcb3385ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:07.511898 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd384f4-026e-4ac7-b4c9-f9fdcb3385ae admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:07.523253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1055/2129] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:07.524197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd384f4-026e-4ac7-b4c9-f9fdcb3385ae admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:07.526505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-7cd384f4-026e-4ac7-b4c9-f9fdcb3385ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:07.541117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd384f4-026e-4ac7-b4c9-f9fdcb3385ae admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:07.549880 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:07.558730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:07.558911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:07.559204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] PATH_INFO: `/v3/users/54c59ae1ccf7471d8fa5a04bab8b156f` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:07.560732 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c59ae1ccf7471d8fa5a04bab8b156f)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:07.562809 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:07.597278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c0075-4286-4751-913e-4b5925cd4ff7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:07.603641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bfece-f3ac-4b53-b191-145c3ee77cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:07.604619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bfece-f3ac-4b53-b191-145c3ee77cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:07.604903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bfece-f3ac-4b53-b191-145c3ee77cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:07.605183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bfece-f3ac-4b53-b191-145c3ee77cc9 admin admin] PATH_INFO: `/v3/users/119fd021bfa248e18dd5536c70b4d446` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:07.606502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bfece-f3ac-4b53-b191-145c3ee77cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=119fd021bfa248e18dd5536c70b4d446)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:07.608519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bfece-f3ac-4b53-b191-145c3ee77cc9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:07.861208 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c59ae1ccf7471d8fa5a04bab8b156f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:07.876454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c59ae1ccf7471d8fa5a04bab8b156f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:07.884990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c59ae1ccf7471d8fa5a04bab8b156f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:07.934343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6d3bfece-f3ac-4b53-b191-145c3ee77cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119fd021bfa248e18dd5536c70b4d446'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:07.956647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6d3bfece-f3ac-4b53-b191-145c3ee77cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119fd021bfa248e18dd5536c70b4d446'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:07.971428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6d3bfece-f3ac-4b53-b191-145c3ee77cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119fd021bfa248e18dd5536c70b4d446'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:08.021962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c59ae1ccf7471d8fa5a04bab8b156f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:08.023246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c59ae1ccf7471d8fa5a04bab8b156f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:08.030801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1056/2130] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:07 2022] DELETE /identity/v3/users/54c59ae1ccf7471d8fa5a04bab8b156f => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:08.031865 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:08.033316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:08.144335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a2383-2330-43a6-a7a3-38793b205af5 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:08.149999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9b01d-819d-4eaf-b2e6-88af3f115938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:08.150928 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9b01d-819d-4eaf-b2e6-88af3f115938 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:08.151214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9b01d-819d-4eaf-b2e6-88af3f115938 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:08.151493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9b01d-819d-4eaf-b2e6-88af3f115938 admin admin] PATH_INFO: `/v3/projects/dbbdbd23ac38443299e97530ec7d3064/users/8c0d5cbcdde54217983665c2bc331930/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:08.153937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9b01d-819d-4eaf-b2e6-88af3f115938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbdbd23ac38443299e97530ec7d3064, user_id=8c0d5cbcdde54217983665c2bc331930, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:08.156807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9b01d-819d-4eaf-b2e6-88af3f115938 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:08.177991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1057/2131] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:08 2022] PUT /identity/v3/projects/dbbdbd23ac38443299e97530ec7d3064/users/8c0d5cbcdde54217983665c2bc331930/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:08.179403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6d3bfece-f3ac-4b53-b191-145c3ee77cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119fd021bfa248e18dd5536c70b4d446'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:08.180060 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6d3bfece-f3ac-4b53-b191-145c3ee77cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119fd021bfa248e18dd5536c70b4d446'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:08.188052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1075/2132] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:07 2022] DELETE /identity/v3/users/119fd021bfa248e18dd5536c70b4d446 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:08.192190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3920ee-65a4-4c10-afa2-cec6386675c1 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:08.193599 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3920ee-65a4-4c10-afa2-cec6386675c1 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:08.194374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c8520-e801-4f47-8337-b5c21a48a547 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:08.194374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c8520-e801-4f47-8337-b5c21a48a547 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:08.194849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3920ee-65a4-4c10-afa2-cec6386675c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:08.195578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c8520-e801-4f47-8337-b5c21a48a547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:08.223428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-6c5c8520-e801-4f47-8337-b5c21a48a547 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:08.224867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6c5c8520-e801-4f47-8337-b5c21a48a547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:08.229838 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-5d3920ee-65a4-4c10-afa2-cec6386675c1 None None] MFA Rules not processed for user `8c0d5cbcdde54217983665c2bc331930`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:08.231228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5d3920ee-65a4-4c10-afa2-cec6386675c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:08.296589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1076/2133] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:08.309624 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c8520-e801-4f47-8337-b5c21a48a547 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:08.322059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6c5c8520-e801-4f47-8337-b5c21a48a547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:08.322059 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:08.344523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1058/2134] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:08.358803 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3920ee-65a4-4c10-afa2-cec6386675c1 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:08.361498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5d3920ee-65a4-4c10-afa2-cec6386675c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:08.417016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c8520-e801-4f47-8337-b5c21a48a547 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:08.418194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d727a-c7ba-47c4-b61f-17d490a23e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:08.418874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d727a-c7ba-47c4-b61f-17d490a23e15 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:08.419152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d727a-c7ba-47c4-b61f-17d490a23e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:08.419426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d727a-c7ba-47c4-b61f-17d490a23e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:08.434098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d727a-c7ba-47c4-b61f-17d490a23e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:08.435586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d727a-c7ba-47c4-b61f-17d490a23e15 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:08.449903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3920ee-65a4-4c10-afa2-cec6386675c1 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:08.451073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1077/2135] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:08.453933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb90db-3de0-45a2-abc5-2a278601a04d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:08.454597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb90db-3de0-45a2-abc5-2a278601a04d service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:08.454879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb90db-3de0-45a2-abc5-2a278601a04d service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:08.455157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb90db-3de0-45a2-abc5-2a278601a04d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:08.457122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-abbb90db-3de0-45a2-abc5-2a278601a04d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:08.527475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb90db-3de0-45a2-abc5-2a278601a04d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:08.529086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb90db-3de0-45a2-abc5-2a278601a04d service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:08.540765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1059/2136] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:08.631632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d727a-c7ba-47c4-b61f-17d490a23e15 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:08.633277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-454d727a-c7ba-47c4-b61f-17d490a23e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:08.653393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d727a-c7ba-47c4-b61f-17d490a23e15 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:08.664814 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:08.667026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:08.667385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:08.667769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] PATH_INFO: `/v3/projects/714bcb270dae4da088d2b0ce544ff04f` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:08.669950 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=714bcb270dae4da088d2b0ce544ff04f)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:08.673637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:08.844228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:08.851583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714bcb270dae4da088d2b0ce544ff04f', 'request_id': 'req-a468dcdd-5a12-4964-adc8-c056e4e41056'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:08.863824 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714bcb270dae4da088d2b0ce544ff04f', 'request_id': 'req-a468dcdd-5a12-4964-adc8-c056e4e41056'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:08.877276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714bcb270dae4da088d2b0ce544ff04f', 'request_id': 'req-a468dcdd-5a12-4964-adc8-c056e4e41056'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:08.977552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] The token cache is being invalidate because project 714bcb270dae4da088d2b0ce544ff04f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:08.978453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:08.979441 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:08.982588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1078/2137] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:08 2022] DELETE /identity/v3/projects/714bcb270dae4da088d2b0ce544ff04f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:08.992227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e6c11-a4c1-438b-967e-673a8ede176b None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:08.992845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e6c11-a4c1-438b-967e-673a8ede176b None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:08.993338 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e6c11-a4c1-438b-967e-673a8ede176b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.025262 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-bf3e6c11-a4c1-438b-967e-673a8ede176b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:09.027308 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bf3e6c11-a4c1-438b-967e-673a8ede176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:09.147024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:09.147195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1060/2138] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:09.157289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944fd4c-8e9d-4a46-9af6-ec081325bdf4 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.157509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:09.157773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944fd4c-8e9d-4a46-9af6-ec081325bdf4 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.158253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944fd4c-8e9d-4a46-9af6-ec081325bdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.200930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-8944fd4c-8e9d-4a46-9af6-ec081325bdf4 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:09.202523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8944fd4c-8e9d-4a46-9af6-ec081325bdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:09.207006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468dcdd-5a12-4964-adc8-c056e4e41056 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:09.213588 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1061/2139] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:09.218187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:09.219303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.219893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.220308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67 admin admin] PATH_INFO: `/v3/projects/b8968bec13ae4ccfa6698f243daacd93` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.221986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8968bec13ae4ccfa6698f243daacd93)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:09.223121 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944fd4c-8e9d-4a46-9af6-ec081325bdf4 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:09.226195 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:09.239324 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944fd4c-8e9d-4a46-9af6-ec081325bdf4 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:09.245946 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054ee30-58a9-44aa-96fa-2102a79939e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:09.246625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054ee30-58a9-44aa-96fa-2102a79939e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.246923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054ee30-58a9-44aa-96fa-2102a79939e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.247178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054ee30-58a9-44aa-96fa-2102a79939e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.248770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054ee30-58a9-44aa-96fa-2102a79939e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:59:09.249373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054ee30-58a9-44aa-96fa-2102a79939e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:09.253313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054ee30-58a9-44aa-96fa-2102a79939e8 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:09.276537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1062/2140] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:59:09.281885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054ee30-58a9-44aa-96fa-2102a79939e8 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:09.300837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054ee30-58a9-44aa-96fa-2102a79939e8 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:09.307929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a57c2-da75-4698-843c-4334ff0d961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:09.308822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a57c2-da75-4698-843c-4334ff0d961e admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.309752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a57c2-da75-4698-843c-4334ff0d961e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.309752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a57c2-da75-4698-843c-4334ff0d961e admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.310078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a57c2-da75-4698-843c-4334ff0d961e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:09.312188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a57c2-da75-4698-843c-4334ff0d961e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:09.373282 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8968bec13ae4ccfa6698f243daacd93', 'request_id': 'req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:09.381752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8968bec13ae4ccfa6698f243daacd93', 'request_id': 'req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:09.387734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8968bec13ae4ccfa6698f243daacd93', 'request_id': 'req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:09.430883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1063/2141] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:09 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:09.436605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a57c2-da75-4698-843c-4334ff0d961e admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:09.515347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a57c2-da75-4698-843c-4334ff0d961e admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:09.525278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028aa83-9916-4783-960e-539c6ae90646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:09.526960 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028aa83-9916-4783-960e-539c6ae90646 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.536798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028aa83-9916-4783-960e-539c6ae90646 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.536798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028aa83-9916-4783-960e-539c6ae90646 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.537441 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67 admin admin] The token cache is being invalidate because project b8968bec13ae4ccfa6698f243daacd93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:09.537579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028aa83-9916-4783-960e-539c6ae90646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:09.537687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:09.537687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2d829f5d-fa3e-4e73-bc0f-37016d07ec67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:09.537687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1079/2142] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:09 2022] DELETE /identity/v3/projects/b8968bec13ae4ccfa6698f243daacd93 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:09.537886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028aa83-9916-4783-960e-539c6ae90646 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:09.541869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5b7c2-7f45-44bb-99d2-f131ae806318 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.542349 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5b7c2-7f45-44bb-99d2-f131ae806318 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.543123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5b7c2-7f45-44bb-99d2-f131ae806318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.569411 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-0fe5b7c2-7f45-44bb-99d2-f131ae806318 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:09.571314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0fe5b7c2-7f45-44bb-99d2-f131ae806318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:09.581374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1080/2143] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:09.589308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb9d3-55f6-4bcc-b5f5-51dbc77f9633 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.589597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb9d3-55f6-4bcc-b5f5-51dbc77f9633 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.589878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb9d3-55f6-4bcc-b5f5-51dbc77f9633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.609867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-530cb9d3-55f6-4bcc-b5f5-51dbc77f9633 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:09.611124 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-530cb9d3-55f6-4bcc-b5f5-51dbc77f9633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:09.621474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1081/2144] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:09.625928 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cb9d3-55f6-4bcc-b5f5-51dbc77f9633 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:09.636872 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cb9d3-55f6-4bcc-b5f5-51dbc77f9633 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:09.641894 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e587519-9cd6-4f8d-a610-ca1fee7f5076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:09.642593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e587519-9cd6-4f8d-a610-ca1fee7f5076 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.642877 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e587519-9cd6-4f8d-a610-ca1fee7f5076 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.643161 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e587519-9cd6-4f8d-a610-ca1fee7f5076 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.643906 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e587519-9cd6-4f8d-a610-ca1fee7f5076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:59:09.644216 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e587519-9cd6-4f8d-a610-ca1fee7f5076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:09.646299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e587519-9cd6-4f8d-a610-ca1fee7f5076 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:09.659377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1082/2145] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:59:09.664576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e587519-9cd6-4f8d-a610-ca1fee7f5076 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:09.675545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e587519-9cd6-4f8d-a610-ca1fee7f5076 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:09.680972 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c55c65-9df3-4e7b-be65-0cbec4169932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:09.681700 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c55c65-9df3-4e7b-be65-0cbec4169932 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.681979 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c55c65-9df3-4e7b-be65-0cbec4169932 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.682253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c55c65-9df3-4e7b-be65-0cbec4169932 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.682963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c55c65-9df3-4e7b-be65-0cbec4169932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:09.684909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c55c65-9df3-4e7b-be65-0cbec4169932 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:09.697370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1064/2146] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:09 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:09.709928 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028aa83-9916-4783-960e-539c6ae90646 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:09.711939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3028aa83-9916-4783-960e-539c6ae90646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:09.725864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028aa83-9916-4783-960e-539c6ae90646 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:09.730640 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bb95f-0e59-4a80-b583-42277b1398c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:09.731334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bb95f-0e59-4a80-b583-42277b1398c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.731605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bb95f-0e59-4a80-b583-42277b1398c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.731887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bb95f-0e59-4a80-b583-42277b1398c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.732671 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bb95f-0e59-4a80-b583-42277b1398c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:09.734337 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bb95f-0e59-4a80-b583-42277b1398c5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:09.746152 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1065/2147] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:59:09.750140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bb95f-0e59-4a80-b583-42277b1398c5 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:09.769554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bb95f-0e59-4a80-b583-42277b1398c5 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:09.774737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a353a-f43d-4fc5-ad8b-6956af2f810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:09.775488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a353a-f43d-4fc5-ad8b-6956af2f810b admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.775717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a353a-f43d-4fc5-ad8b-6956af2f810b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.775996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a353a-f43d-4fc5-ad8b-6956af2f810b admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.776788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a353a-f43d-4fc5-ad8b-6956af2f810b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:09.778420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a353a-f43d-4fc5-ad8b-6956af2f810b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:09.792369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1066/2148] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:59:09.796399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a353a-f43d-4fc5-ad8b-6956af2f810b admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:09.807744 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a353a-f43d-4fc5-ad8b-6956af2f810b admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:09.812339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a2bf-4f16-4344-9aa0-18babd799ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:09.813278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a2bf-4f16-4344-9aa0-18babd799ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.813556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a2bf-4f16-4344-9aa0-18babd799ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.813837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a2bf-4f16-4344-9aa0-18babd799ce3 admin admin] PATH_INFO: `/v3/projects/f8fce73f2a48445dae1c1d067e1bea33/users/796785f8a60041aab7d1559c383e35e0/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.830966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a2bf-4f16-4344-9aa0-18babd799ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8fce73f2a48445dae1c1d067e1bea33, user_id=796785f8a60041aab7d1559c383e35e0, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:09.833758 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a2bf-4f16-4344-9aa0-18babd799ce3 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:09.840114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1083/2149] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:09 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:09.844356 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c55c65-9df3-4e7b-be65-0cbec4169932 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:09.917338 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c55c65-9df3-4e7b-be65-0cbec4169932 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:09.922530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b006625-0064-4583-b00e-93f0f86720c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:09.923180 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006625-0064-4583-b00e-93f0f86720c1 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.923488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006625-0064-4583-b00e-93f0f86720c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.923772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006625-0064-4583-b00e-93f0f86720c1 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:09.924603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b006625-0064-4583-b00e-93f0f86720c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:09.930197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b006625-0064-4583-b00e-93f0f86720c1 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:09.964918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1067/2150] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:09 2022] PUT /identity/v3/projects/f8fce73f2a48445dae1c1d067e1bea33/users/796785f8a60041aab7d1559c383e35e0/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:09.976450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8d5f5-7482-4ba9-a9c8-9e579529a542 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:09.976787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8d5f5-7482-4ba9-a9c8-9e579529a542 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:09.977065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8d5f5-7482-4ba9-a9c8-9e579529a542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:10.007577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d1e8d5f5-7482-4ba9-a9c8-9e579529a542 None None] MFA Rules not processed for user `796785f8a60041aab7d1559c383e35e0`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:10.008838 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d1e8d5f5-7482-4ba9-a9c8-9e579529a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:10.032956 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1084/2151] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:09 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:10.037705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b006625-0064-4583-b00e-93f0f86720c1 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:10.048886 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b006625-0064-4583-b00e-93f0f86720c1 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:10.107010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1068/2152] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:10.120444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8d5f5-7482-4ba9-a9c8-9e579529a542 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:10.122576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d1e8d5f5-7482-4ba9-a9c8-9e579529a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:10.125546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b7a01-4795-48ea-becb-0d8aee84eb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:10.129010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b7a01-4795-48ea-becb-0d8aee84eb8a admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:10.129010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b7a01-4795-48ea-becb-0d8aee84eb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:10.129010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b7a01-4795-48ea-becb-0d8aee84eb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:10.129010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b7a01-4795-48ea-becb-0d8aee84eb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:10.130833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b7a01-4795-48ea-becb-0d8aee84eb8a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:10.146473 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1085/2153] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:59:10.153597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b7a01-4795-48ea-becb-0d8aee84eb8a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:10.172173 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b7a01-4795-48ea-becb-0d8aee84eb8a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:10.180200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be127c5b-4f54-4e3a-a2b1-714573f15f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:10.181320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be127c5b-4f54-4e3a-a2b1-714573f15f08 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:10.181783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be127c5b-4f54-4e3a-a2b1-714573f15f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:10.182247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be127c5b-4f54-4e3a-a2b1-714573f15f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:10.183675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be127c5b-4f54-4e3a-a2b1-714573f15f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:10.186329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be127c5b-4f54-4e3a-a2b1-714573f15f08 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:10.198964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1086/2154] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:10.203822 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be127c5b-4f54-4e3a-a2b1-714573f15f08 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:10.215516 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be127c5b-4f54-4e3a-a2b1-714573f15f08 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:10.222068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfc8df-f30a-4fcf-9b48-ed6b85aac02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:10.222975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc8df-f30a-4fcf-9b48-ed6b85aac02b admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:10.223258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc8df-f30a-4fcf-9b48-ed6b85aac02b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:10.223534 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc8df-f30a-4fcf-9b48-ed6b85aac02b admin admin] PATH_INFO: `/v3/projects/62b84111fcf34b26bd9ad4557c90ce8e/users/8e53dcca0a2c471e91b11ddb7e71faa7/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:10.229096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8d5f5-7482-4ba9-a9c8-9e579529a542 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:10.233443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc2c6f-c310-40d7-a088-0e1269d479e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:10.234988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc2c6f-c310-40d7-a088-0e1269d479e5 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:10.234988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc2c6f-c310-40d7-a088-0e1269d479e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:10.234988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc2c6f-c310-40d7-a088-0e1269d479e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:10.244246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc2c6f-c310-40d7-a088-0e1269d479e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:10.244685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfc8df-f30a-4fcf-9b48-ed6b85aac02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b84111fcf34b26bd9ad4557c90ce8e, user_id=8e53dcca0a2c471e91b11ddb7e71faa7, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:10.245765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc2c6f-c310-40d7-a088-0e1269d479e5 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:10.247289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfc8df-f30a-4fcf-9b48-ed6b85aac02b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:10.256845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1069/2155] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:59:10.317143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1087/2156] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:10 2022] PUT /identity/v3/projects/62b84111fcf34b26bd9ad4557c90ce8e/users/8e53dcca0a2c471e91b11ddb7e71faa7/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:10.328646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258a1b-3007-4784-bfc8-6f4efc7ed875 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:10.329000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258a1b-3007-4784-bfc8-6f4efc7ed875 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:10.329282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258a1b-3007-4784-bfc8-6f4efc7ed875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:10.363574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d8258a1b-3007-4784-bfc8-6f4efc7ed875 None None] MFA Rules not processed for user `8e53dcca0a2c471e91b11ddb7e71faa7`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:10.364817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d8258a1b-3007-4784-bfc8-6f4efc7ed875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:10.445371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1070/2157] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:10.456908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfc8df-f30a-4fcf-9b48-ed6b85aac02b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:10.461089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9ebfc8df-f30a-4fcf-9b48-ed6b85aac02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:10.526559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfc8df-f30a-4fcf-9b48-ed6b85aac02b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:10.531165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445b56b-04b7-4d74-a92a-75b7784e5421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:10.531912 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445b56b-04b7-4d74-a92a-75b7784e5421 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:10.532198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445b56b-04b7-4d74-a92a-75b7784e5421 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:10.532490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445b56b-04b7-4d74-a92a-75b7784e5421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:10.544025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445b56b-04b7-4d74-a92a-75b7784e5421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:10.545603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445b56b-04b7-4d74-a92a-75b7784e5421 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:10.559110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1088/2158] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:11.256549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8258a1b-3007-4784-bfc8-6f4efc7ed875 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:11.258092 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d8258a1b-3007-4784-bfc8-6f4efc7ed875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:11.295156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:11.334694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8258a1b-3007-4784-bfc8-6f4efc7ed875 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:11.339499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:11.340559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:11.340842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:11.341112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] PATH_INFO: `/v3/users/c6362ec1a7544263a63bcbf415083400` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:11.342356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6362ec1a7544263a63bcbf415083400)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:11.344467 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:11.771441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6362ec1a7544263a63bcbf415083400'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:11.777229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:11.791067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6362ec1a7544263a63bcbf415083400'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:11.799883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6362ec1a7544263a63bcbf415083400'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:11.912024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6362ec1a7544263a63bcbf415083400'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:11.912848 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6362ec1a7544263a63bcbf415083400'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:11.926381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1071/2159] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:11 2022] DELETE /identity/v3/users/c6362ec1a7544263a63bcbf415083400 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:11.931335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40904c5c-06eb-4cad-82e9-c12b13b29c4f None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:11.931772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40904c5c-06eb-4cad-82e9-c12b13b29c4f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:11.932067 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40904c5c-06eb-4cad-82e9-c12b13b29c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:11.958741 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-40904c5c-06eb-4cad-82e9-c12b13b29c4f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:11.960098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-40904c5c-06eb-4cad-82e9-c12b13b29c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:12.037298 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1089/2160] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:12.049482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:12.051098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:12.126862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329494a-640f-4182-8e54-51a96b4ea5f0 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:12.130475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454408a3-e837-4fe9-8516-73e6fdcd1503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:12.131165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454408a3-e837-4fe9-8516-73e6fdcd1503 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:12.131444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454408a3-e837-4fe9-8516-73e6fdcd1503 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:12.131723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454408a3-e837-4fe9-8516-73e6fdcd1503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:12.142309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454408a3-e837-4fe9-8516-73e6fdcd1503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:12.144116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454408a3-e837-4fe9-8516-73e6fdcd1503 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:12.156165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1072/2161] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:12.794155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40904c5c-06eb-4cad-82e9-c12b13b29c4f None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:12.795592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-40904c5c-06eb-4cad-82e9-c12b13b29c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:12.815273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40904c5c-06eb-4cad-82e9-c12b13b29c4f None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:12.815273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:12.815830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:12.816116 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:12.816384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] PATH_INFO: `/v3/projects/61aa95d0c4c4424c8abebd31cdbf73b9` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:12.818193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61aa95d0c4c4424c8abebd31cdbf73b9)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:12.822183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:13.034653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61aa95d0c4c4424c8abebd31cdbf73b9', 'request_id': 'req-9baf13bf-5243-4907-9dc4-cc7654310f05'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:13.047090 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61aa95d0c4c4424c8abebd31cdbf73b9', 'request_id': 'req-9baf13bf-5243-4907-9dc4-cc7654310f05'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:13.049564 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61aa95d0c4c4424c8abebd31cdbf73b9', 'request_id': 'req-9baf13bf-5243-4907-9dc4-cc7654310f05'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:13.169758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] The token cache is being invalidate because project 61aa95d0c4c4424c8abebd31cdbf73b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:13.170043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:13.170726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:13.172361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1090/2162] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:12 2022] DELETE /identity/v3/projects/61aa95d0c4c4424c8abebd31cdbf73b9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:13.176437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454408a3-e837-4fe9-8516-73e6fdcd1503 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:13.187069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454408a3-e837-4fe9-8516-73e6fdcd1503 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:13.251703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:13.252607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:13.252885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:13.253155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] PATH_INFO: `/v3/users/8c3a4527f75a4038824c961322704157` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:13.254373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3a4527f75a4038824c961322704157)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:13.257666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:13.719081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:13.719841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3a4527f75a4038824c961322704157'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:13.734705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3a4527f75a4038824c961322704157'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:13.743480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3a4527f75a4038824c961322704157'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:13.826794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3a4527f75a4038824c961322704157'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:13.827488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3a4527f75a4038824c961322704157'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:13.837111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1073/2163] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:13 2022] DELETE /identity/v3/users/8c3a4527f75a4038824c961322704157 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:14.029858 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:14.031438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:14.097827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf13bf-5243-4907-9dc4-cc7654310f05 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:14.189354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff941169-d7a5-4234-be7c-3586a9ad3511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:14.190091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff941169-d7a5-4234-be7c-3586a9ad3511 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:14.190648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff941169-d7a5-4234-be7c-3586a9ad3511 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:14.191392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff941169-d7a5-4234-be7c-3586a9ad3511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:14.194942 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ff941169-d7a5-4234-be7c-3586a9ad3511 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:14.273246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff941169-d7a5-4234-be7c-3586a9ad3511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:14.274721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff941169-d7a5-4234-be7c-3586a9ad3511 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:14.286403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1091/2164] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:14.502634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:14.507267 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:14.618012 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c22d84-19be-4130-85c6-ab3a17b4388e admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:14.622874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:14.623735 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:14.624015 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:14.626072 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] PATH_INFO: `/v3/projects/b7bf7a5fc9d642f6a065ba13c189d751` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:14.626072 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7bf7a5fc9d642f6a065ba13c189d751)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:14.627596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:14.746142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7bf7a5fc9d642f6a065ba13c189d751', 'request_id': 'req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:14.752165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7bf7a5fc9d642f6a065ba13c189d751', 'request_id': 'req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:14.844753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7bf7a5fc9d642f6a065ba13c189d751', 'request_id': 'req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:14.855521 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] The token cache is being invalidate because project b7bf7a5fc9d642f6a065ba13c189d751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:14.855929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:14.856865 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:14.858532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1074/2165] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:14 2022] DELETE /identity/v3/projects/b7bf7a5fc9d642f6a065ba13c189d751 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:14.865278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1238c0b-2bf5-41ed-b63b-d7bb8687c517 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:14.865515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1238c0b-2bf5-41ed-b63b-d7bb8687c517 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:14.865810 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1238c0b-2bf5-41ed-b63b-d7bb8687c517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:14.891818 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-d1238c0b-2bf5-41ed-b63b-d7bb8687c517 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:14.893108 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d1238c0b-2bf5-41ed-b63b-d7bb8687c517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:14.959259 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:14.963432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:14.969462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1092/2166] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:14.980531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5f8d4-34ff-4afe-a90a-cc6e55293f09 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:14.981675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969074e9-82d2-4efa-83cf-825ed3061b94 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:14.982191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969074e9-82d2-4efa-83cf-825ed3061b94 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:14.982534 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969074e9-82d2-4efa-83cf-825ed3061b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:14.986477 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b42991-bcd7-4c1f-b50d-a3fa1dd5d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:14.987812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b42991-bcd7-4c1f-b50d-a3fa1dd5d675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:14.988253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b42991-bcd7-4c1f-b50d-a3fa1dd5d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:14.990233 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b42991-bcd7-4c1f-b50d-a3fa1dd5d675 admin admin] PATH_INFO: `/v3/users/796785f8a60041aab7d1559c383e35e0` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:14.990752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b42991-bcd7-4c1f-b50d-a3fa1dd5d675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=796785f8a60041aab7d1559c383e35e0)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:14.992603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b42991-bcd7-4c1f-b50d-a3fa1dd5d675 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:15.004138 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-969074e9-82d2-4efa-83cf-825ed3061b94 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:15.005500 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-969074e9-82d2-4efa-83cf-825ed3061b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:15.015006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1093/2167] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:15.018848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969074e9-82d2-4efa-83cf-825ed3061b94 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:15.028559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969074e9-82d2-4efa-83cf-825ed3061b94 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:15.033535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02759e-ccf7-47bb-bc49-688a64c857f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:15.034529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02759e-ccf7-47bb-bc49-688a64c857f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:15.034529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02759e-ccf7-47bb-bc49-688a64c857f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:15.034806 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02759e-ccf7-47bb-bc49-688a64c857f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:15.035499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02759e-ccf7-47bb-bc49-688a64c857f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:59:15.035786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02759e-ccf7-47bb-bc49-688a64c857f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:15.038066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02759e-ccf7-47bb-bc49-688a64c857f2 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:15.051431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1094/2168] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:59:15.059123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02759e-ccf7-47bb-bc49-688a64c857f2 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:15.077362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02759e-ccf7-47bb-bc49-688a64c857f2 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:15.084713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c4555-700f-4c01-8431-a6d11c4090d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:15.085589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c4555-700f-4c01-8431-a6d11c4090d4 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:15.088769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c4555-700f-4c01-8431-a6d11c4090d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:15.088769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c4555-700f-4c01-8431-a6d11c4090d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:15.088769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c4555-700f-4c01-8431-a6d11c4090d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:15.090177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c4555-700f-4c01-8431-a6d11c4090d4 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:15.118209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:15.278784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1095/2169] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:15 2022] POST /identity/v3/projects => generated 373 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:15.282891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c4555-700f-4c01-8431-a6d11c4090d4 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:15.289215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-35b42991-bcd7-4c1f-b50d-a3fa1dd5d675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796785f8a60041aab7d1559c383e35e0'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:15.305541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-35b42991-bcd7-4c1f-b50d-a3fa1dd5d675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796785f8a60041aab7d1559c383e35e0'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:15.314452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-35b42991-bcd7-4c1f-b50d-a3fa1dd5d675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796785f8a60041aab7d1559c383e35e0'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:15.359635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c4555-700f-4c01-8431-a6d11c4090d4 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:15.365043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904f0e0-8531-4d8f-929f-cd63b878856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:15.365732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904f0e0-8531-4d8f-929f-cd63b878856e admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:15.366015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904f0e0-8531-4d8f-929f-cd63b878856e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:15.366309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904f0e0-8531-4d8f-929f-cd63b878856e admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:15.367010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904f0e0-8531-4d8f-929f-cd63b878856e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:15.369016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904f0e0-8531-4d8f-929f-cd63b878856e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:15.466478 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-35b42991-bcd7-4c1f-b50d-a3fa1dd5d675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796785f8a60041aab7d1559c383e35e0'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:15.467104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-35b42991-bcd7-4c1f-b50d-a3fa1dd5d675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796785f8a60041aab7d1559c383e35e0'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:15.473670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1075/2170] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:14 2022] DELETE /identity/v3/users/796785f8a60041aab7d1559c383e35e0 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:15.479272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468330b-2e22-4760-80a1-90e605c346bf None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:15.479591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468330b-2e22-4760-80a1-90e605c346bf None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:15.479874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468330b-2e22-4760-80a1-90e605c346bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:15.499965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-3468330b-2e22-4760-80a1-90e605c346bf None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:15.501186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3468330b-2e22-4760-80a1-90e605c346bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:15.501462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1096/2171] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:15 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:15.505625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904f0e0-8531-4d8f-929f-cd63b878856e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:15.507541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a904f0e0-8531-4d8f-929f-cd63b878856e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:15.519996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904f0e0-8531-4d8f-929f-cd63b878856e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:15.576996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1076/2172] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:15.587428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:15.594133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468330b-2e22-4760-80a1-90e605c346bf None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:15.594368 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad54e9-2e54-4a1d-8ea5-4f11afdd6104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:15.594484 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3468330b-2e22-4760-80a1-90e605c346bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:15.594565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad54e9-2e54-4a1d-8ea5-4f11afdd6104 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:15.594565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad54e9-2e54-4a1d-8ea5-4f11afdd6104 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:15.594565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad54e9-2e54-4a1d-8ea5-4f11afdd6104 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:15.594565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad54e9-2e54-4a1d-8ea5-4f11afdd6104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:15.594565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad54e9-2e54-4a1d-8ea5-4f11afdd6104 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:15.609717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1097/2173] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:59:15.611248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad54e9-2e54-4a1d-8ea5-4f11afdd6104 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:15.624217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad54e9-2e54-4a1d-8ea5-4f11afdd6104 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:15.629328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4a939-8f56-452e-a752-1e870ba559e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:15.630103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4a939-8f56-452e-a752-1e870ba559e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:15.631094 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4a939-8f56-452e-a752-1e870ba559e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:15.631372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4a939-8f56-452e-a752-1e870ba559e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:15.632105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4a939-8f56-452e-a752-1e870ba559e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:15.633728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4a939-8f56-452e-a752-1e870ba559e4 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:15.647727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1098/2174] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:59:15.649402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4a939-8f56-452e-a752-1e870ba559e4 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:15.655900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468330b-2e22-4760-80a1-90e605c346bf None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:15.660241 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34480a6-defd-4b56-8723-4980ffed222b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:15.661991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34480a6-defd-4b56-8723-4980ffed222b service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:15.662276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34480a6-defd-4b56-8723-4980ffed222b service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:15.662554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34480a6-defd-4b56-8723-4980ffed222b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:15.663530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4a939-8f56-452e-a752-1e870ba559e4 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:15.668841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caf524-001e-48f4-b8e6-252d479a52b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:15.669749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf524-001e-48f4-b8e6-252d479a52b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:15.670055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf524-001e-48f4-b8e6-252d479a52b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:15.670315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf524-001e-48f4-b8e6-252d479a52b4 admin admin] PATH_INFO: `/v3/projects/dce83dfedf94430eb9a35ef4e8c199d3/users/ae98633baddd4dd19516a1ee4cff0e32/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:15.673908 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34480a6-defd-4b56-8723-4980ffed222b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:15.675541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34480a6-defd-4b56-8723-4980ffed222b service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:15.686060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1077/2175] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:15.687285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17caf524-001e-48f4-b8e6-252d479a52b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce83dfedf94430eb9a35ef4e8c199d3, user_id=ae98633baddd4dd19516a1ee4cff0e32, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:15.690005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17caf524-001e-48f4-b8e6-252d479a52b4 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:15.804936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1099/2176] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:15 2022] PUT /identity/v3/projects/dce83dfedf94430eb9a35ef4e8c199d3/users/ae98633baddd4dd19516a1ee4cff0e32/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:15.810415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d158-544d-4740-b4a7-368577472e76 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:15.810692 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d158-544d-4740-b4a7-368577472e76 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:15.810971 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d158-544d-4740-b4a7-368577472e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:15.831880 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-f361d158-544d-4740-b4a7-368577472e76 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:15.833845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f361d158-544d-4740-b4a7-368577472e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:15.923590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1078/2177] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:15.933522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caf524-001e-48f4-b8e6-252d479a52b4 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:15.936606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-17caf524-001e-48f4-b8e6-252d479a52b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:16.036217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caf524-001e-48f4-b8e6-252d479a52b4 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:16.043569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8ed62-6a5b-4796-b317-8dd595c243de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:16.044815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8ed62-6a5b-4796-b317-8dd595c243de service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:16.045311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8ed62-6a5b-4796-b317-8dd595c243de service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:16.046203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8ed62-6a5b-4796-b317-8dd595c243de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:16.060100 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8ed62-6a5b-4796-b317-8dd595c243de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:16.061732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8ed62-6a5b-4796-b317-8dd595c243de service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:16.074020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1100/2178] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:59:16.264940 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d158-544d-4740-b4a7-368577472e76 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:16.266459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f361d158-544d-4740-b4a7-368577472e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:16.287589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d158-544d-4740-b4a7-368577472e76 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:16.297195 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c081a-046d-4b0e-8c82-aaafca03b64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:16.298420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c081a-046d-4b0e-8c82-aaafca03b64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:16.298776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c081a-046d-4b0e-8c82-aaafca03b64b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:16.299086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c081a-046d-4b0e-8c82-aaafca03b64b admin admin] PATH_INFO: `/v3/projects/f8fce73f2a48445dae1c1d067e1bea33` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:16.301129 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c081a-046d-4b0e-8c82-aaafca03b64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8fce73f2a48445dae1c1d067e1bea33)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:16.304392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c081a-046d-4b0e-8c82-aaafca03b64b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:16.483774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8ed62-6a5b-4796-b317-8dd595c243de service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:16.486210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4fc8ed62-6a5b-4796-b317-8dd595c243de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:16.515450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8ed62-6a5b-4796-b317-8dd595c243de service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:16.531155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-433c081a-046d-4b0e-8c82-aaafca03b64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8fce73f2a48445dae1c1d067e1bea33', 'request_id': 'req-433c081a-046d-4b0e-8c82-aaafca03b64b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:16.538582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:16.544404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-433c081a-046d-4b0e-8c82-aaafca03b64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8fce73f2a48445dae1c1d067e1bea33', 'request_id': 'req-433c081a-046d-4b0e-8c82-aaafca03b64b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:16.606338 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c812c79-0db8-4660-84d6-2e87666d0cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:16.607346 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c812c79-0db8-4660-84d6-2e87666d0cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:16.607708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c812c79-0db8-4660-84d6-2e87666d0cce admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:16.608108 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c812c79-0db8-4660-84d6-2e87666d0cce admin admin] PATH_INFO: `/v3/users/8e53dcca0a2c471e91b11ddb7e71faa7` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:16.610335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c812c79-0db8-4660-84d6-2e87666d0cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e53dcca0a2c471e91b11ddb7e71faa7)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:16.613559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c812c79-0db8-4660-84d6-2e87666d0cce admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:16.626985 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-433c081a-046d-4b0e-8c82-aaafca03b64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8fce73f2a48445dae1c1d067e1bea33', 'request_id': 'req-433c081a-046d-4b0e-8c82-aaafca03b64b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:16.648840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-433c081a-046d-4b0e-8c82-aaafca03b64b admin admin] The token cache is being invalidate because project f8fce73f2a48445dae1c1d067e1bea33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:16.649800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-433c081a-046d-4b0e-8c82-aaafca03b64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:16.651142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-433c081a-046d-4b0e-8c82-aaafca03b64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:16.654639 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1079/2179] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:16 2022] DELETE /identity/v3/projects/f8fce73f2a48445dae1c1d067e1bea33 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:16.664049 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cc8e4-3209-41cd-bb5f-ecb65a22ab3f None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:16.664593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cc8e4-3209-41cd-bb5f-ecb65a22ab3f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:16.665356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cc8e4-3209-41cd-bb5f-ecb65a22ab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:16.688261 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-837cc8e4-3209-41cd-bb5f-ecb65a22ab3f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:16.689538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-837cc8e4-3209-41cd-bb5f-ecb65a22ab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:16.699146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1080/2180] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:16.707184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac7cfa-cf91-40d6-9c56-b3d9d3b9c1bc None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:16.707709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac7cfa-cf91-40d6-9c56-b3d9d3b9c1bc None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:16.707809 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac7cfa-cf91-40d6-9c56-b3d9d3b9c1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:16.736529 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-14ac7cfa-cf91-40d6-9c56-b3d9d3b9c1bc None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:16.737880 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-14ac7cfa-cf91-40d6-9c56-b3d9d3b9c1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:16.747161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1081/2181] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:16.751622 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac7cfa-cf91-40d6-9c56-b3d9d3b9c1bc None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:16.761183 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac7cfa-cf91-40d6-9c56-b3d9d3b9c1bc None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:16.766079 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445d8d-81bf-4005-bacf-ca83370b6897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:16.766725 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445d8d-81bf-4005-bacf-ca83370b6897 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:16.767010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445d8d-81bf-4005-bacf-ca83370b6897 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:16.767287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445d8d-81bf-4005-bacf-ca83370b6897 admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:16.768049 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445d8d-81bf-4005-bacf-ca83370b6897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:59:16.768354 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445d8d-81bf-4005-bacf-ca83370b6897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:16.769978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445d8d-81bf-4005-bacf-ca83370b6897 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:16.784526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1082/2182] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:59:16.790556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445d8d-81bf-4005-bacf-ca83370b6897 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:16.801227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445d8d-81bf-4005-bacf-ca83370b6897 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:16.807290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e3025-118c-4d96-8822-290e51ddec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:16.808010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e3025-118c-4d96-8822-290e51ddec71 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:16.808342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e3025-118c-4d96-8822-290e51ddec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:16.808590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e3025-118c-4d96-8822-290e51ddec71 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:16.809494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e3025-118c-4d96-8822-290e51ddec71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:16.811296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e3025-118c-4d96-8822-290e51ddec71 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:16.941165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2c812c79-0db8-4660-84d6-2e87666d0cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e53dcca0a2c471e91b11ddb7e71faa7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:16.953681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1083/2183] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:16 2022] POST /identity/v3/projects => generated 399 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:16.959532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e3025-118c-4d96-8822-290e51ddec71 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:16.966472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2c812c79-0db8-4660-84d6-2e87666d0cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e53dcca0a2c471e91b11ddb7e71faa7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:16.980494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2c812c79-0db8-4660-84d6-2e87666d0cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e53dcca0a2c471e91b11ddb7e71faa7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:17.073050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2c812c79-0db8-4660-84d6-2e87666d0cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e53dcca0a2c471e91b11ddb7e71faa7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:17.075218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2c812c79-0db8-4660-84d6-2e87666d0cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e53dcca0a2c471e91b11ddb7e71faa7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:17.096785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1101/2184] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:16 2022] DELETE /identity/v3/users/8e53dcca0a2c471e91b11ddb7e71faa7 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:17.102966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42609c37-d5c7-48b1-b246-827a760f2e26 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:17.103464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42609c37-d5c7-48b1-b246-827a760f2e26 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:17.103970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42609c37-d5c7-48b1-b246-827a760f2e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:17.115692 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e3025-118c-4d96-8822-290e51ddec71 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:17.135862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-42609c37-d5c7-48b1-b246-827a760f2e26 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:17.138718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-42609c37-d5c7-48b1-b246-827a760f2e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:17.200962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ce9f4-c3ed-4a4b-aea2-64a233cd9f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:17.201655 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ce9f4-c3ed-4a4b-aea2-64a233cd9f8a admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:17.201937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ce9f4-c3ed-4a4b-aea2-64a233cd9f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:17.202221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ce9f4-c3ed-4a4b-aea2-64a233cd9f8a admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:17.202953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ce9f4-c3ed-4a4b-aea2-64a233cd9f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:17.205006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ce9f4-c3ed-4a4b-aea2-64a233cd9f8a admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:17.256296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1102/2185] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:17.275707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42609c37-d5c7-48b1-b246-827a760f2e26 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:17.277396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-42609c37-d5c7-48b1-b246-827a760f2e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:17.370939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42609c37-d5c7-48b1-b246-827a760f2e26 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:17.377539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d01fd7-560a-4dd1-8047-4b66bfc09b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:17.378222 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d01fd7-560a-4dd1-8047-4b66bfc09b2b service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:17.378504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d01fd7-560a-4dd1-8047-4b66bfc09b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:17.382930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d01fd7-560a-4dd1-8047-4b66bfc09b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:17.383115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1084/2186] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:16 2022] POST /identity/v3/users => generated 300 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:17.384613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ce9f4-c3ed-4a4b-aea2-64a233cd9f8a admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:17.387422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d74ce9f4-c3ed-4a4b-aea2-64a233cd9f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:17.399386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d01fd7-560a-4dd1-8047-4b66bfc09b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:17.401857 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d01fd7-560a-4dd1-8047-4b66bfc09b2b service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:17.413381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ce9f4-c3ed-4a4b-aea2-64a233cd9f8a admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:17.419834 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe3183-7b1c-40d9-9022-5fc4cbb91ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:17.420545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1103/2187] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:59:17.420850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe3183-7b1c-40d9-9022-5fc4cbb91ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:17.421180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe3183-7b1c-40d9-9022-5fc4cbb91ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:17.421499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe3183-7b1c-40d9-9022-5fc4cbb91ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:17.422294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe3183-7b1c-40d9-9022-5fc4cbb91ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:17.424697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe3183-7b1c-40d9-9022-5fc4cbb91ff2 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:17.439244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1085/2188] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:59:17.443478 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d01fd7-560a-4dd1-8047-4b66bfc09b2b service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:17.453588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d01fd7-560a-4dd1-8047-4b66bfc09b2b service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:17.459618 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60866182-9c89-4023-af42-abac1ad60190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:17.460316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60866182-9c89-4023-af42-abac1ad60190 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:17.460651 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60866182-9c89-4023-af42-abac1ad60190 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:17.460932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60866182-9c89-4023-af42-abac1ad60190 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:17.461677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60866182-9c89-4023-af42-abac1ad60190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:17.463381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60866182-9c89-4023-af42-abac1ad60190 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:17.475115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1104/2189] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:17.480234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe3183-7b1c-40d9-9022-5fc4cbb91ff2 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:17.493679 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe3183-7b1c-40d9-9022-5fc4cbb91ff2 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:17.498652 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc08c4-0c0c-4e65-b15a-d879cdf6a359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:17.499629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc08c4-0c0c-4e65-b15a-d879cdf6a359 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:17.499906 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc08c4-0c0c-4e65-b15a-d879cdf6a359 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:17.500182 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc08c4-0c0c-4e65-b15a-d879cdf6a359 admin admin] PATH_INFO: `/v3/projects/dab01194548843a0a2459bc84000b1a0/users/22e90053a12f45478a0ce086df091d8c/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:17.519733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc08c4-0c0c-4e65-b15a-d879cdf6a359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab01194548843a0a2459bc84000b1a0, user_id=22e90053a12f45478a0ce086df091d8c, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:17.522893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc08c4-0c0c-4e65-b15a-d879cdf6a359 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:17.593348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1086/2190] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:17 2022] PUT /identity/v3/projects/dab01194548843a0a2459bc84000b1a0/users/22e90053a12f45478a0ce086df091d8c/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:17.604547 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e7956-c0aa-46a4-bd8b-9162cd5dc95f None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:17.604885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e7956-c0aa-46a4-bd8b-9162cd5dc95f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:17.605170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e7956-c0aa-46a4-bd8b-9162cd5dc95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:17.629503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:17.650281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-953e7956-c0aa-46a4-bd8b-9162cd5dc95f None None] MFA Rules not processed for user `22e90053a12f45478a0ce086df091d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:17.651785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-953e7956-c0aa-46a4-bd8b-9162cd5dc95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:17.745522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1105/2191] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:17.789803 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc08c4-0c0c-4e65-b15a-d879cdf6a359 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:17.792603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-55cc08c4-0c0c-4e65-b15a-d879cdf6a359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:17.868535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc08c4-0c0c-4e65-b15a-d879cdf6a359 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:17.873052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3923d-bcf8-4747-9758-69c2af127e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:17.873809 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3923d-bcf8-4747-9758-69c2af127e45 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:17.874099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3923d-bcf8-4747-9758-69c2af127e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:17.874403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3923d-bcf8-4747-9758-69c2af127e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:17.885348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3923d-bcf8-4747-9758-69c2af127e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:17.886853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3923d-bcf8-4747-9758-69c2af127e45 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:17.898438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1087/2192] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:18.509930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e7956-c0aa-46a4-bd8b-9162cd5dc95f None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:18.512127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-953e7956-c0aa-46a4-bd8b-9162cd5dc95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:18.512541 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f07c42-4ee3-4fb0-82cb-e9a77a36bf7d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:18.512995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f07c42-4ee3-4fb0-82cb-e9a77a36bf7d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:18.513692 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f07c42-4ee3-4fb0-82cb-e9a77a36bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:18.575414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c5f07c42-4ee3-4fb0-82cb-e9a77a36bf7d None None] MFA Rules not processed for user `ae98633baddd4dd19516a1ee4cff0e32`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:18.577631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c5f07c42-4ee3-4fb0-82cb-e9a77a36bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:18.626362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e7956-c0aa-46a4-bd8b-9162cd5dc95f None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:18.632042 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d7889-e025-4952-9f09-6a7530aec8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:18.632960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d7889-e025-4952-9f09-6a7530aec8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:18.633237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d7889-e025-4952-9f09-6a7530aec8de admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:18.639831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d7889-e025-4952-9f09-6a7530aec8de admin admin] PATH_INFO: `/v3/projects/62b84111fcf34b26bd9ad4557c90ce8e` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:18.640754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d7889-e025-4952-9f09-6a7530aec8de admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b84111fcf34b26bd9ad4557c90ce8e)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:18.642923 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d7889-e025-4952-9f09-6a7530aec8de admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:18.660284 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1088/2193] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:18.840905 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-db7d7889-e025-4952-9f09-6a7530aec8de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b84111fcf34b26bd9ad4557c90ce8e', 'request_id': 'req-db7d7889-e025-4952-9f09-6a7530aec8de'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:18.847934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-db7d7889-e025-4952-9f09-6a7530aec8de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b84111fcf34b26bd9ad4557c90ce8e', 'request_id': 'req-db7d7889-e025-4952-9f09-6a7530aec8de'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:18.855317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-db7d7889-e025-4952-9f09-6a7530aec8de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b84111fcf34b26bd9ad4557c90ce8e', 'request_id': 'req-db7d7889-e025-4952-9f09-6a7530aec8de'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:18.872453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f07c42-4ee3-4fb0-82cb-e9a77a36bf7d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:18.874092 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c5f07c42-4ee3-4fb0-82cb-e9a77a36bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:18.892465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f07c42-4ee3-4fb0-82cb-e9a77a36bf7d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:18.949805 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969c74f-f87b-4dd0-9410-a038884c05f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:18.950471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969c74f-f87b-4dd0-9410-a038884c05f3 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:18.950817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969c74f-f87b-4dd0-9410-a038884c05f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:18.951246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969c74f-f87b-4dd0-9410-a038884c05f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:18.999742 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-db7d7889-e025-4952-9f09-6a7530aec8de admin admin] The token cache is being invalidate because project 62b84111fcf34b26bd9ad4557c90ce8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:19.000560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-db7d7889-e025-4952-9f09-6a7530aec8de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:19.001018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-db7d7889-e025-4952-9f09-6a7530aec8de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:19.003561 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1106/2194] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:18 2022] DELETE /identity/v3/projects/62b84111fcf34b26bd9ad4557c90ce8e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:19.010671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b501b7-859b-4e10-91fb-4593883f038d None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:19.011124 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b501b7-859b-4e10-91fb-4593883f038d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:19.011673 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b501b7-859b-4e10-91fb-4593883f038d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:19.025801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969c74f-f87b-4dd0-9410-a038884c05f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:19.031685 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969c74f-f87b-4dd0-9410-a038884c05f3 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:19.036245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f4b501b7-859b-4e10-91fb-4593883f038d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:19.038363 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1089/2195] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:59:19.038531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f4b501b7-859b-4e10-91fb-4593883f038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:19.139347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1107/2196] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:19.144582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb31ed-b17a-499b-afcf-dbb2a395d1cc None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:19.144582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb31ed-b17a-499b-afcf-dbb2a395d1cc None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:19.144582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb31ed-b17a-499b-afcf-dbb2a395d1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:19.168249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-2bbb31ed-b17a-499b-afcf-dbb2a395d1cc None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:19.169729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2bbb31ed-b17a-499b-afcf-dbb2a395d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:19.179365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1090/2197] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:19.183542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b501b7-859b-4e10-91fb-4593883f038d None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:19.196548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b501b7-859b-4e10-91fb-4593883f038d None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:19.203303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc3767-6ee9-47f1-8b27-abb9d505a7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:19.203858 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc3767-6ee9-47f1-8b27-abb9d505a7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:19.204145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc3767-6ee9-47f1-8b27-abb9d505a7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:19.204672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc3767-6ee9-47f1-8b27-abb9d505a7d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:19.205370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc3767-6ee9-47f1-8b27-abb9d505a7d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:59:19.205566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc3767-6ee9-47f1-8b27-abb9d505a7d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:19.207419 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc3767-6ee9-47f1-8b27-abb9d505a7d5 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:19.225649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1108/2198] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 17:59:19.226951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb31ed-b17a-499b-afcf-dbb2a395d1cc None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:19.236992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb31ed-b17a-499b-afcf-dbb2a395d1cc None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:19.242651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf5d30-be1b-40ec-a472-10bdeb23186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:19.243351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf5d30-be1b-40ec-a472-10bdeb23186e admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:19.243661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf5d30-be1b-40ec-a472-10bdeb23186e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:19.243996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf5d30-be1b-40ec-a472-10bdeb23186e admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:19.244741 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf5d30-be1b-40ec-a472-10bdeb23186e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:19.246754 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf5d30-be1b-40ec-a472-10bdeb23186e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:19.253487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:19.406241 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1091/2199] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:19 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:19.408659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc3767-6ee9-47f1-8b27-abb9d505a7d5 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:19.420691 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc3767-6ee9-47f1-8b27-abb9d505a7d5 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:19.504250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae000f79-3a22-4fc9-8033-f5ef53ef8976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:19.504250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae000f79-3a22-4fc9-8033-f5ef53ef8976 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:19.504250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae000f79-3a22-4fc9-8033-f5ef53ef8976 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:19.504250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae000f79-3a22-4fc9-8033-f5ef53ef8976 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:19.505260 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae000f79-3a22-4fc9-8033-f5ef53ef8976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:19.505260 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae000f79-3a22-4fc9-8033-f5ef53ef8976 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:19.643242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1109/2200] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:19 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:19.649930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf5d30-be1b-40ec-a472-10bdeb23186e admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:19.667466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:19.673371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf5d30-be1b-40ec-a472-10bdeb23186e admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:19.678910 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccefc69-76ee-4454-8442-131ba414cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:19.680039 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccefc69-76ee-4454-8442-131ba414cc39 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:19.680572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccefc69-76ee-4454-8442-131ba414cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:19.681190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccefc69-76ee-4454-8442-131ba414cc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:19.682601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccefc69-76ee-4454-8442-131ba414cc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:19.685750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccefc69-76ee-4454-8442-131ba414cc39 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:19.700366 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1092/2201] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:19.708394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae000f79-3a22-4fc9-8033-f5ef53ef8976 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:19.718796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae000f79-3a22-4fc9-8033-f5ef53ef8976 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:19.724255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa3461-f19c-4383-9121-c94c44da876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:19.725289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa3461-f19c-4383-9121-c94c44da876e admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:19.725586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa3461-f19c-4383-9121-c94c44da876e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:19.725878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa3461-f19c-4383-9121-c94c44da876e admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:19.726632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa3461-f19c-4383-9121-c94c44da876e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:19.728274 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa3461-f19c-4383-9121-c94c44da876e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:19.740525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1110/2202] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:19.746962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccefc69-76ee-4454-8442-131ba414cc39 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:19.762539 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccefc69-76ee-4454-8442-131ba414cc39 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:19.767721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d987771-ce37-488f-98af-fefefff6abaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:19.768663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d987771-ce37-488f-98af-fefefff6abaa admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:19.768951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d987771-ce37-488f-98af-fefefff6abaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:19.769227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d987771-ce37-488f-98af-fefefff6abaa admin admin] PATH_INFO: `/v3/projects/27fbc137fe59431dafb01eb0716f8448/users/e12ac4c1e89f4c788d6d38c8f92fa097/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:19.785389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d987771-ce37-488f-98af-fefefff6abaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fbc137fe59431dafb01eb0716f8448, user_id=e12ac4c1e89f4c788d6d38c8f92fa097, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:19.788891 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d987771-ce37-488f-98af-fefefff6abaa admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:19.883075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1093/2203] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:19 2022] PUT /identity/v3/projects/27fbc137fe59431dafb01eb0716f8448/users/e12ac4c1e89f4c788d6d38c8f92fa097/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:19.896235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5621802-e78e-4646-8f18-36601ab68e18 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:19.896678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5621802-e78e-4646-8f18-36601ab68e18 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:19.897085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5621802-e78e-4646-8f18-36601ab68e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:19.934080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a5621802-e78e-4646-8f18-36601ab68e18 None None] MFA Rules not processed for user `e12ac4c1e89f4c788d6d38c8f92fa097`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:19.935360 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a5621802-e78e-4646-8f18-36601ab68e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:20.020105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1111/2204] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:20.025364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d987771-ce37-488f-98af-fefefff6abaa admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:20.099844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d987771-ce37-488f-98af-fefefff6abaa admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:20.105177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f92ce-5047-4a33-936e-036785658a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:20.105894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f92ce-5047-4a33-936e-036785658a11 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:20.106219 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f92ce-5047-4a33-936e-036785658a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:20.106538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f92ce-5047-4a33-936e-036785658a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:20.107360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f92ce-5047-4a33-936e-036785658a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:20.109576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f92ce-5047-4a33-936e-036785658a11 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:20.234767 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1094/2205] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:20 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:20.238992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5621802-e78e-4646-8f18-36601ab68e18 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:20.255342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5621802-e78e-4646-8f18-36601ab68e18 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:20.339964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0634f-864e-4566-96a6-c2a683050543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:20.340457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0634f-864e-4566-96a6-c2a683050543 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:20.340775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0634f-864e-4566-96a6-c2a683050543 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:20.341237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0634f-864e-4566-96a6-c2a683050543 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:20.341770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0634f-864e-4566-96a6-c2a683050543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:20.343715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0634f-864e-4566-96a6-c2a683050543 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:20.386894 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:20.420841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1112/2206] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:20 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:20.425225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f92ce-5047-4a33-936e-036785658a11 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:20.437075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f92ce-5047-4a33-936e-036785658a11 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:20.443137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d32505-c154-4693-898b-be2c1fa2eb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:20.443416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d32505-c154-4693-898b-be2c1fa2eb61 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:20.443705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d32505-c154-4693-898b-be2c1fa2eb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:20.443992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d32505-c154-4693-898b-be2c1fa2eb61 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:20.444818 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d32505-c154-4693-898b-be2c1fa2eb61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:20.446487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d32505-c154-4693-898b-be2c1fa2eb61 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:20.462750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1095/2207] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:20.465357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0634f-864e-4566-96a6-c2a683050543 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:20.476865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0634f-864e-4566-96a6-c2a683050543 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:20.482288 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67b5c8-1d53-4fe1-9255-51150b9e1960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:20.483274 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67b5c8-1d53-4fe1-9255-51150b9e1960 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:20.483274 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67b5c8-1d53-4fe1-9255-51150b9e1960 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:20.483861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67b5c8-1d53-4fe1-9255-51150b9e1960 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:20.484434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67b5c8-1d53-4fe1-9255-51150b9e1960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:20.485878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67b5c8-1d53-4fe1-9255-51150b9e1960 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:20.497605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1113/2208] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:20.502133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d32505-c154-4693-898b-be2c1fa2eb61 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:20.513367 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d32505-c154-4693-898b-be2c1fa2eb61 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:20.518296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477e706-a4f7-42ee-8ea4-858fed9022dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:20.519190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477e706-a4f7-42ee-8ea4-858fed9022dc admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:20.519501 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477e706-a4f7-42ee-8ea4-858fed9022dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:20.519773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477e706-a4f7-42ee-8ea4-858fed9022dc admin admin] PATH_INFO: `/v3/projects/7c6839fa7d324bacaa4e43ce42003e34/users/6b696d01811648be823f15e0e830c073/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:20.538203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477e706-a4f7-42ee-8ea4-858fed9022dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6839fa7d324bacaa4e43ce42003e34, user_id=6b696d01811648be823f15e0e830c073, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:20.541287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477e706-a4f7-42ee-8ea4-858fed9022dc admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:20.649526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1096/2209] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:20 2022] PUT /identity/v3/projects/7c6839fa7d324bacaa4e43ce42003e34/users/6b696d01811648be823f15e0e830c073/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:20.660001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e988437-1dab-4db4-bd5f-722dffc0e503 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:20.660672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e988437-1dab-4db4-bd5f-722dffc0e503 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:20.660672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e988437-1dab-4db4-bd5f-722dffc0e503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:20.693544 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-4e988437-1dab-4db4-bd5f-722dffc0e503 None None] MFA Rules not processed for user `6b696d01811648be823f15e0e830c073`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:20.694971 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4e988437-1dab-4db4-bd5f-722dffc0e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:20.788793 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1114/2210] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:20.793934 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477e706-a4f7-42ee-8ea4-858fed9022dc admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:20.856454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:20.896859 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477e706-a4f7-42ee-8ea4-858fed9022dc admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:20.905253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed34c72-0849-4328-8288-d1e440c6eda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:20.906331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed34c72-0849-4328-8288-d1e440c6eda7 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:20.906800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed34c72-0849-4328-8288-d1e440c6eda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:20.907260 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed34c72-0849-4328-8288-d1e440c6eda7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:20.908047 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed34c72-0849-4328-8288-d1e440c6eda7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:20.910222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed34c72-0849-4328-8288-d1e440c6eda7 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:21.040393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1097/2211] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:20 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:21.047774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e988437-1dab-4db4-bd5f-722dffc0e503 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:21.060970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e988437-1dab-4db4-bd5f-722dffc0e503 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:21.131200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982c3e6-f54c-45c6-8107-ff5d540d5da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:21.135741 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982c3e6-f54c-45c6-8107-ff5d540d5da6 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:21.135741 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982c3e6-f54c-45c6-8107-ff5d540d5da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:21.135741 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982c3e6-f54c-45c6-8107-ff5d540d5da6 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:21.135741 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982c3e6-f54c-45c6-8107-ff5d540d5da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:21.135741 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982c3e6-f54c-45c6-8107-ff5d540d5da6 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:21.273481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1115/2212] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:21 2022] POST /identity/v3/users => generated 299 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:21.277297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed34c72-0849-4328-8288-d1e440c6eda7 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:21.288795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed34c72-0849-4328-8288-d1e440c6eda7 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:21.294421 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0ddbe-803a-4882-983c-963b1e9e6ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:21.295023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ddbe-803a-4882-983c-963b1e9e6ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:21.295300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ddbe-803a-4882-983c-963b1e9e6ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:21.295575 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0ddbe-803a-4882-983c-963b1e9e6ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:21.296322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0ddbe-803a-4882-983c-963b1e9e6ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:21.298030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0ddbe-803a-4882-983c-963b1e9e6ab6 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:21.311889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1098/2213] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:21.315899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982c3e6-f54c-45c6-8107-ff5d540d5da6 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:21.326909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982c3e6-f54c-45c6-8107-ff5d540d5da6 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:21.332079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039216e-0bd8-48f7-bdde-15053617e08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:21.333646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039216e-0bd8-48f7-bdde-15053617e08b admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:21.333926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039216e-0bd8-48f7-bdde-15053617e08b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:21.341187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039216e-0bd8-48f7-bdde-15053617e08b admin admin] PATH_INFO: `/v3/projects/8b1d017476764cd5a0819d9fad63335b/users/b2ed282182174e319d2162382686af51/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:21.352712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039216e-0bd8-48f7-bdde-15053617e08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1d017476764cd5a0819d9fad63335b, user_id=b2ed282182174e319d2162382686af51, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:21.355537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039216e-0bd8-48f7-bdde-15053617e08b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:21.466653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1116/2214] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:21 2022] PUT /identity/v3/projects/8b1d017476764cd5a0819d9fad63335b/users/b2ed282182174e319d2162382686af51/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:21.470723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0ddbe-803a-4882-983c-963b1e9e6ab6 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:21.483705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0ddbe-803a-4882-983c-963b1e9e6ab6 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:21.545014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd354f-de57-423a-be72-e4cf70fee2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:21.545593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd354f-de57-423a-be72-e4cf70fee2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:21.545870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd354f-de57-423a-be72-e4cf70fee2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:21.546142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd354f-de57-423a-be72-e4cf70fee2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:21.546873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd354f-de57-423a-be72-e4cf70fee2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:21.548465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd354f-de57-423a-be72-e4cf70fee2e6 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:21.559025 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1099/2215] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:21.563153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039216e-0bd8-48f7-bdde-15053617e08b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:21.573796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039216e-0bd8-48f7-bdde-15053617e08b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:21.578817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692694c5-53a3-493c-bed3-1286eef7d0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:21.579711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692694c5-53a3-493c-bed3-1286eef7d0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:21.579986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692694c5-53a3-493c-bed3-1286eef7d0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:21.580293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692694c5-53a3-493c-bed3-1286eef7d0ec admin admin] PATH_INFO: `/v3/projects/8b1d017476764cd5a0819d9fad63335b/users/b2ed282182174e319d2162382686af51/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:21.582566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692694c5-53a3-493c-bed3-1286eef7d0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1d017476764cd5a0819d9fad63335b, user_id=b2ed282182174e319d2162382686af51, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:21.586075 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692694c5-53a3-493c-bed3-1286eef7d0ec admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:21.597169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1117/2216] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:21 2022] PUT /identity/v3/projects/8b1d017476764cd5a0819d9fad63335b/users/b2ed282182174e319d2162382686af51/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:21.612289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe66d-0586-42bb-80e6-7ee716461e03 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:21.612617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe66d-0586-42bb-80e6-7ee716461e03 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:21.612899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fe66d-0586-42bb-80e6-7ee716461e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:21.651931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-403fe66d-0586-42bb-80e6-7ee716461e03 None None] MFA Rules not processed for user `b2ed282182174e319d2162382686af51`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:21.653575 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-403fe66d-0586-42bb-80e6-7ee716461e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:21.729831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1100/2217] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:21.742334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692694c5-53a3-493c-bed3-1286eef7d0ec admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:21.744296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-692694c5-53a3-493c-bed3-1286eef7d0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:21.814392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692694c5-53a3-493c-bed3-1286eef7d0ec admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:21.819361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3df52e-96c8-43ce-a382-f7a0a5e3c3d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:21.822181 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3df52e-96c8-43ce-a382-f7a0a5e3c3d4 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:21.822181 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3df52e-96c8-43ce-a382-f7a0a5e3c3d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:21.822181 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3df52e-96c8-43ce-a382-f7a0a5e3c3d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:21.882522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3df52e-96c8-43ce-a382-f7a0a5e3c3d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:21.883962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3df52e-96c8-43ce-a382-f7a0a5e3c3d4 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:21.894554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1118/2218] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:22.095367 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d4ff4-4bc2-4b30-bfca-e41a34e65297 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:22.095367 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d4ff4-4bc2-4b30-bfca-e41a34e65297 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:22.095367 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d4ff4-4bc2-4b30-bfca-e41a34e65297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:22.117213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-5f4d4ff4-4bc2-4b30-bfca-e41a34e65297 None None] MFA Rules not processed for user `ae98633baddd4dd19516a1ee4cff0e32`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:22.118467 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5f4d4ff4-4bc2-4b30-bfca-e41a34e65297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:22.198577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1101/2219] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:22.774832 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:23.369619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:25.141893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:25.203380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3df52e-96c8-43ce-a382-f7a0a5e3c3d4 service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:25.215169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3df52e-96c8-43ce-a382-f7a0a5e3c3d4 service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:25.219512 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644fe47-076a-4975-a2e2-41039c6cb037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:25.220329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644fe47-076a-4975-a2e2-41039c6cb037 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:25.220804 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644fe47-076a-4975-a2e2-41039c6cb037 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:25.221086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644fe47-076a-4975-a2e2-41039c6cb037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:25.290665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644fe47-076a-4975-a2e2-41039c6cb037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:25.292223 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644fe47-076a-4975-a2e2-41039c6cb037 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:25.302710 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1119/2220] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:25.506110 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:26.148568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d4ff4-4bc2-4b30-bfca-e41a34e65297 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:26.150010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5f4d4ff4-4bc2-4b30-bfca-e41a34e65297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:26.236103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d4ff4-4bc2-4b30-bfca-e41a34e65297 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:26.241625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:26.242525 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:26.242801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:26.243078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] PATH_INFO: `/v3/users/22e90053a12f45478a0ce086df091d8c` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:26.244260 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e90053a12f45478a0ce086df091d8c)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:26.246270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:26.607385 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e90053a12f45478a0ce086df091d8c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:26.622772 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e90053a12f45478a0ce086df091d8c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:26.630629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e90053a12f45478a0ce086df091d8c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:26.826601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e90053a12f45478a0ce086df091d8c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:26.829587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e90053a12f45478a0ce086df091d8c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:26.844987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1102/2221] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:26 2022] DELETE /identity/v3/users/22e90053a12f45478a0ce086df091d8c => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:26.853362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8f23-08cd-41d7-8fdb-630e381a3372 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:26.854267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8f23-08cd-41d7-8fdb-630e381a3372 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:26.854267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8f23-08cd-41d7-8fdb-630e381a3372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:26.890682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-617f8f23-08cd-41d7-8fdb-630e381a3372 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:26.892450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-617f8f23-08cd-41d7-8fdb-630e381a3372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:26.964752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1120/2222] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:26.977393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:26.981240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:27.057532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdccfbb-b34e-4840-a970-aeb266c28ea2 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:27.063991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e9e42-37a5-461e-a17e-6254ef3ba4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:27.065231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9e42-37a5-461e-a17e-6254ef3ba4df service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:27.065754 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9e42-37a5-461e-a17e-6254ef3ba4df service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:27.066454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9e42-37a5-461e-a17e-6254ef3ba4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:27.083597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e9e42-37a5-461e-a17e-6254ef3ba4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:27.086605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e9e42-37a5-461e-a17e-6254ef3ba4df service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:27.106601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1103/2223] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:27.774957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f8f23-08cd-41d7-8fdb-630e381a3372 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:27.776383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-617f8f23-08cd-41d7-8fdb-630e381a3372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:27.792072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f8f23-08cd-41d7-8fdb-630e381a3372 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:27.797295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:27.798304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:27.798691 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:27.799072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31 admin admin] PATH_INFO: `/v3/projects/dab01194548843a0a2459bc84000b1a0` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:27.800841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab01194548843a0a2459bc84000b1a0)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:27.803127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:27.961734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab01194548843a0a2459bc84000b1a0', 'request_id': 'req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:27.969196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab01194548843a0a2459bc84000b1a0', 'request_id': 'req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:27.978080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab01194548843a0a2459bc84000b1a0', 'request_id': 'req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:28.087366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:28.097778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31 admin admin] The token cache is being invalidate because project dab01194548843a0a2459bc84000b1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:28.100329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:28.101600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b127cfc0-54e3-4c8d-a2b9-f4f93cb73a31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:28.108458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e9e42-37a5-461e-a17e-6254ef3ba4df service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:28.109174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1121/2224] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:27 2022] DELETE /identity/v3/projects/dab01194548843a0a2459bc84000b1a0 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:28.111021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-7d5e9e42-37a5-461e-a17e-6254ef3ba4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:28.111827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d59e1-b0c5-4337-85d4-7ec67c2e7f50 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:28.112309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d59e1-b0c5-4337-85d4-7ec67c2e7f50 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:28.114852 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d59e1-b0c5-4337-85d4-7ec67c2e7f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:28.139982 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f34d59e1-b0c5-4337-85d4-7ec67c2e7f50 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:28.141413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f34d59e1-b0c5-4337-85d4-7ec67c2e7f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:28.211122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e9e42-37a5-461e-a17e-6254ef3ba4df service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:28.218188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1122/2225] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:28.228787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcf8fc-a7f8-484d-9eed-7411ca928d00 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:28.229084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcf8fc-a7f8-484d-9eed-7411ca928d00 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:28.229371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcf8fc-a7f8-484d-9eed-7411ca928d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:28.253397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e1bcf8fc-a7f8-484d-9eed-7411ca928d00 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:28.255305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e1bcf8fc-a7f8-484d-9eed-7411ca928d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:28.263888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1123/2226] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:28.268458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcf8fc-a7f8-484d-9eed-7411ca928d00 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:28.278582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcf8fc-a7f8-484d-9eed-7411ca928d00 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:28.299727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92a6bf-6f3b-4e43-82fd-0934d68bfb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:28.301533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92a6bf-6f3b-4e43-82fd-0934d68bfb51 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:28.302797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92a6bf-6f3b-4e43-82fd-0934d68bfb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:28.304105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92a6bf-6f3b-4e43-82fd-0934d68bfb51 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:28.306455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92a6bf-6f3b-4e43-82fd-0934d68bfb51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:59:28.306878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92a6bf-6f3b-4e43-82fd-0934d68bfb51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:28.308059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86076e5b-b545-47fd-b416-c40e7af09326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:28.308766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86076e5b-b545-47fd-b416-c40e7af09326 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:28.308937 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92a6bf-6f3b-4e43-82fd-0934d68bfb51 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:28.309104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86076e5b-b545-47fd-b416-c40e7af09326 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:28.309380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86076e5b-b545-47fd-b416-c40e7af09326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:28.315173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-86076e5b-b545-47fd-b416-c40e7af09326 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:28.335120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1124/2227] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:59:28.337538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92a6bf-6f3b-4e43-82fd-0934d68bfb51 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:28.351888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92a6bf-6f3b-4e43-82fd-0934d68bfb51 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:28.359807 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0318ca1-04ef-4675-b649-4790ee21ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:28.360663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0318ca1-04ef-4675-b649-4790ee21ada5 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:28.361027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0318ca1-04ef-4675-b649-4790ee21ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:28.361306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0318ca1-04ef-4675-b649-4790ee21ada5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:28.362025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0318ca1-04ef-4675-b649-4790ee21ada5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:28.364019 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0318ca1-04ef-4675-b649-4790ee21ada5 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:28.385987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:28.429855 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86076e5b-b545-47fd-b416-c40e7af09326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:28.432177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86076e5b-b545-47fd-b416-c40e7af09326 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:28.453744 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1104/2228] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:59:28.545016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1125/2229] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:28 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:28.552669 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86076e5b-b545-47fd-b416-c40e7af09326 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:28.574500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86076e5b-b545-47fd-b416-c40e7af09326 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:28.655508 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eefdfa-b1df-4f85-a811-af0327619014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:28.656204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eefdfa-b1df-4f85-a811-af0327619014 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:28.656506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eefdfa-b1df-4f85-a811-af0327619014 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:28.656851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eefdfa-b1df-4f85-a811-af0327619014 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:28.657616 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eefdfa-b1df-4f85-a811-af0327619014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:28.660261 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eefdfa-b1df-4f85-a811-af0327619014 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:28.810438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1105/2230] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:28 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:28.812707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0318ca1-04ef-4675-b649-4790ee21ada5 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:28.848689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0318ca1-04ef-4675-b649-4790ee21ada5 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:28.848689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db2b26-d976-4efb-b25e-24ddb698823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:28.848689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db2b26-d976-4efb-b25e-24ddb698823f admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:28.848689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db2b26-d976-4efb-b25e-24ddb698823f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:28.849305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db2b26-d976-4efb-b25e-24ddb698823f admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:28.849305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db2b26-d976-4efb-b25e-24ddb698823f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:28.849305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db2b26-d976-4efb-b25e-24ddb698823f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:28.860505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1126/2231] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:28.869123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eefdfa-b1df-4f85-a811-af0327619014 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:28.888688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eefdfa-b1df-4f85-a811-af0327619014 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:28.896676 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafa412-9763-4267-9670-56759cfd8ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:28.897843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafa412-9763-4267-9670-56759cfd8ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:28.898304 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafa412-9763-4267-9670-56759cfd8ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:28.898814 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafa412-9763-4267-9670-56759cfd8ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:28.900234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafa412-9763-4267-9670-56759cfd8ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:28.903605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafa412-9763-4267-9670-56759cfd8ca4 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:28.922524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1106/2232] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:28.929941 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db2b26-d976-4efb-b25e-24ddb698823f admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:28.954823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db2b26-d976-4efb-b25e-24ddb698823f admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:28.960192 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f788f-de25-449d-a0a0-50b0dcfda853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:28.961296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f788f-de25-449d-a0a0-50b0dcfda853 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:28.961635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f788f-de25-449d-a0a0-50b0dcfda853 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:28.961979 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f788f-de25-449d-a0a0-50b0dcfda853 admin admin] PATH_INFO: `/v3/projects/deb33eae0aa34330888eee1fbf9bdd96/users/29a8fcba54e345f197b129dbdb7a3fef/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:28.979912 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f788f-de25-449d-a0a0-50b0dcfda853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb33eae0aa34330888eee1fbf9bdd96, user_id=29a8fcba54e345f197b129dbdb7a3fef, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:28.982608 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f788f-de25-449d-a0a0-50b0dcfda853 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:29.103526 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1127/2233] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:28 2022] PUT /identity/v3/projects/deb33eae0aa34330888eee1fbf9bdd96/users/29a8fcba54e345f197b129dbdb7a3fef/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:29.110681 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6ed2-6ff4-4a2f-a7e5-d98f23103f4c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:29.111519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6ed2-6ff4-4a2f-a7e5-d98f23103f4c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:29.111519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6ed2-6ff4-4a2f-a7e5-d98f23103f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:29.140398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-8b0b6ed2-6ff4-4a2f-a7e5-d98f23103f4c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:29.142670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8b0b6ed2-6ff4-4a2f-a7e5-d98f23103f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:29.220615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1107/2234] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:29.237901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f788f-de25-449d-a0a0-50b0dcfda853 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:29.248963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-235f788f-de25-449d-a0a0-50b0dcfda853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:29.403810 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f788f-de25-449d-a0a0-50b0dcfda853 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:29.408536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79ab31-8477-4e7d-907c-af3436154724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:29.409237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79ab31-8477-4e7d-907c-af3436154724 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:29.412007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79ab31-8477-4e7d-907c-af3436154724 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:29.412007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79ab31-8477-4e7d-907c-af3436154724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:29.430635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79ab31-8477-4e7d-907c-af3436154724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:29.437294 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79ab31-8477-4e7d-907c-af3436154724 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:29.449533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1128/2235] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:30.034570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:30.639296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:32.267759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:32.492409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96bf44-076f-4266-8aa2-a5b33cad4bd7 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:32.492982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96bf44-076f-4266-8aa2-a5b33cad4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:32.493494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96bf44-076f-4266-8aa2-a5b33cad4bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:32.529032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-cb96bf44-076f-4266-8aa2-a5b33cad4bd7 None None] MFA Rules not processed for user `fed263f071864582ba96d79f75fbfb36`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:32.531316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-cb96bf44-076f-4266-8aa2-a5b33cad4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:32.666078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1108/2236] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:34.295672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:34.722313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:35.032908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79ab31-8477-4e7d-907c-af3436154724 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:35.035539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3c79ab31-8477-4e7d-907c-af3436154724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:35.071292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79ab31-8477-4e7d-907c-af3436154724 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:35.083870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:35.085616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:35.085916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:35.086201 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] PATH_INFO: `/v3/users/47a22ccbb4c940eca9545b9fdbd894a9` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:35.089634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a22ccbb4c940eca9545b9fdbd894a9)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:35.092371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:35.440777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a22ccbb4c940eca9545b9fdbd894a9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:35.475258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a22ccbb4c940eca9545b9fdbd894a9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:35.489439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a22ccbb4c940eca9545b9fdbd894a9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:35.643778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a22ccbb4c940eca9545b9fdbd894a9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:35.646771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a22ccbb4c940eca9545b9fdbd894a9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:35.673783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1129/2237] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:35 2022] DELETE /identity/v3/users/47a22ccbb4c940eca9545b9fdbd894a9 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:35.680316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dabfd-884a-4a33-a676-131358a0ab55 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:35.680845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dabfd-884a-4a33-a676-131358a0ab55 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:35.681351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dabfd-884a-4a33-a676-131358a0ab55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:35.724835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-524dabfd-884a-4a33-a676-131358a0ab55 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:35.727245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-524dabfd-884a-4a33-a676-131358a0ab55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:35.823555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:35.826120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:36.047269 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1109/2238] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:36.054114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dabfd-884a-4a33-a676-131358a0ab55 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:36.059081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-524dabfd-884a-4a33-a676-131358a0ab55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:36.075606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154c3b-2726-4ac5-a9eb-d8ac938ce634 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:36.088702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:36.090031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:36.090575 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:36.091069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] PATH_INFO: `/v3/users/e12ac4c1e89f4c788d6d38c8f92fa097` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:36.093379 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12ac4c1e89f4c788d6d38c8f92fa097)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:36.096198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:36.187902 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dabfd-884a-4a33-a676-131358a0ab55 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:36.224243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70656d51-611b-4469-a84c-bad355e0a4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:36.224953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70656d51-611b-4469-a84c-bad355e0a4fb service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:36.225523 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70656d51-611b-4469-a84c-bad355e0a4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:36.226023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70656d51-611b-4469-a84c-bad355e0a4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:36.242612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70656d51-611b-4469-a84c-bad355e0a4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:36.244629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70656d51-611b-4469-a84c-bad355e0a4fb service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:36.258646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1110/2239] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:59:36.483840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12ac4c1e89f4c788d6d38c8f92fa097'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:36.521864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12ac4c1e89f4c788d6d38c8f92fa097'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:36.532393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12ac4c1e89f4c788d6d38c8f92fa097'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:36.614628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12ac4c1e89f4c788d6d38c8f92fa097'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:36.616230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12ac4c1e89f4c788d6d38c8f92fa097'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:36.643812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1130/2240] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:35 2022] DELETE /identity/v3/users/e12ac4c1e89f4c788d6d38c8f92fa097 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:36.646414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834b847-b3a9-423c-8e75-9f28c3a24c1d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:36.646707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834b847-b3a9-423c-8e75-9f28c3a24c1d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:36.646967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834b847-b3a9-423c-8e75-9f28c3a24c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:36.688038 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-2834b847-b3a9-423c-8e75-9f28c3a24c1d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:36.689429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2834b847-b3a9-423c-8e75-9f28c3a24c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:36.863487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1111/2241] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:36.881388 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:36.883154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:37.015393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e2b61-df6d-4783-8e2b-c45871ff70bd admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:37.021184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eea827-4e12-466c-8170-9e60bd40fa7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:37.022171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eea827-4e12-466c-8170-9e60bd40fa7f service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:37.022818 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eea827-4e12-466c-8170-9e60bd40fa7f service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:37.023542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eea827-4e12-466c-8170-9e60bd40fa7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:37.045380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eea827-4e12-466c-8170-9e60bd40fa7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:37.045380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eea827-4e12-466c-8170-9e60bd40fa7f service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:37.057483 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1131/2242] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:59:37.158973 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834b847-b3a9-423c-8e75-9f28c3a24c1d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:37.161536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2834b847-b3a9-423c-8e75-9f28c3a24c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:37.194936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834b847-b3a9-423c-8e75-9f28c3a24c1d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:37.205028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:37.206069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:37.206235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:37.206467 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] PATH_INFO: `/v3/projects/25389f415ace49948bbebbde1c204f67` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:37.212602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] RBAC: Authorizing `identity:delete_project(project_id=25389f415ace49948bbebbde1c204f67)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:37.214724 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:37.426782 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25389f415ace49948bbebbde1c204f67', 'request_id': 'req-7636f8e5-db2c-4460-bee7-87d1bef8272f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:37.436951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25389f415ace49948bbebbde1c204f67', 'request_id': 'req-7636f8e5-db2c-4460-bee7-87d1bef8272f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:37.564944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25389f415ace49948bbebbde1c204f67', 'request_id': 'req-7636f8e5-db2c-4460-bee7-87d1bef8272f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:37.606326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] The token cache is being invalidate because project 25389f415ace49948bbebbde1c204f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:37.606832 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:37.608119 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:37.615163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1112/2243] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:37 2022] DELETE /identity/v3/projects/25389f415ace49948bbebbde1c204f67 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:37.617947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eea827-4e12-466c-8170-9e60bd40fa7f service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:37.640682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eea827-4e12-466c-8170-9e60bd40fa7f service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:37.806981 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:37.809062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:37.809645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:37.810331 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] PATH_INFO: `/v3/users/8c0d5cbcdde54217983665c2bc331930` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:37.813251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0d5cbcdde54217983665c2bc331930)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:37.818258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:37.882688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:37.886106 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:37.921173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636f8e5-db2c-4460-bee7-87d1bef8272f admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:37.932216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:37.945578 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:37.946400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:37.949036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] PATH_INFO: `/v3/projects/27fbc137fe59431dafb01eb0716f8448` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:37.952339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27fbc137fe59431dafb01eb0716f8448)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:37.957609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:38.044276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0d5cbcdde54217983665c2bc331930'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:38.076739 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0d5cbcdde54217983665c2bc331930'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:38.096374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0d5cbcdde54217983665c2bc331930'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:38.196987 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0d5cbcdde54217983665c2bc331930'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:38.198001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0d5cbcdde54217983665c2bc331930'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:38.209987 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1132/2244] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:37 2022] DELETE /identity/v3/users/8c0d5cbcdde54217983665c2bc331930 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:38.247436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27fbc137fe59431dafb01eb0716f8448', 'request_id': 'req-95327c1d-b859-4ee5-a383-c33a73655349'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:38.272709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27fbc137fe59431dafb01eb0716f8448', 'request_id': 'req-95327c1d-b859-4ee5-a383-c33a73655349'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:38.396448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27fbc137fe59431dafb01eb0716f8448', 'request_id': 'req-95327c1d-b859-4ee5-a383-c33a73655349'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:38.421555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] The token cache is being invalidate because project 27fbc137fe59431dafb01eb0716f8448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:38.427441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:38.430146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:38.456134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1113/2245] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:37 2022] DELETE /identity/v3/projects/27fbc137fe59431dafb01eb0716f8448 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:38.456285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:38.456285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:38.629025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b21a2-53ae-44a3-89a2-ca5c5ed6dae2 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:38.636568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaee267-57f0-46b1-82e2-db38c0107a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:38.638064 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaee267-57f0-46b1-82e2-db38c0107a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:38.638340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaee267-57f0-46b1-82e2-db38c0107a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:38.638614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaee267-57f0-46b1-82e2-db38c0107a56 admin admin] PATH_INFO: `/v3/users/6b696d01811648be823f15e0e830c073` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:38.640001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaee267-57f0-46b1-82e2-db38c0107a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b696d01811648be823f15e0e830c073)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:38.643613 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaee267-57f0-46b1-82e2-db38c0107a56 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:38.662499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:38.945339 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-dbaee267-57f0-46b1-82e2-db38c0107a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b696d01811648be823f15e0e830c073'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:38.969518 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-dbaee267-57f0-46b1-82e2-db38c0107a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b696d01811648be823f15e0e830c073'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:39.000510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-dbaee267-57f0-46b1-82e2-db38c0107a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b696d01811648be823f15e0e830c073'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:39.155106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-dbaee267-57f0-46b1-82e2-db38c0107a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b696d01811648be823f15e0e830c073'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:39.156578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-dbaee267-57f0-46b1-82e2-db38c0107a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b696d01811648be823f15e0e830c073'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:39.180708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1133/2246] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:38 2022] DELETE /identity/v3/users/6b696d01811648be823f15e0e830c073 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:39.342218 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:39.361715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:39.365871 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:39.592590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95327c1d-b859-4ee5-a383-c33a73655349 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:39.854670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:39.856323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:39.856646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:39.857138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef admin admin] PATH_INFO: `/v3/projects/dbbdbd23ac38443299e97530ec7d3064` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:39.865162 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbbdbd23ac38443299e97530ec7d3064)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:39.870623 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:40.088557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbbdbd23ac38443299e97530ec7d3064', 'request_id': 'req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:40.108528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbbdbd23ac38443299e97530ec7d3064', 'request_id': 'req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:40.220907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbbdbd23ac38443299e97530ec7d3064', 'request_id': 'req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:40.244016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef admin admin] The token cache is being invalidate because project dbbdbd23ac38443299e97530ec7d3064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:40.244571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:40.245979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f020fdf3-fcb0-4479-8056-4fab4b2f11ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:40.248696 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1114/2247] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:39 2022] DELETE /identity/v3/projects/dbbdbd23ac38443299e97530ec7d3064 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:40.256875 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d945dd-3437-49d9-b7ba-c5acc434eaed None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:40.257619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d945dd-3437-49d9-b7ba-c5acc434eaed None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:40.257844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d945dd-3437-49d9-b7ba-c5acc434eaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:40.295098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-23d945dd-3437-49d9-b7ba-c5acc434eaed None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:40.297202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-23d945dd-3437-49d9-b7ba-c5acc434eaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:40.419547 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1134/2248] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:40.424175 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbcf93-79a3-4de4-a278-0bf36e7ccf4a None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:40.425043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbcf93-79a3-4de4-a278-0bf36e7ccf4a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:40.425180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbcf93-79a3-4de4-a278-0bf36e7ccf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:40.462185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-6edbcf93-79a3-4de4-a278-0bf36e7ccf4a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:40.464893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6edbcf93-79a3-4de4-a278-0bf36e7ccf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:40.481040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1115/2249] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:40.487618 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d945dd-3437-49d9-b7ba-c5acc434eaed None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:40.513365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d945dd-3437-49d9-b7ba-c5acc434eaed None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:40.525203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28696b1f-3f0f-42c5-b92b-75903363961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:40.527033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28696b1f-3f0f-42c5-b92b-75903363961c admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:40.527898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28696b1f-3f0f-42c5-b92b-75903363961c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:40.530367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28696b1f-3f0f-42c5-b92b-75903363961c admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:40.532181 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28696b1f-3f0f-42c5-b92b-75903363961c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:59:40.534418 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28696b1f-3f0f-42c5-b92b-75903363961c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:40.540277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28696b1f-3f0f-42c5-b92b-75903363961c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:40.594920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b64b46-9474-4184-91d1-105d1e7abce4 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:40.594920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b64b46-9474-4184-91d1-105d1e7abce4 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:40.594920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b64b46-9474-4184-91d1-105d1e7abce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:40.640511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1135/2250] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:59:40.646257 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28696b1f-3f0f-42c5-b92b-75903363961c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:40.703024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28696b1f-3f0f-42c5-b92b-75903363961c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:40.727278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43c72-d860-4339-84a4-af657e91fb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:40.731785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43c72-d860-4339-84a4-af657e91fb66 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:40.732926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43c72-d860-4339-84a4-af657e91fb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:40.732926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43c72-d860-4339-84a4-af657e91fb66 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:40.733705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a43c72-d860-4339-84a4-af657e91fb66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:40.742628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a43c72-d860-4339-84a4-af657e91fb66 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:40.762630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-a1b64b46-9474-4184-91d1-105d1e7abce4 None None] MFA Rules not processed for user `29a8fcba54e345f197b129dbdb7a3fef`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:40.764937 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a1b64b46-9474-4184-91d1-105d1e7abce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:40.980247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1136/2251] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:40 2022] POST /identity/v3/projects => generated 379 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:40.980247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43c72-d860-4339-84a4-af657e91fb66 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:40.984390 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-24a43c72-d860-4339-84a4-af657e91fb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:41.008740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1116/2252] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:41.010664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b64b46-9474-4184-91d1-105d1e7abce4 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:41.043669 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b64b46-9474-4184-91d1-105d1e7abce4 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:41.193483 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43c72-d860-4339-84a4-af657e91fb66 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:41.209771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:41.210944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:41.211238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:41.211522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] PATH_INFO: `/v3/projects/7c6839fa7d324bacaa4e43ce42003e34` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:41.215566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6839fa7d324bacaa4e43ce42003e34)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:41.218860 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:41.292230 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8667-19a0-4db8-95b6-1d0af01ba475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:41.293370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8667-19a0-4db8-95b6-1d0af01ba475 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:41.293871 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8667-19a0-4db8-95b6-1d0af01ba475 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:41.294449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8667-19a0-4db8-95b6-1d0af01ba475 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:41.297688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8667-19a0-4db8-95b6-1d0af01ba475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:41.298987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8667-19a0-4db8-95b6-1d0af01ba475 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:41.484999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6839fa7d324bacaa4e43ce42003e34', 'request_id': 'req-1c818d51-7498-4e80-a247-3f0b649139f2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:41.492601 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6839fa7d324bacaa4e43ce42003e34', 'request_id': 'req-1c818d51-7498-4e80-a247-3f0b649139f2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:41.499482 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6839fa7d324bacaa4e43ce42003e34', 'request_id': 'req-1c818d51-7498-4e80-a247-3f0b649139f2'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:41.595245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1117/2253] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:41 2022] POST /identity/v3/users => generated 290 bytes in 581 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:41.595245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8667-19a0-4db8-95b6-1d0af01ba475 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:41.595245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bc1a8667-19a0-4db8-95b6-1d0af01ba475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:41.620181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8667-19a0-4db8-95b6-1d0af01ba475 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:41.639702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] The token cache is being invalidate because project 7c6839fa7d324bacaa4e43ce42003e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:41.643183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:41.647656 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:41.653666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1137/2254] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:40 2022] DELETE /identity/v3/projects/7c6839fa7d324bacaa4e43ce42003e34 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:41.656279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:41.674362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:41.744733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be3732-9965-4399-ac94-56552d7ed2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:41.746580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be3732-9965-4399-ac94-56552d7ed2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:41.747318 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be3732-9965-4399-ac94-56552d7ed2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:41.748008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be3732-9965-4399-ac94-56552d7ed2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:41.749904 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be3732-9965-4399-ac94-56552d7ed2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:41.755587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be3732-9965-4399-ac94-56552d7ed2b6 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:41.860450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818d51-7498-4e80-a247-3f0b649139f2 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:41.869082 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e027e-2af5-488d-868c-93cc87f72149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:41.869874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e027e-2af5-488d-868c-93cc87f72149 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:41.871513 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e027e-2af5-488d-868c-93cc87f72149 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:41.871885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e027e-2af5-488d-868c-93cc87f72149 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:41.872762 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e027e-2af5-488d-868c-93cc87f72149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:41.874623 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e027e-2af5-488d-868c-93cc87f72149 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:41.899478 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1138/2255] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:41.900568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e027e-2af5-488d-868c-93cc87f72149 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:41.903392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-955e027e-2af5-488d-868c-93cc87f72149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:41.927437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e027e-2af5-488d-868c-93cc87f72149 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:41.940587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1118/2256] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:41 2022] POST /identity/v3/projects => generated 373 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:41.940899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:41.941083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be3732-9965-4399-ac94-56552d7ed2b6 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:41.941759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:41.941759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:41.941759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] PATH_INFO: `/v3/users/b2ed282182174e319d2162382686af51` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:41.943462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2ed282182174e319d2162382686af51)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:41.945750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:42.120797 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be3732-9965-4399-ac94-56552d7ed2b6 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:42.133531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86150f10-03ac-4c80-972c-909ac38ddf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:42.134729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86150f10-03ac-4c80-972c-909ac38ddf85 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:42.135268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86150f10-03ac-4c80-972c-909ac38ddf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:42.135762 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86150f10-03ac-4c80-972c-909ac38ddf85 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:42.136984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86150f10-03ac-4c80-972c-909ac38ddf85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:42.138989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86150f10-03ac-4c80-972c-909ac38ddf85 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:42.156652 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1119/2257] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:42.157724 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86150f10-03ac-4c80-972c-909ac38ddf85 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:42.161938 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-86150f10-03ac-4c80-972c-909ac38ddf85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:42.204942 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86150f10-03ac-4c80-972c-909ac38ddf85 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:42.216798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44cefa-ccd6-4040-ad38-c121610faba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:42.217596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44cefa-ccd6-4040-ad38-c121610faba6 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:42.217884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44cefa-ccd6-4040-ad38-c121610faba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:42.218170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44cefa-ccd6-4040-ad38-c121610faba6 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:42.219133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44cefa-ccd6-4040-ad38-c121610faba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:42.222882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44cefa-ccd6-4040-ad38-c121610faba6 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:42.252977 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2ed282182174e319d2162382686af51'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:42.273382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2ed282182174e319d2162382686af51'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:42.282477 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2ed282182174e319d2162382686af51'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:42.375627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1120/2258] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:42 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:42.377335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44cefa-ccd6-4040-ad38-c121610faba6 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:42.419094 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2ed282182174e319d2162382686af51'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:42.420410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2ed282182174e319d2162382686af51'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:42.431319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1139/2259] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:41 2022] DELETE /identity/v3/users/b2ed282182174e319d2162382686af51 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:42.437895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44cefa-ccd6-4040-ad38-c121610faba6 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:42.440080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:42.443463 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:42.610600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:42.618620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679788c2-f69c-445b-b9cd-d25935d25688 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:42.638363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577bf31-3721-424f-9474-d11c243d6802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:42.640777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577bf31-3721-424f-9474-d11c243d6802 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:42.640777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577bf31-3721-424f-9474-d11c243d6802 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:42.640777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577bf31-3721-424f-9474-d11c243d6802 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:42.641884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577bf31-3721-424f-9474-d11c243d6802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:42.652307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577bf31-3721-424f-9474-d11c243d6802 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:42.696979 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1140/2260] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:42.706205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577bf31-3721-424f-9474-d11c243d6802 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:42.716926 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb98883-3eb7-4afe-8555-9f8c5324af94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:42.718600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98883-3eb7-4afe-8555-9f8c5324af94 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:42.719077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98883-3eb7-4afe-8555-9f8c5324af94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:42.719499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98883-3eb7-4afe-8555-9f8c5324af94 admin admin] PATH_INFO: `/v3/projects/f91616d79b444744880a3981efc0f08c/users/473b37cd87a3449ebf64a9e988d4acea/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:42.767888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577bf31-3721-424f-9474-d11c243d6802 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:42.788016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378e93a-0b9b-43db-b9a6-3f210f51b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:42.790112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378e93a-0b9b-43db-b9a6-3f210f51b2fa admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:42.790490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378e93a-0b9b-43db-b9a6-3f210f51b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:42.792619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378e93a-0b9b-43db-b9a6-3f210f51b2fa admin admin] PATH_INFO: `/v3/projects/93bf2155672641dfa2fb7366b4fb2b68/users/18b745270c324cc48bbe1b4b68bad566/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:42.809856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb98883-3eb7-4afe-8555-9f8c5324af94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91616d79b444744880a3981efc0f08c, user_id=473b37cd87a3449ebf64a9e988d4acea, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:42.817446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb98883-3eb7-4afe-8555-9f8c5324af94 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:42.832841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378e93a-0b9b-43db-b9a6-3f210f51b2fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=93bf2155672641dfa2fb7366b4fb2b68, user_id=18b745270c324cc48bbe1b4b68bad566, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:42.839776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378e93a-0b9b-43db-b9a6-3f210f51b2fa admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:42.901702 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:42.916830 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1121/2261] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:42 2022] PUT /identity/v3/projects/f91616d79b444744880a3981efc0f08c/users/473b37cd87a3449ebf64a9e988d4acea/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:42.928462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033df0-af62-4cc2-b4cd-9359dcf3ee7e None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:42.928923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033df0-af62-4cc2-b4cd-9359dcf3ee7e None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:42.929382 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033df0-af62-4cc2-b4cd-9359dcf3ee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:43.012800 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1141/2262] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:42 2022] PUT /identity/v3/projects/93bf2155672641dfa2fb7366b4fb2b68/users/18b745270c324cc48bbe1b4b68bad566/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:43.026254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378e93a-0b9b-43db-b9a6-3f210f51b2fa admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:43.055609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-8d033df0-af62-4cc2-b4cd-9359dcf3ee7e None None] MFA Rules not processed for user `473b37cd87a3449ebf64a9e988d4acea`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:43.060622 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8d033df0-af62-4cc2-b4cd-9359dcf3ee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:43.309586 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1122/2263] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:43.314413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d033df0-af62-4cc2-b4cd-9359dcf3ee7e None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:43.321831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8d033df0-af62-4cc2-b4cd-9359dcf3ee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:43.322539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378e93a-0b9b-43db-b9a6-3f210f51b2fa admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:43.339352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e98fbd-de98-4146-ba5c-8facec717a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:43.343841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e98fbd-de98-4146-ba5c-8facec717a11 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:43.343841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e98fbd-de98-4146-ba5c-8facec717a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:43.343841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e98fbd-de98-4146-ba5c-8facec717a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:43.343841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e98fbd-de98-4146-ba5c-8facec717a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:43.343841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e98fbd-de98-4146-ba5c-8facec717a11 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:43.353682 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d033df0-af62-4cc2-b4cd-9359dcf3ee7e None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:43.366433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9c049-b0f0-4f75-8dac-4f7cfba6a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:43.367875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9c049-b0f0-4f75-8dac-4f7cfba6a6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:43.368746 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9c049-b0f0-4f75-8dac-4f7cfba6a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:43.369643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9c049-b0f0-4f75-8dac-4f7cfba6a6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:43.369902 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1142/2264] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:43.371449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9c049-b0f0-4f75-8dac-4f7cfba6a6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:43.376018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e98fbd-de98-4146-ba5c-8facec717a11 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:43.377475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9c049-b0f0-4f75-8dac-4f7cfba6a6b1 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:43.407358 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e98fbd-de98-4146-ba5c-8facec717a11 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:43.426730 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ab84f-8b3d-4d3a-9ddf-a12e24b07a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:43.427934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ab84f-8b3d-4d3a-9ddf-a12e24b07a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:43.428139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ab84f-8b3d-4d3a-9ddf-a12e24b07a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:43.428279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ab84f-8b3d-4d3a-9ddf-a12e24b07a67 admin admin] PATH_INFO: `/v3/projects/93bf2155672641dfa2fb7366b4fb2b68/users/18b745270c324cc48bbe1b4b68bad566/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:43.438284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ab84f-8b3d-4d3a-9ddf-a12e24b07a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93bf2155672641dfa2fb7366b4fb2b68, user_id=18b745270c324cc48bbe1b4b68bad566, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:43.441935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ab84f-8b3d-4d3a-9ddf-a12e24b07a67 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:43.454869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1143/2265] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:43 2022] PUT /identity/v3/projects/93bf2155672641dfa2fb7366b4fb2b68/users/18b745270c324cc48bbe1b4b68bad566/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:43.573140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1123/2266] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:43 2022] POST /identity/v3/projects => generated 379 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:43.578296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ab84f-8b3d-4d3a-9ddf-a12e24b07a67 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:43.711194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ab84f-8b3d-4d3a-9ddf-a12e24b07a67 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:43.815999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517d1d7-1be4-473c-9d44-96a3ccba26de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:43.816437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517d1d7-1be4-473c-9d44-96a3ccba26de admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:43.819146 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517d1d7-1be4-473c-9d44-96a3ccba26de admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:43.819657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517d1d7-1be4-473c-9d44-96a3ccba26de admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:43.820899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517d1d7-1be4-473c-9d44-96a3ccba26de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:43.825470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517d1d7-1be4-473c-9d44-96a3ccba26de admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:44.053702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1144/2267] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:43 2022] POST /identity/v3/users => generated 290 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 17:59:44.056368 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9c049-b0f0-4f75-8dac-4f7cfba6a6b1 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:44.074285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9c049-b0f0-4f75-8dac-4f7cfba6a6b1 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:44.089573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cac08-e272-49bb-a8ea-b2cb6c8d7341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:44.096757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cac08-e272-49bb-a8ea-b2cb6c8d7341 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:44.097141 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cac08-e272-49bb-a8ea-b2cb6c8d7341 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:44.098193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cac08-e272-49bb-a8ea-b2cb6c8d7341 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:44.110517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cac08-e272-49bb-a8ea-b2cb6c8d7341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:44.114713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cac08-e272-49bb-a8ea-b2cb6c8d7341 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:44.147374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1124/2268] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:59:44.154752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517d1d7-1be4-473c-9d44-96a3ccba26de admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:44.187685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517d1d7-1be4-473c-9d44-96a3ccba26de admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:44.233605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65920d-d3f2-4279-8be0-ca660eae1f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:44.236532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65920d-d3f2-4279-8be0-ca660eae1f3d admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:44.237218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65920d-d3f2-4279-8be0-ca660eae1f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:44.237754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65920d-d3f2-4279-8be0-ca660eae1f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:44.241418 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65920d-d3f2-4279-8be0-ca660eae1f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:44.247281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65920d-d3f2-4279-8be0-ca660eae1f3d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:44.298838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1145/2269] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:44.302913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cac08-e272-49bb-a8ea-b2cb6c8d7341 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:44.319158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cac08-e272-49bb-a8ea-b2cb6c8d7341 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:44.325511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a8570-2de9-410b-82b3-7484c4b74743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:44.326763 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a8570-2de9-410b-82b3-7484c4b74743 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:44.327215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a8570-2de9-410b-82b3-7484c4b74743 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:44.327675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a8570-2de9-410b-82b3-7484c4b74743 admin admin] PATH_INFO: `/v3/projects/da41c7038eb4480591cf385511223f67/users/5260b3716f724b529a92367b14a36732/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:44.364179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a8570-2de9-410b-82b3-7484c4b74743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da41c7038eb4480591cf385511223f67, user_id=5260b3716f724b529a92367b14a36732, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:44.368571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a8570-2de9-410b-82b3-7484c4b74743 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:44.422768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65920d-d3f2-4279-8be0-ca660eae1f3d admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:44.424903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5d65920d-d3f2-4279-8be0-ca660eae1f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:44.465032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65920d-d3f2-4279-8be0-ca660eae1f3d admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:44.478323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1125/2270] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:44 2022] PUT /identity/v3/projects/da41c7038eb4480591cf385511223f67/users/5260b3716f724b529a92367b14a36732/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:44.492050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:44.493780 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:44.494062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:44.494345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb admin admin] PATH_INFO: `/v3/projects/8b1d017476764cd5a0819d9fad63335b` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:44.495717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1d017476764cd5a0819d9fad63335b)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:44.498286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:44.504969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe04b4-ece9-4720-add3-dad8ae909496 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:44.509548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe04b4-ece9-4720-add3-dad8ae909496 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:44.509548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe04b4-ece9-4720-add3-dad8ae909496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:44.575166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-acbe04b4-ece9-4720-add3-dad8ae909496 None None] MFA Rules not processed for user `5260b3716f724b529a92367b14a36732`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:44.576089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-acbe04b4-ece9-4720-add3-dad8ae909496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:44.737508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1d017476764cd5a0819d9fad63335b', 'request_id': 'req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:44.746969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1d017476764cd5a0819d9fad63335b', 'request_id': 'req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:44.757102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1d017476764cd5a0819d9fad63335b', 'request_id': 'req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:44.821112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1126/2271] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:44.841038 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe04b4-ece9-4720-add3-dad8ae909496 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:44.881987 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb admin admin] The token cache is being invalidate because project 8b1d017476764cd5a0819d9fad63335b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:44.881987 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:44.882448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-07e9cda5-3fff-4b54-bf65-90f9c4b8b0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:44.884569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1146/2272] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:44 2022] DELETE /identity/v3/projects/8b1d017476764cd5a0819d9fad63335b => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:44.890063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cae741-6875-4451-bdac-ff2dcb55cdd5 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:44.896559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cae741-6875-4451-bdac-ff2dcb55cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:44.897168 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cae741-6875-4451-bdac-ff2dcb55cdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:44.925099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:44.943038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-d7cae741-6875-4451-bdac-ff2dcb55cdd5 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:44.944332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d7cae741-6875-4451-bdac-ff2dcb55cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:45.064605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe04b4-ece9-4720-add3-dad8ae909496 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:45.194981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dcecf-1b20-443d-8cae-582e9187010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:45.196126 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dcecf-1b20-443d-8cae-582e9187010d admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:45.196697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dcecf-1b20-443d-8cae-582e9187010d admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:45.197200 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1dcecf-1b20-443d-8cae-582e9187010d admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:45.198157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1dcecf-1b20-443d-8cae-582e9187010d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:45.201527 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1dcecf-1b20-443d-8cae-582e9187010d admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:45.224510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1147/2273] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:45.312060 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b997c-570e-432e-854d-19fcd07a2aef None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:45.312741 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b997c-570e-432e-854d-19fcd07a2aef None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:45.313265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b997c-570e-432e-854d-19fcd07a2aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:45.387927 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1127/2274] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:44 2022] POST /identity/v3/projects => generated 377 bytes in 554 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:45.404770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dcecf-1b20-443d-8cae-582e9187010d admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:45.406935 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3f1dcecf-1b20-443d-8cae-582e9187010d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:45.446589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-d14b997c-570e-432e-854d-19fcd07a2aef None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:45.449148 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d14b997c-570e-432e-854d-19fcd07a2aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:45.518866 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1dcecf-1b20-443d-8cae-582e9187010d admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:45.524570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655e6f6-0c59-432d-b778-4a78ad8f428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:45.525319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655e6f6-0c59-432d-b778-4a78ad8f428a admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:45.525602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655e6f6-0c59-432d-b778-4a78ad8f428a admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:45.525880 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655e6f6-0c59-432d-b778-4a78ad8f428a admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:45.527574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655e6f6-0c59-432d-b778-4a78ad8f428a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:45.528915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655e6f6-0c59-432d-b778-4a78ad8f428a admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:45.611546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1148/2275] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:45.617630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b997c-570e-432e-854d-19fcd07a2aef None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:45.650477 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1128/2276] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:45 2022] POST /identity/v3/users => generated 295 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:45.652892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b997c-570e-432e-854d-19fcd07a2aef None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:45.656715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655e6f6-0c59-432d-b778-4a78ad8f428a admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:45.672406 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12f5e2-96b2-492d-8c87-bc0487da28f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:45.673775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12f5e2-96b2-492d-8c87-bc0487da28f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:45.674083 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12f5e2-96b2-492d-8c87-bc0487da28f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:45.674334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12f5e2-96b2-492d-8c87-bc0487da28f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:45.675097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12f5e2-96b2-492d-8c87-bc0487da28f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 17:59:45.676529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12f5e2-96b2-492d-8c87-bc0487da28f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:45.680528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655e6f6-0c59-432d-b778-4a78ad8f428a admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:45.682951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12f5e2-96b2-492d-8c87-bc0487da28f5 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:45.690653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcffb8-e1f4-4527-9166-c2ed20945fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:45.692090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcffb8-e1f4-4527-9166-c2ed20945fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:45.692379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcffb8-e1f4-4527-9166-c2ed20945fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:45.692720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcffb8-e1f4-4527-9166-c2ed20945fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:45.699641 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcffb8-e1f4-4527-9166-c2ed20945fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:45.700156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dcffb8-e1f4-4527-9166-c2ed20945fa6 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:45.714383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1149/2277] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 17:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 17:59:45.722495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1129/2278] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 17:59:45.723283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12f5e2-96b2-492d-8c87-bc0487da28f5 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:45.728310 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcffb8-e1f4-4527-9166-c2ed20945fa6 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:45.744661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12f5e2-96b2-492d-8c87-bc0487da28f5 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:45.746696 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcffb8-e1f4-4527-9166-c2ed20945fa6 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:45.758836 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dadfa-452d-4a83-98aa-20e5d0ce27f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:45.759812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b74eb-2ed2-4957-9a0b-3e0d631999f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:45.761367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b74eb-2ed2-4957-9a0b-3e0d631999f7 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:45.762239 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dadfa-452d-4a83-98aa-20e5d0ce27f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:45.763000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dadfa-452d-4a83-98aa-20e5d0ce27f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:45.763273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b74eb-2ed2-4957-9a0b-3e0d631999f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:45.763725 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b74eb-2ed2-4957-9a0b-3e0d631999f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:45.764225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dadfa-452d-4a83-98aa-20e5d0ce27f9 admin admin] PATH_INFO: `/v3/projects/140d5c7c71df422ba8f2f799a8721bb8/users/d7a48069e91e4ce585bd85e78de16f87/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:45.766308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b74eb-2ed2-4957-9a0b-3e0d631999f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:45.768902 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b74eb-2ed2-4957-9a0b-3e0d631999f7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:45.807895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dadfa-452d-4a83-98aa-20e5d0ce27f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=140d5c7c71df422ba8f2f799a8721bb8, user_id=d7a48069e91e4ce585bd85e78de16f87, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:45.813105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dadfa-452d-4a83-98aa-20e5d0ce27f9 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:45.937474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1130/2279] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:45 2022] PUT /identity/v3/projects/140d5c7c71df422ba8f2f799a8721bb8/users/d7a48069e91e4ce585bd85e78de16f87/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:45.946569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dadfa-452d-4a83-98aa-20e5d0ce27f9 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:45.947733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1150/2280] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 17:59:45 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:45.950014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b74eb-2ed2-4957-9a0b-3e0d631999f7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:46.100079 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dadfa-452d-4a83-98aa-20e5d0ce27f9 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:46.177343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b74eb-2ed2-4957-9a0b-3e0d631999f7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:46.187137 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45397fbc-6839-46ad-ae02-74661c5caf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:46.188666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45397fbc-6839-46ad-ae02-74661c5caf58 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:46.189644 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45397fbc-6839-46ad-ae02-74661c5caf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:46.190304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45397fbc-6839-46ad-ae02-74661c5caf58 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:46.192259 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45397fbc-6839-46ad-ae02-74661c5caf58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:46.201367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45397fbc-6839-46ad-ae02-74661c5caf58 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:46.242876 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88a8a0-de37-46be-8f9b-72b4cbd74603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:46.245434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88a8a0-de37-46be-8f9b-72b4cbd74603 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:46.245710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88a8a0-de37-46be-8f9b-72b4cbd74603 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:46.246425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88a8a0-de37-46be-8f9b-72b4cbd74603 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:46.246996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88a8a0-de37-46be-8f9b-72b4cbd74603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:46.248708 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88a8a0-de37-46be-8f9b-72b4cbd74603 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:46.269471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1131/2281] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:46.276168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88a8a0-de37-46be-8f9b-72b4cbd74603 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:46.281806 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:46.309428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88a8a0-de37-46be-8f9b-72b4cbd74603 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:46.322054 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f89d7c-a374-4ae2-a3de-73ecc17b4e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:46.324797 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f89d7c-a374-4ae2-a3de-73ecc17b4e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:46.325560 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f89d7c-a374-4ae2-a3de-73ecc17b4e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:46.326499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f89d7c-a374-4ae2-a3de-73ecc17b4e6c admin admin] PATH_INFO: `/v3/projects/140d5c7c71df422ba8f2f799a8721bb8/users/d7a48069e91e4ce585bd85e78de16f87/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:46.332728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f89d7c-a374-4ae2-a3de-73ecc17b4e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=140d5c7c71df422ba8f2f799a8721bb8, user_id=d7a48069e91e4ce585bd85e78de16f87, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:46.365831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f89d7c-a374-4ae2-a3de-73ecc17b4e6c admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:46.429377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1151/2282] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 17:59:45 2022] POST /identity/v3/users => generated 286 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 17:59:46.444335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45397fbc-6839-46ad-ae02-74661c5caf58 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:46.467603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1132/2283] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:46 2022] PUT /identity/v3/projects/140d5c7c71df422ba8f2f799a8721bb8/users/d7a48069e91e4ce585bd85e78de16f87/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:46.478281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45397fbc-6839-46ad-ae02-74661c5caf58 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:46.492881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa3542-c8f1-476a-ae23-c92f181f8101 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:46.493455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa3542-c8f1-476a-ae23-c92f181f8101 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:46.493922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa3542-c8f1-476a-ae23-c92f181f8101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:46.619273 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-30aa3542-c8f1-476a-ae23-c92f181f8101 None None] MFA Rules not processed for user `d7a48069e91e4ce585bd85e78de16f87`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:46.631774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-30aa3542-c8f1-476a-ae23-c92f181f8101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:46.830381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b3faf-627e-4a1d-904c-761835b6220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:46.831644 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b3faf-627e-4a1d-904c-761835b6220c admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:46.836446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b3faf-627e-4a1d-904c-761835b6220c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:46.837379 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b3faf-627e-4a1d-904c-761835b6220c admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:46.839416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b3faf-627e-4a1d-904c-761835b6220c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:46.848538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b3faf-627e-4a1d-904c-761835b6220c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:46.916807 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1152/2284] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:46.927358 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b3faf-627e-4a1d-904c-761835b6220c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:46.951181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1133/2285] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:46.991732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b3faf-627e-4a1d-904c-761835b6220c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:46.992810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa3542-c8f1-476a-ae23-c92f181f8101 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:47.001907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-30aa3542-c8f1-476a-ae23-c92f181f8101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:47.037603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3066d-0c47-40c7-ad10-c3c6c525ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:47.040266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3066d-0c47-40c7-ad10-c3c6c525ea10 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:47.043703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3066d-0c47-40c7-ad10-c3c6c525ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:47.043703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3066d-0c47-40c7-ad10-c3c6c525ea10 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:47.048188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3066d-0c47-40c7-ad10-c3c6c525ea10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:47.060036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3066d-0c47-40c7-ad10-c3c6c525ea10 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:47.114532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1153/2286] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 17:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 17:59:47.119322 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3066d-0c47-40c7-ad10-c3c6c525ea10 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:47.157931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3066d-0c47-40c7-ad10-c3c6c525ea10 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:47.195799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd71ae-6e45-4d9c-9869-ddda6fafdb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:47.198499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd71ae-6e45-4d9c-9869-ddda6fafdb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:47.202416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd71ae-6e45-4d9c-9869-ddda6fafdb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:47.202880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd71ae-6e45-4d9c-9869-ddda6fafdb50 admin admin] PATH_INFO: `/v3/projects/dd8f1c1c7a4b43809142c740c8cad06b/users/c33dc1b3531e49b1aed777e80e6a0a9b/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:47.205096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa3542-c8f1-476a-ae23-c92f181f8101 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:47.214152 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7f192-49f9-42db-9ac3-61034fcd96eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:47.215673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7f192-49f9-42db-9ac3-61034fcd96eb service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:47.216512 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7f192-49f9-42db-9ac3-61034fcd96eb service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:47.217506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7f192-49f9-42db-9ac3-61034fcd96eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:47.221351 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:47.252003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd71ae-6e45-4d9c-9869-ddda6fafdb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8f1c1c7a4b43809142c740c8cad06b, user_id=c33dc1b3531e49b1aed777e80e6a0a9b, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:47.255882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd71ae-6e45-4d9c-9869-ddda6fafdb50 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:47.257430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7f192-49f9-42db-9ac3-61034fcd96eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:47.261328 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7f192-49f9-42db-9ac3-61034fcd96eb service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:47.287554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1134/2287] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:59:47.505222 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1154/2288] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 17:59:47 2022] PUT /identity/v3/projects/dd8f1c1c7a4b43809142c740c8cad06b/users/c33dc1b3531e49b1aed777e80e6a0a9b/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:47.516713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d2e19-ea3d-4e56-8065-ea07d97857fb None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:47.517111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d2e19-ea3d-4e56-8065-ea07d97857fb None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:47.517560 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d2e19-ea3d-4e56-8065-ea07d97857fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:47.555472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-bc3d2e19-ea3d-4e56-8065-ea07d97857fb None None] MFA Rules not processed for user `c33dc1b3531e49b1aed777e80e6a0a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:47.557259 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bc3d2e19-ea3d-4e56-8065-ea07d97857fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:47.598423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd71ae-6e45-4d9c-9869-ddda6fafdb50 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:47.602235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0bdd71ae-6e45-4d9c-9869-ddda6fafdb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:47.696043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1135/2289] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:47.718252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d2e19-ea3d-4e56-8065-ea07d97857fb None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:47.720823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bc3d2e19-ea3d-4e56-8065-ea07d97857fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:47.731606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd71ae-6e45-4d9c-9869-ddda6fafdb50 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:47.739456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7da01-687f-4a15-8bc8-15877c7a0395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:47.740745 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7da01-687f-4a15-8bc8-15877c7a0395 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:47.741248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7da01-687f-4a15-8bc8-15877c7a0395 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:47.741645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7da01-687f-4a15-8bc8-15877c7a0395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:47.745007 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d4a7da01-687f-4a15-8bc8-15877c7a0395 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:47.881931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7da01-687f-4a15-8bc8-15877c7a0395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:47.884332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7da01-687f-4a15-8bc8-15877c7a0395 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:47.902978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1155/2290] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:59:47.913229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d2e19-ea3d-4e56-8065-ea07d97857fb None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:47.924126 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a849eb-435b-436c-ae1e-a0ed27c89b42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '259d506eb54e4766a8fe3fa5bb514e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:47.925954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a849eb-435b-436c-ae1e-a0ed27c89b42 service glance] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:47.926461 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a849eb-435b-436c-ae1e-a0ed27c89b42 service glance] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:47.926964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a849eb-435b-436c-ae1e-a0ed27c89b42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:47.982817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a849eb-435b-436c-ae1e-a0ed27c89b42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:47.984898 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a849eb-435b-436c-ae1e-a0ed27c89b42 service glance] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:48.013787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1136/2291] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 17:59:49.882323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:50.728293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:50.922032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad6776-d897-4faf-b5f6-c985a505fb2e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:50.922681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad6776-d897-4faf-b5f6-c985a505fb2e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:50.923162 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad6776-d897-4faf-b5f6-c985a505fb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:50.956875 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-49ad6776-d897-4faf-b5f6-c985a505fb2e None None] MFA Rules not processed for user `ae98633baddd4dd19516a1ee4cff0e32`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:50.961548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-49ad6776-d897-4faf-b5f6-c985a505fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:51.142035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1156/2292] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:52.696116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:53.360696 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c51a-f833-47e8-b739-e7c00fa29c44 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:53.361209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c51a-f833-47e8-b739-e7c00fa29c44 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:53.361711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c51a-f833-47e8-b739-e7c00fa29c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:53.393400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-34b5c51a-f833-47e8-b739-e7c00fa29c44 None None] MFA Rules not processed for user `de47dd54e8fc48ca9411ce4c7906b80b`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:53.395260 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-34b5c51a-f833-47e8-b739-e7c00fa29c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:53.544086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1137/2293] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:53.878433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:55.786373 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad6776-d897-4faf-b5f6-c985a505fb2e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:56.117214 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad6776-d897-4faf-b5f6-c985a505fb2e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:56.131151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e753cc8-5498-4544-acd0-c75e085fe32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:56.137491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753cc8-5498-4544-acd0-c75e085fe32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:56.155166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753cc8-5498-4544-acd0-c75e085fe32e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:56.157403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753cc8-5498-4544-acd0-c75e085fe32e admin admin] PATH_INFO: `/v3/users/473b37cd87a3449ebf64a9e988d4acea` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:56.163085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e753cc8-5498-4544-acd0-c75e085fe32e admin admin] RBAC: Authorizing `identity:delete_user(user_id=473b37cd87a3449ebf64a9e988d4acea)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:56.166763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e753cc8-5498-4544-acd0-c75e085fe32e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:56.540794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1e753cc8-5498-4544-acd0-c75e085fe32e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473b37cd87a3449ebf64a9e988d4acea'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:56.570530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1e753cc8-5498-4544-acd0-c75e085fe32e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473b37cd87a3449ebf64a9e988d4acea'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:56.587209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1e753cc8-5498-4544-acd0-c75e085fe32e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473b37cd87a3449ebf64a9e988d4acea'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:56.699847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1e753cc8-5498-4544-acd0-c75e085fe32e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473b37cd87a3449ebf64a9e988d4acea'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:56.701579 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1e753cc8-5498-4544-acd0-c75e085fe32e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473b37cd87a3449ebf64a9e988d4acea'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:56.719009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1157/2294] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:55 2022] DELETE /identity/v3/users/473b37cd87a3449ebf64a9e988d4acea => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 17:59:56.727698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e561a1-4cdf-4298-b673-a9a215ea56de None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:56.728574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e561a1-4cdf-4298-b673-a9a215ea56de None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:56.742772 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e561a1-4cdf-4298-b673-a9a215ea56de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:56.749736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:56.810960 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-89e561a1-4cdf-4298-b673-a9a215ea56de None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:56.814235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-89e561a1-4cdf-4298-b673-a9a215ea56de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:57.030218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f2ae7-52df-4da7-95ae-cfc8ffb67253 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:57.032695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f2ae7-52df-4da7-95ae-cfc8ffb67253 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:57.043981 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f2ae7-52df-4da7-95ae-cfc8ffb67253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:57.055370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1138/2295] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 17:59:57.083151 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e561a1-4cdf-4298-b673-a9a215ea56de None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:57.103571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-89e561a1-4cdf-4298-b673-a9a215ea56de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:57.105888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ce7f2ae7-52df-4da7-95ae-cfc8ffb67253 None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:57.108933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ce7f2ae7-52df-4da7-95ae-cfc8ffb67253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:57.283426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e561a1-4cdf-4298-b673-a9a215ea56de None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:57.288365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1158/2296] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 17:59:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:57.292197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5672e-b192-4a76-8c53-f81c34a603c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:57.294369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5672e-b192-4a76-8c53-f81c34a603c1 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:57.295394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5672e-b192-4a76-8c53-f81c34a603c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:57.296168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5672e-b192-4a76-8c53-f81c34a603c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:57.313013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5672e-b192-4a76-8c53-f81c34a603c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:57.315845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5672e-b192-4a76-8c53-f81c34a603c1 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:57.339211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1139/2297] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 17:59:57.387432 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f2ae7-52df-4da7-95ae-cfc8ffb67253 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:57.394432 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ce7f2ae7-52df-4da7-95ae-cfc8ffb67253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:57.623720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f2ae7-52df-4da7-95ae-cfc8ffb67253 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:57.663183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e30af5-00ae-45ee-9a51-ed61b94fc5dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:57.664282 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30af5-00ae-45ee-9a51-ed61b94fc5dd service swift] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:57.667235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30af5-00ae-45ee-9a51-ed61b94fc5dd service swift] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:57.683205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30af5-00ae-45ee-9a51-ed61b94fc5dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:57.729930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e30af5-00ae-45ee-9a51-ed61b94fc5dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:57.741929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e30af5-00ae-45ee-9a51-ed61b94fc5dd service swift] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:57.788093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1159/2298] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 17:59:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 17:59:58.013331 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:58.541309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5672e-b192-4a76-8c53-f81c34a603c1 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:58.544182 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-39f5672e-b192-4a76-8c53-f81c34a603c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:58.623625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5672e-b192-4a76-8c53-f81c34a603c1 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:58.648129 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:58.648129 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:58.648445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:58.648995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] PATH_INFO: `/v3/projects/f91616d79b444744880a3981efc0f08c` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:58.651657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91616d79b444744880a3981efc0f08c)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:58.656088 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:58.937159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91616d79b444744880a3981efc0f08c', 'request_id': 'req-9f2f9a07-cd04-41a5-9409-065f702e22b2'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:58.957248 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 17:59:58.961197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91616d79b444744880a3981efc0f08c', 'request_id': 'req-9f2f9a07-cd04-41a5-9409-065f702e22b2'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:59.041719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91616d79b444744880a3981efc0f08c', 'request_id': 'req-9f2f9a07-cd04-41a5-9409-065f702e22b2'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:59.062730 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90d7af-f6a4-4259-9fc6-a5a08676f9ca None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:59.063505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90d7af-f6a4-4259-9fc6-a5a08676f9ca None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:59.063505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90d7af-f6a4-4259-9fc6-a5a08676f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:59.101962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] The token cache is being invalidate because project f91616d79b444744880a3981efc0f08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 17:59:59.113067 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:59.117775 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:59.138609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1140/2299] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 17:59:58 2022] DELETE /identity/v3/projects/f91616d79b444744880a3981efc0f08c => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 17:59:59.148008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:59.150925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:59.236353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-9b90d7af-f6a4-4259-9fc6-a5a08676f9ca None None] MFA Rules not processed for user `18b745270c324cc48bbe1b4b68bad566`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 17:59:59.238262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9b90d7af-f6a4-4259-9fc6-a5a08676f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:59.445719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f9a07-cd04-41a5-9409-065f702e22b2 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:59.459593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:59.460851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:59.461520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:59.463000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] PATH_INFO: `/v3/users/5260b3716f724b529a92367b14a36732` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:59.468676 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5260b3716f724b529a92367b14a36732)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 17:59:59.471211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 17:59:59.506770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1160/2300] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 17:59:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 17:59:59.528793 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90d7af-f6a4-4259-9fc6-a5a08676f9ca None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 17:59:59.530793 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9b90d7af-f6a4-4259-9fc6-a5a08676f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:59.755408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5260b3716f724b529a92367b14a36732'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:59.793458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5260b3716f724b529a92367b14a36732'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:59.796986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90d7af-f6a4-4259-9fc6-a5a08676f9ca None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 17:59:59.807876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfce84a-45db-4dc7-8706-460306e48883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 17:59:59.809437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfce84a-45db-4dc7-8706-460306e48883 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 17:59:59.809899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfce84a-45db-4dc7-8706-460306e48883 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 17:59:59.810451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfce84a-45db-4dc7-8706-460306e48883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 17:59:59.817385 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5260b3716f724b529a92367b14a36732'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:59.819114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-fdfce84a-45db-4dc7-8706-460306e48883 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 17:59:59.962490 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5260b3716f724b529a92367b14a36732'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 17:59:59.964283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5260b3716f724b529a92367b14a36732'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:00.072387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1141/2301] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 17:59:59 2022] DELETE /identity/v3/users/5260b3716f724b529a92367b14a36732 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:00.076330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfce84a-45db-4dc7-8706-460306e48883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:00.117733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfce84a-45db-4dc7-8706-460306e48883 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:00.117733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1161/2302] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 17:59:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:00:00.621409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:01.449861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:02.226164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:03.047262 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:03.367281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:03.760245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:03.816511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:03.818314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:03.983115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3fe31-ef27-489b-a577-2ec18c14c2a5 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:04.005483 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:04.006821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:04.007112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:04.007395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] PATH_INFO: `/v3/projects/da41c7038eb4480591cf385511223f67` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:04.011244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da41c7038eb4480591cf385511223f67)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:04.013287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:04.210825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:04.245359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da41c7038eb4480591cf385511223f67', 'request_id': 'req-999ddf36-09d0-457c-af6c-23c9b8771615'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:04.266752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da41c7038eb4480591cf385511223f67', 'request_id': 'req-999ddf36-09d0-457c-af6c-23c9b8771615'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:04.343855 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da41c7038eb4480591cf385511223f67', 'request_id': 'req-999ddf36-09d0-457c-af6c-23c9b8771615'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:04.371133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] The token cache is being invalidate because project da41c7038eb4480591cf385511223f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:00:04.371415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:04.372124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:04.373809 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1142/2303] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:00:03 2022] DELETE /identity/v3/projects/da41c7038eb4480591cf385511223f67 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:04.378917 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfce84a-45db-4dc7-8706-460306e48883 service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:04.404079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfce84a-45db-4dc7-8706-460306e48883 service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:04.629278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e66f6-abf3-4178-bfce-b6117580dcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:04.630437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e66f6-abf3-4178-bfce-b6117580dcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:04.630728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e66f6-abf3-4178-bfce-b6117580dcde admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:04.631013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e66f6-abf3-4178-bfce-b6117580dcde admin admin] PATH_INFO: `/v3/users/d7a48069e91e4ce585bd85e78de16f87` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:04.636714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e66f6-abf3-4178-bfce-b6117580dcde admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a48069e91e4ce585bd85e78de16f87)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:04.644102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e66f6-abf3-4178-bfce-b6117580dcde admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:05.217695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-927e66f6-abf3-4178-bfce-b6117580dcde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a48069e91e4ce585bd85e78de16f87'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:05.261702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:05.270480 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-927e66f6-abf3-4178-bfce-b6117580dcde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a48069e91e4ce585bd85e78de16f87'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:05.295148 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-927e66f6-abf3-4178-bfce-b6117580dcde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a48069e91e4ce585bd85e78de16f87'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:05.407325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-927e66f6-abf3-4178-bfce-b6117580dcde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a48069e91e4ce585bd85e78de16f87'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:05.411415 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-927e66f6-abf3-4178-bfce-b6117580dcde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a48069e91e4ce585bd85e78de16f87'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:05.421492 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1162/2304] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:00:04 2022] DELETE /identity/v3/users/d7a48069e91e4ce585bd85e78de16f87 => generated 0 bytes in 1044 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:06.540349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:08.069382 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:08.071260 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:08.108136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ddf36-09d0-457c-af6c-23c9b8771615 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:08.357131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:08.357131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:08.357131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:08.357131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec admin admin] PATH_INFO: `/v3/projects/140d5c7c71df422ba8f2f799a8721bb8` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:08.362521 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=140d5c7c71df422ba8f2f799a8721bb8)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:08.374821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:08.628774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140d5c7c71df422ba8f2f799a8721bb8', 'request_id': 'req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:08.655686 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140d5c7c71df422ba8f2f799a8721bb8', 'request_id': 'req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:08.824297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140d5c7c71df422ba8f2f799a8721bb8', 'request_id': 'req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:08.856125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec admin admin] The token cache is being invalidate because project 140d5c7c71df422ba8f2f799a8721bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:00:08.856747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:08.858860 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3a05e1c2-b7c8-4b77-b729-55ac67ce8aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:08.863370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1143/2305] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:00:08 2022] DELETE /identity/v3/projects/140d5c7c71df422ba8f2f799a8721bb8 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:08.873921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac76fa-27a8-4001-a624-3fd65414f861 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:08.879771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac76fa-27a8-4001-a624-3fd65414f861 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:08.879771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac76fa-27a8-4001-a624-3fd65414f861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:08.959098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-48ac76fa-27a8-4001-a624-3fd65414f861 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:08.962639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-48ac76fa-27a8-4001-a624-3fd65414f861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:09.235861 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1163/2306] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:09.250108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a92f5-0459-4542-95eb-727bc7fe17d9 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:09.254894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a92f5-0459-4542-95eb-727bc7fe17d9 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:09.254894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a92f5-0459-4542-95eb-727bc7fe17d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:09.323729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-731a92f5-0459-4542-95eb-727bc7fe17d9 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:09.337945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-731a92f5-0459-4542-95eb-727bc7fe17d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:09.350834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:09.361342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1144/2307] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:00:09.370079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac76fa-27a8-4001-a624-3fd65414f861 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:09.421377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac76fa-27a8-4001-a624-3fd65414f861 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:09.448575 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94b3fe-12f1-4df8-9dfa-6c6c7153f1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:09.449941 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94b3fe-12f1-4df8-9dfa-6c6c7153f1ff admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:09.450566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94b3fe-12f1-4df8-9dfa-6c6c7153f1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:09.451174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94b3fe-12f1-4df8-9dfa-6c6c7153f1ff admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:09.452753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94b3fe-12f1-4df8-9dfa-6c6c7153f1ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:00:09.454681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94b3fe-12f1-4df8-9dfa-6c6c7153f1ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:09.460746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94b3fe-12f1-4df8-9dfa-6c6c7153f1ff admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:09.533024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1164/2308] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:00:09.540680 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a92f5-0459-4542-95eb-727bc7fe17d9 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:09.558754 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a92f5-0459-4542-95eb-727bc7fe17d9 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:09.569915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df15905-a634-4867-b1f4-f998dbf1efef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:09.570969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15905-a634-4867-b1f4-f998dbf1efef admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:09.571524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15905-a634-4867-b1f4-f998dbf1efef admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:09.571986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15905-a634-4867-b1f4-f998dbf1efef admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:09.573062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df15905-a634-4867-b1f4-f998dbf1efef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:09.577892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df15905-a634-4867-b1f4-f998dbf1efef admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:09.781255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1145/2309] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:00:09 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:00:09.786783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94b3fe-12f1-4df8-9dfa-6c6c7153f1ff admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:09.823568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94b3fe-12f1-4df8-9dfa-6c6c7153f1ff admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:09.967678 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:10.014113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab01a18-4104-4a84-902a-b385df21eef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:10.025232 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab01a18-4104-4a84-902a-b385df21eef5 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:10.025814 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab01a18-4104-4a84-902a-b385df21eef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:10.026296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab01a18-4104-4a84-902a-b385df21eef5 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:10.027965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab01a18-4104-4a84-902a-b385df21eef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:10.032012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab01a18-4104-4a84-902a-b385df21eef5 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:10.207457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1165/2310] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:00:09 2022] POST /identity/v3/users => generated 294 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:00:10.214086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df15905-a634-4867-b1f4-f998dbf1efef admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:10.264100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df15905-a634-4867-b1f4-f998dbf1efef admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:10.302268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ff9fa-7242-476a-8b47-385debb19e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:10.303461 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ff9fa-7242-476a-8b47-385debb19e46 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:10.304366 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ff9fa-7242-476a-8b47-385debb19e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:10.305321 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ff9fa-7242-476a-8b47-385debb19e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:10.307885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ff9fa-7242-476a-8b47-385debb19e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:10.310228 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ff9fa-7242-476a-8b47-385debb19e46 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:10.345099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1146/2311] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:00:10.352839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab01a18-4104-4a84-902a-b385df21eef5 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:10.411756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab01a18-4104-4a84-902a-b385df21eef5 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:10.448005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a19f45-ed39-4c69-8015-e513598fa6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:10.449928 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a19f45-ed39-4c69-8015-e513598fa6fd admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:10.450838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a19f45-ed39-4c69-8015-e513598fa6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:10.453080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a19f45-ed39-4c69-8015-e513598fa6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:10.458405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a19f45-ed39-4c69-8015-e513598fa6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:10.460105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a19f45-ed39-4c69-8015-e513598fa6fd admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:10.492688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ff9fa-7242-476a-8b47-385debb19e46 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:10.493136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1166/2312] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:00:10.526552 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ff9fa-7242-476a-8b47-385debb19e46 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:10.537199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f45e20-55d9-4efd-b1a5-f5e13710c153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:10.539639 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f45e20-55d9-4efd-b1a5-f5e13710c153 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:10.540551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f45e20-55d9-4efd-b1a5-f5e13710c153 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:10.541468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f45e20-55d9-4efd-b1a5-f5e13710c153 admin admin] PATH_INFO: `/v3/projects/f3e9f4bd282d4d6fb1b5fa1698c50e3e/users/afeb2632754f446cb62fbc31dafba654/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:10.619972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f45e20-55d9-4efd-b1a5-f5e13710c153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e9f4bd282d4d6fb1b5fa1698c50e3e, user_id=afeb2632754f446cb62fbc31dafba654, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:10.626514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f45e20-55d9-4efd-b1a5-f5e13710c153 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:10.792278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1147/2313] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:00:10 2022] PUT /identity/v3/projects/f3e9f4bd282d4d6fb1b5fa1698c50e3e/users/afeb2632754f446cb62fbc31dafba654/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:10.805196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b47af-524b-43da-92ba-0e1b30c47505 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:10.805491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b47af-524b-43da-92ba-0e1b30c47505 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:10.805758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b47af-524b-43da-92ba-0e1b30c47505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:10.835842 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:10.871369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ff3b47af-524b-43da-92ba-0e1b30c47505 None None] MFA Rules not processed for user `afeb2632754f446cb62fbc31dafba654`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:10.872878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ff3b47af-524b-43da-92ba-0e1b30c47505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:10.914828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1530a5-b5db-4280-9b49-4b3165021a1d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:10.915856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1530a5-b5db-4280-9b49-4b3165021a1d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:10.917468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1530a5-b5db-4280-9b49-4b3165021a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:10.968415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-6b1530a5-b5db-4280-9b49-4b3165021a1d None None] MFA Rules not processed for user `29a8fcba54e345f197b129dbdb7a3fef`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:10.970226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6b1530a5-b5db-4280-9b49-4b3165021a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:11.049921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1167/2314] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:11.054943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b47af-524b-43da-92ba-0e1b30c47505 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:11.170856 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1148/2315] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:00:11.235552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b47af-524b-43da-92ba-0e1b30c47505 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:11.247812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f13e09-72b5-48d2-b751-c22142911fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:11.249043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f13e09-72b5-48d2-b751-c22142911fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:11.249648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f13e09-72b5-48d2-b751-c22142911fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:11.250186 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f13e09-72b5-48d2-b751-c22142911fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:11.252848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f13e09-72b5-48d2-b751-c22142911fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:11.257460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f13e09-72b5-48d2-b751-c22142911fa3 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:11.562250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1168/2316] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:00:11 2022] POST /identity/v3/projects => generated 385 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:00:11.563714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1530a5-b5db-4280-9b49-4b3165021a1d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:11.581483 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1530a5-b5db-4280-9b49-4b3165021a1d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:11.708044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04107f-536d-4142-b8cc-610588b45a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:11.710679 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04107f-536d-4142-b8cc-610588b45a3f admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:11.711493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04107f-536d-4142-b8cc-610588b45a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:11.712168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04107f-536d-4142-b8cc-610588b45a3f admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:11.713314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04107f-536d-4142-b8cc-610588b45a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:11.721561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04107f-536d-4142-b8cc-610588b45a3f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:11.843492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:11.886758 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1149/2317] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:00:11 2022] POST /identity/v3/users => generated 299 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:00:11.888868 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f13e09-72b5-48d2-b751-c22142911fa3 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:11.962635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f13e09-72b5-48d2-b751-c22142911fa3 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:11.985261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55d48d-6ed9-4f84-a091-60abd77d2941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:11.987438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55d48d-6ed9-4f84-a091-60abd77d2941 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:11.987438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55d48d-6ed9-4f84-a091-60abd77d2941 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:11.987961 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55d48d-6ed9-4f84-a091-60abd77d2941 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:11.989544 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55d48d-6ed9-4f84-a091-60abd77d2941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:11.997299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55d48d-6ed9-4f84-a091-60abd77d2941 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:12.053350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1169/2318] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:00:12.057388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04107f-536d-4142-b8cc-610588b45a3f admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:12.073814 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04107f-536d-4142-b8cc-610588b45a3f admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:12.110805 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86906aa5-2a13-469f-ac42-1f87a5fab735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:12.112648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86906aa5-2a13-469f-ac42-1f87a5fab735 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:12.118349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86906aa5-2a13-469f-ac42-1f87a5fab735 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:12.118349 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86906aa5-2a13-469f-ac42-1f87a5fab735 admin admin] PATH_INFO: `/v3/projects/4a635033cd2747a0aa0d76ed0e4dd6c0/users/205166e9f48c472282d770ac15e431c9/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:12.133364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86906aa5-2a13-469f-ac42-1f87a5fab735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a635033cd2747a0aa0d76ed0e4dd6c0, user_id=205166e9f48c472282d770ac15e431c9, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:12.138444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86906aa5-2a13-469f-ac42-1f87a5fab735 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:12.274499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1150/2319] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:00:12 2022] PUT /identity/v3/projects/4a635033cd2747a0aa0d76ed0e4dd6c0/users/205166e9f48c472282d770ac15e431c9/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:12.280183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55d48d-6ed9-4f84-a091-60abd77d2941 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:12.301841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55d48d-6ed9-4f84-a091-60abd77d2941 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:12.474206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a877e-6a62-42d7-a0f7-598f00d38f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:12.474939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a877e-6a62-42d7-a0f7-598f00d38f22 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:12.475326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a877e-6a62-42d7-a0f7-598f00d38f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:12.475762 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a877e-6a62-42d7-a0f7-598f00d38f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:12.476675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a877e-6a62-42d7-a0f7-598f00d38f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:12.478584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a877e-6a62-42d7-a0f7-598f00d38f22 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:12.510016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1170/2320] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:00:12.511385 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86906aa5-2a13-469f-ac42-1f87a5fab735 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:12.527807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86906aa5-2a13-469f-ac42-1f87a5fab735 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:12.533293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bed042-6593-4b44-86f8-d901eb252c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:12.534276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bed042-6593-4b44-86f8-d901eb252c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:12.534628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bed042-6593-4b44-86f8-d901eb252c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:12.534911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bed042-6593-4b44-86f8-d901eb252c6f admin admin] PATH_INFO: `/v3/projects/4a635033cd2747a0aa0d76ed0e4dd6c0/users/205166e9f48c472282d770ac15e431c9/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:12.537206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bed042-6593-4b44-86f8-d901eb252c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a635033cd2747a0aa0d76ed0e4dd6c0, user_id=205166e9f48c472282d770ac15e431c9, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:12.540590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bed042-6593-4b44-86f8-d901eb252c6f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:12.568516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1151/2321] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:00:12 2022] PUT /identity/v3/projects/4a635033cd2747a0aa0d76ed0e4dd6c0/users/205166e9f48c472282d770ac15e431c9/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:12.575050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f51679-7fa6-41ac-a88a-9a9b074d28d3 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:12.576527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f51679-7fa6-41ac-a88a-9a9b074d28d3 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:12.576527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f51679-7fa6-41ac-a88a-9a9b074d28d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:12.651129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-52f51679-7fa6-41ac-a88a-9a9b074d28d3 None None] MFA Rules not processed for user `205166e9f48c472282d770ac15e431c9`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:12.652417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-52f51679-7fa6-41ac-a88a-9a9b074d28d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:12.756226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:12.775653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1171/2322] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:00:12.790923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bed042-6593-4b44-86f8-d901eb252c6f admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:12.793286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-19bed042-6593-4b44-86f8-d901eb252c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:12.940722 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bed042-6593-4b44-86f8-d901eb252c6f admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:12.961315 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aef7f8-5828-4850-b1e2-3b68ca089fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:12.961999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aef7f8-5828-4850-b1e2-3b68ca089fde service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:12.962294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aef7f8-5828-4850-b1e2-3b68ca089fde service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:12.962569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aef7f8-5828-4850-b1e2-3b68ca089fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:12.994542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aef7f8-5828-4850-b1e2-3b68ca089fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:12.996073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aef7f8-5828-4850-b1e2-3b68ca089fde service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:13.022824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:13.036780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1152/2323] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:00:15.795239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:15.920582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f51679-7fa6-41ac-a88a-9a9b074d28d3 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:16.082288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:16.168299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f51679-7fa6-41ac-a88a-9a9b074d28d3 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:16.174179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:16.175541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:16.176123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:16.176776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] PATH_INFO: `/v3/users/afeb2632754f446cb62fbc31dafba654` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:16.178639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afeb2632754f446cb62fbc31dafba654)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:16.181212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:16.632130 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afeb2632754f446cb62fbc31dafba654'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:16.685039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afeb2632754f446cb62fbc31dafba654'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:16.697071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afeb2632754f446cb62fbc31dafba654'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:16.801325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afeb2632754f446cb62fbc31dafba654'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:16.803522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afeb2632754f446cb62fbc31dafba654'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:16.811943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1172/2324] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:00:15 2022] DELETE /identity/v3/users/afeb2632754f446cb62fbc31dafba654 => generated 0 bytes in 895 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:16.840622 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f0219-40f2-4e30-8190-62920585b999 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:16.841203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f0219-40f2-4e30-8190-62920585b999 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:16.841651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f0219-40f2-4e30-8190-62920585b999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:16.881828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-951f0219-40f2-4e30-8190-62920585b999 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:16.884703 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-951f0219-40f2-4e30-8190-62920585b999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:17.088466 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1153/2325] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:17.119595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:17.121840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:17.319860 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9f3c-e854-4565-a3d2-95b187ac234f admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:17.325680 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5f25d-6afd-4beb-b470-547ee1154b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:17.326489 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5f25d-6afd-4beb-b470-547ee1154b46 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:17.326848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5f25d-6afd-4beb-b470-547ee1154b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:17.327205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5f25d-6afd-4beb-b470-547ee1154b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:17.341453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5f25d-6afd-4beb-b470-547ee1154b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:17.342976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5f25d-6afd-4beb-b470-547ee1154b46 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:17.367516 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1173/2326] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:00:18.163553 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f0219-40f2-4e30-8190-62920585b999 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:18.166633 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-951f0219-40f2-4e30-8190-62920585b999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:18.189100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f0219-40f2-4e30-8190-62920585b999 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:18.198290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:18.199699 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:18.200114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:18.200571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] PATH_INFO: `/v3/projects/f3e9f4bd282d4d6fb1b5fa1698c50e3e` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:18.203692 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e9f4bd282d4d6fb1b5fa1698c50e3e)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:18.208120 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:18.394503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e9f4bd282d4d6fb1b5fa1698c50e3e', 'request_id': 'req-060d967b-f018-43b1-b54c-70878962c5be'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:18.410266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e9f4bd282d4d6fb1b5fa1698c50e3e', 'request_id': 'req-060d967b-f018-43b1-b54c-70878962c5be'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:18.526958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e9f4bd282d4d6fb1b5fa1698c50e3e', 'request_id': 'req-060d967b-f018-43b1-b54c-70878962c5be'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:18.559810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] The token cache is being invalidate because project f3e9f4bd282d4d6fb1b5fa1698c50e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:00:18.560710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:18.563013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:18.567221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1154/2327] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:00:18 2022] DELETE /identity/v3/projects/f3e9f4bd282d4d6fb1b5fa1698c50e3e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:18.571744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5f25d-6afd-4beb-b470-547ee1154b46 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:18.584529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5f25d-6afd-4beb-b470-547ee1154b46 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:18.706197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc0fd0-ebdc-47e4-a12a-38c25152bf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:18.707478 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc0fd0-ebdc-47e4-a12a-38c25152bf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:18.708769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc0fd0-ebdc-47e4-a12a-38c25152bf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:18.713878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc0fd0-ebdc-47e4-a12a-38c25152bf8b admin admin] PATH_INFO: `/v3/users/205166e9f48c472282d770ac15e431c9` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:18.713878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc0fd0-ebdc-47e4-a12a-38c25152bf8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=205166e9f48c472282d770ac15e431c9)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:18.713878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc0fd0-ebdc-47e4-a12a-38c25152bf8b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:19.517921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c8fc0fd0-ebdc-47e4-a12a-38c25152bf8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205166e9f48c472282d770ac15e431c9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:19.544958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c8fc0fd0-ebdc-47e4-a12a-38c25152bf8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205166e9f48c472282d770ac15e431c9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:19.556064 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:19.578236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c8fc0fd0-ebdc-47e4-a12a-38c25152bf8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205166e9f48c472282d770ac15e431c9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:19.676035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c8fc0fd0-ebdc-47e4-a12a-38c25152bf8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205166e9f48c472282d770ac15e431c9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:19.677309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c8fc0fd0-ebdc-47e4-a12a-38c25152bf8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205166e9f48c472282d770ac15e431c9'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:19.696511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1174/2328] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:00:18 2022] DELETE /identity/v3/users/205166e9f48c472282d770ac15e431c9 => generated 0 bytes in 1120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:19.842757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:20.541317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:20.544620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:20.568392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d967b-f018-43b1-b54c-70878962c5be admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:20.680718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fbea4-3905-4af1-98fe-3ce356676a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:20.681605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fbea4-3905-4af1-98fe-3ce356676a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:20.681883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fbea4-3905-4af1-98fe-3ce356676a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:20.682158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fbea4-3905-4af1-98fe-3ce356676a5c admin admin] PATH_INFO: `/v3/projects/4a635033cd2747a0aa0d76ed0e4dd6c0` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:20.683398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fbea4-3905-4af1-98fe-3ce356676a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a635033cd2747a0aa0d76ed0e4dd6c0)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:20.685393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fbea4-3905-4af1-98fe-3ce356676a5c admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:20.916458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-465fbea4-3905-4af1-98fe-3ce356676a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a635033cd2747a0aa0d76ed0e4dd6c0', 'request_id': 'req-465fbea4-3905-4af1-98fe-3ce356676a5c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:20.923968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-465fbea4-3905-4af1-98fe-3ce356676a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a635033cd2747a0aa0d76ed0e4dd6c0', 'request_id': 'req-465fbea4-3905-4af1-98fe-3ce356676a5c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:20.943466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:21.084328 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-465fbea4-3905-4af1-98fe-3ce356676a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a635033cd2747a0aa0d76ed0e4dd6c0', 'request_id': 'req-465fbea4-3905-4af1-98fe-3ce356676a5c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:21.113542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-465fbea4-3905-4af1-98fe-3ce356676a5c admin admin] The token cache is being invalidate because project 4a635033cd2747a0aa0d76ed0e4dd6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:00:21.113841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-465fbea4-3905-4af1-98fe-3ce356676a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:21.114532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-465fbea4-3905-4af1-98fe-3ce356676a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:21.116251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1155/2329] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:00:20 2022] DELETE /identity/v3/projects/4a635033cd2747a0aa0d76ed0e4dd6c0 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:21.124369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2290e-2508-401a-a4d8-e17e02481018 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:21.124874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2290e-2508-401a-a4d8-e17e02481018 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:21.125357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2290e-2508-401a-a4d8-e17e02481018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:21.154110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b0c2290e-2508-401a-a4d8-e17e02481018 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:21.155349 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b0c2290e-2508-401a-a4d8-e17e02481018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:21.234724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1175/2330] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:00:21.242992 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37176266-d72f-4087-8e0c-04a9957d81bc None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:21.243283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37176266-d72f-4087-8e0c-04a9957d81bc None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:21.243570 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37176266-d72f-4087-8e0c-04a9957d81bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:21.265383 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-37176266-d72f-4087-8e0c-04a9957d81bc None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:21.269087 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-37176266-d72f-4087-8e0c-04a9957d81bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:21.276104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1156/2331] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:21.281125 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2290e-2508-401a-a4d8-e17e02481018 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:21.292885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2290e-2508-401a-a4d8-e17e02481018 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:21.297650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5055b-364e-4744-9a27-b0aa92a57720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:21.298322 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5055b-364e-4744-9a27-b0aa92a57720 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:21.299342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5055b-364e-4744-9a27-b0aa92a57720 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:21.299708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5055b-364e-4744-9a27-b0aa92a57720 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:21.300450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5055b-364e-4744-9a27-b0aa92a57720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:00:21.300795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5055b-364e-4744-9a27-b0aa92a57720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:21.302515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5055b-364e-4744-9a27-b0aa92a57720 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:21.316013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1176/2332] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:00:21.320764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37176266-d72f-4087-8e0c-04a9957d81bc None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:21.331697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37176266-d72f-4087-8e0c-04a9957d81bc None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:21.338055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1f859-6523-44fc-917e-143f29b9a10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:21.338750 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1f859-6523-44fc-917e-143f29b9a10f admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:21.339042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1f859-6523-44fc-917e-143f29b9a10f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:21.339336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1f859-6523-44fc-917e-143f29b9a10f admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:21.341112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1f859-6523-44fc-917e-143f29b9a10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:21.343322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1f859-6523-44fc-917e-143f29b9a10f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:21.532204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1157/2333] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:00:21 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:00:21.536502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5055b-364e-4744-9a27-b0aa92a57720 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:21.549786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5055b-364e-4744-9a27-b0aa92a57720 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:21.613038 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518c404-a2f1-4357-93f7-df138ca6c8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:21.613723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518c404-a2f1-4357-93f7-df138ca6c8ad admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:21.614005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518c404-a2f1-4357-93f7-df138ca6c8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:21.614280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518c404-a2f1-4357-93f7-df138ca6c8ad admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:21.615052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518c404-a2f1-4357-93f7-df138ca6c8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:21.617032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518c404-a2f1-4357-93f7-df138ca6c8ad admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:21.727984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1177/2334] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:00:21 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:00:21.733475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1f859-6523-44fc-917e-143f29b9a10f admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:21.746094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1f859-6523-44fc-917e-143f29b9a10f admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:21.750979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a379d17-7d4e-459d-8385-2833167cb334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:21.751725 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a379d17-7d4e-459d-8385-2833167cb334 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:21.752017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a379d17-7d4e-459d-8385-2833167cb334 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:21.752267 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a379d17-7d4e-459d-8385-2833167cb334 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:21.753051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a379d17-7d4e-459d-8385-2833167cb334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:21.754686 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a379d17-7d4e-459d-8385-2833167cb334 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:21.766982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:21.770852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1158/2335] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:00:21.775289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518c404-a2f1-4357-93f7-df138ca6c8ad admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:21.786213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518c404-a2f1-4357-93f7-df138ca6c8ad admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:21.791485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa169bf7-3d4b-489a-9f35-f604e663ff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:21.792149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa169bf7-3d4b-489a-9f35-f604e663ff95 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:21.792496 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa169bf7-3d4b-489a-9f35-f604e663ff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:21.792796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa169bf7-3d4b-489a-9f35-f604e663ff95 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:21.793528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa169bf7-3d4b-489a-9f35-f604e663ff95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:21.795164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa169bf7-3d4b-489a-9f35-f604e663ff95 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:21.807056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1178/2336] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:00:21.811911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a379d17-7d4e-459d-8385-2833167cb334 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:21.823987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a379d17-7d4e-459d-8385-2833167cb334 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:21.829294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601f0b5-d87c-43cb-8644-846c1ba7cbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:21.830050 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601f0b5-d87c-43cb-8644-846c1ba7cbb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:21.830330 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601f0b5-d87c-43cb-8644-846c1ba7cbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:21.830624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601f0b5-d87c-43cb-8644-846c1ba7cbb4 admin admin] PATH_INFO: `/v3/projects/f57b37f31964437dba4bf5d1f73adc7a/users/8acaca49b9974f70b44ac5b708954d57/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:21.854463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601f0b5-d87c-43cb-8644-846c1ba7cbb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57b37f31964437dba4bf5d1f73adc7a, user_id=8acaca49b9974f70b44ac5b708954d57, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:21.857974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601f0b5-d87c-43cb-8644-846c1ba7cbb4 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:21.968624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1159/2337] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:00:21 2022] PUT /identity/v3/projects/f57b37f31964437dba4bf5d1f73adc7a/users/8acaca49b9974f70b44ac5b708954d57/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:21.982791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa50bc-419f-4944-ba40-0399c80e0056 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:21.983589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa50bc-419f-4944-ba40-0399c80e0056 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:21.983589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa50bc-419f-4944-ba40-0399c80e0056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:22.024118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-73fa50bc-419f-4944-ba40-0399c80e0056 None None] MFA Rules not processed for user `8acaca49b9974f70b44ac5b708954d57`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:22.028846 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-73fa50bc-419f-4944-ba40-0399c80e0056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:22.128946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1179/2338] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:22.139579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601f0b5-d87c-43cb-8644-846c1ba7cbb4 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:22.180989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa50bc-419f-4944-ba40-0399c80e0056 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:22.182685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-73fa50bc-419f-4944-ba40-0399c80e0056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:22.222197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601f0b5-d87c-43cb-8644-846c1ba7cbb4 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:22.228988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d48189-30f9-4e4d-9ec7-481d6fd8b5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:22.229675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d48189-30f9-4e4d-9ec7-481d6fd8b5dc admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:22.229981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d48189-30f9-4e4d-9ec7-481d6fd8b5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:22.230994 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d48189-30f9-4e4d-9ec7-481d6fd8b5dc admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:22.231155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d48189-30f9-4e4d-9ec7-481d6fd8b5dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:22.233393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d48189-30f9-4e4d-9ec7-481d6fd8b5dc admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:22.273196 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa50bc-419f-4944-ba40-0399c80e0056 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:22.278261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07e62f-6ad1-4b57-949f-fcfd6a04480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:22.279110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07e62f-6ad1-4b57-949f-fcfd6a04480a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:22.279393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07e62f-6ad1-4b57-949f-fcfd6a04480a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:22.279693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07e62f-6ad1-4b57-949f-fcfd6a04480a admin admin] PATH_INFO: `/v3/users/c33dc1b3531e49b1aed777e80e6a0a9b` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:22.281197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07e62f-6ad1-4b57-949f-fcfd6a04480a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33dc1b3531e49b1aed777e80e6a0a9b)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:22.283836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07e62f-6ad1-4b57-949f-fcfd6a04480a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:22.379684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1160/2339] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:00:22 2022] POST /identity/v3/projects => generated 381 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:00:22.383930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d48189-30f9-4e4d-9ec7-481d6fd8b5dc admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:22.463957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d48189-30f9-4e4d-9ec7-481d6fd8b5dc admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:22.468974 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b8ad1-b661-48c9-b08a-393472e96cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:22.469816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b8ad1-b661-48c9-b08a-393472e96cce admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:22.470094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b8ad1-b661-48c9-b08a-393472e96cce admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:22.470432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b8ad1-b661-48c9-b08a-393472e96cce admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:22.471300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b8ad1-b661-48c9-b08a-393472e96cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:22.473290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b8ad1-b661-48c9-b08a-393472e96cce admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:22.487570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:22.521911 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2e07e62f-6ad1-4b57-949f-fcfd6a04480a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33dc1b3531e49b1aed777e80e6a0a9b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:22.541538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2e07e62f-6ad1-4b57-949f-fcfd6a04480a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33dc1b3531e49b1aed777e80e6a0a9b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:22.551482 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2e07e62f-6ad1-4b57-949f-fcfd6a04480a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33dc1b3531e49b1aed777e80e6a0a9b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:22.596158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1161/2340] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:00:22 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:00:22.603037 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b8ad1-b661-48c9-b08a-393472e96cce admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:22.619844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b8ad1-b661-48c9-b08a-393472e96cce admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:22.626086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06655bf3-bd70-4b91-8daf-6619f6730402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:22.627818 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06655bf3-bd70-4b91-8daf-6619f6730402 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:22.628171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06655bf3-bd70-4b91-8daf-6619f6730402 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:22.628371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06655bf3-bd70-4b91-8daf-6619f6730402 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:22.630028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06655bf3-bd70-4b91-8daf-6619f6730402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:22.632325 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06655bf3-bd70-4b91-8daf-6619f6730402 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:22.664379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1162/2341] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:00:22.668271 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06655bf3-bd70-4b91-8daf-6619f6730402 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:22.679970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2e07e62f-6ad1-4b57-949f-fcfd6a04480a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33dc1b3531e49b1aed777e80e6a0a9b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:22.680669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2e07e62f-6ad1-4b57-949f-fcfd6a04480a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33dc1b3531e49b1aed777e80e6a0a9b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:22.682436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06655bf3-bd70-4b91-8daf-6619f6730402 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:22.689812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1180/2342] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:00:22 2022] DELETE /identity/v3/users/c33dc1b3531e49b1aed777e80e6a0a9b => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:22.695487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1add5e-54fc-4d93-95ca-8498f12be933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:22.695487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1add5e-54fc-4d93-95ca-8498f12be933 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:22.695487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1add5e-54fc-4d93-95ca-8498f12be933 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:22.695487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1add5e-54fc-4d93-95ca-8498f12be933 admin admin] PATH_INFO: `/v3/projects/a05bff2b6d364bd0878b057848b34cda/users/731410aa82444df48c35816d536a7c60/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:22.699120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e922f2-855d-4394-a94c-f48e475e748f None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:22.699503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e922f2-855d-4394-a94c-f48e475e748f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:22.699854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e922f2-855d-4394-a94c-f48e475e748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:22.714244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1add5e-54fc-4d93-95ca-8498f12be933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05bff2b6d364bd0878b057848b34cda, user_id=731410aa82444df48c35816d536a7c60, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:22.717040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1add5e-54fc-4d93-95ca-8498f12be933 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:22.721336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-91e922f2-855d-4394-a94c-f48e475e748f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:22.722676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-91e922f2-855d-4394-a94c-f48e475e748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:22.806652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1181/2343] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:00:22.810423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1163/2344] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:00:22 2022] PUT /identity/v3/projects/a05bff2b6d364bd0878b057848b34cda/users/731410aa82444df48c35816d536a7c60/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:22.815188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e922f2-855d-4394-a94c-f48e475e748f None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:22.817305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-91e922f2-855d-4394-a94c-f48e475e748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:22.822988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1add5e-54fc-4d93-95ca-8498f12be933 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:22.826549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6d1add5e-54fc-4d93-95ca-8498f12be933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:22.838911 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e922f2-855d-4394-a94c-f48e475e748f None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:22.926765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c6626-346e-44a4-b302-7ca4c45f61bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:22.930086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c6626-346e-44a4-b302-7ca4c45f61bc admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:22.930086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c6626-346e-44a4-b302-7ca4c45f61bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:22.930086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c6626-346e-44a4-b302-7ca4c45f61bc admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:22.931329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c6626-346e-44a4-b302-7ca4c45f61bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:22.934522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c6626-346e-44a4-b302-7ca4c45f61bc admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:22.953060 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1182/2345] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:00:22.954991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c6626-346e-44a4-b302-7ca4c45f61bc admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:22.968289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c6626-346e-44a4-b302-7ca4c45f61bc admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:22.973795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed32051-3218-4699-aa49-cc05234e3ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:22.974848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed32051-3218-4699-aa49-cc05234e3ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:22.975006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1add5e-54fc-4d93-95ca-8498f12be933 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:22.975472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed32051-3218-4699-aa49-cc05234e3ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:22.975472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed32051-3218-4699-aa49-cc05234e3ebe admin admin] PATH_INFO: `/v3/projects/a05bff2b6d364bd0878b057848b34cda/users/731410aa82444df48c35816d536a7c60/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:22.993840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3f2c-d03e-4344-9f17-dbe54c22c413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:23.005571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3f2c-d03e-4344-9f17-dbe54c22c413 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:23.005571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3f2c-d03e-4344-9f17-dbe54c22c413 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:23.005571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f3f2c-d03e-4344-9f17-dbe54c22c413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:23.006011 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed32051-3218-4699-aa49-cc05234e3ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05bff2b6d364bd0878b057848b34cda, user_id=731410aa82444df48c35816d536a7c60, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:23.006011 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed32051-3218-4699-aa49-cc05234e3ebe admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:23.007169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f3f2c-d03e-4344-9f17-dbe54c22c413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:23.008704 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f3f2c-d03e-4344-9f17-dbe54c22c413 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:23.018430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1183/2346] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:00:22 2022] PUT /identity/v3/projects/a05bff2b6d364bd0878b057848b34cda/users/731410aa82444df48c35816d536a7c60/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:00:23.020544 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1164/2347] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:00:23.031820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8c33a-d0d9-4837-925e-ec3e6197838c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:23.032104 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8c33a-d0d9-4837-925e-ec3e6197838c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:23.033927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8c33a-d0d9-4837-925e-ec3e6197838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:23.068289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a5b8c33a-d0d9-4837-925e-ec3e6197838c None None] MFA Rules not processed for user `731410aa82444df48c35816d536a7c60`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:23.068289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a5b8c33a-d0d9-4837-925e-ec3e6197838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:23.152508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1184/2348] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:23.172380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3f2c-d03e-4344-9f17-dbe54c22c413 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:23.175342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e70f3f2c-d03e-4344-9f17-dbe54c22c413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:23.196683 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:23.278425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f3f2c-d03e-4344-9f17-dbe54c22c413 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:23.377761 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4219a-08b2-45b1-862e-3a033f7f62af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:23.378606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4219a-08b2-45b1-862e-3a033f7f62af service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:23.378900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4219a-08b2-45b1-862e-3a033f7f62af service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:23.381561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4219a-08b2-45b1-862e-3a033f7f62af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:23.381561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-19d4219a-08b2-45b1-862e-3a033f7f62af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:23.510810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4219a-08b2-45b1-862e-3a033f7f62af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:23.514037 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4219a-08b2-45b1-862e-3a033f7f62af service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:23.530710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1165/2349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:00:23.547744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:23.723515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8c33a-d0d9-4837-925e-ec3e6197838c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:23.725381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a5b8c33a-d0d9-4837-925e-ec3e6197838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:23.812040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8c33a-d0d9-4837-925e-ec3e6197838c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:23.818024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:23.818883 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:23.819185 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:23.819436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] PATH_INFO: `/v3/projects/dd8f1c1c7a4b43809142c740c8cad06b` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:23.820674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8f1c1c7a4b43809142c740c8cad06b)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:23.823103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:23.891670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:24.083089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8f1c1c7a4b43809142c740c8cad06b', 'request_id': 'req-6d354ac2-c95f-4802-9b39-5d5d6598c93c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:24.089744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8f1c1c7a4b43809142c740c8cad06b', 'request_id': 'req-6d354ac2-c95f-4802-9b39-5d5d6598c93c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:24.096530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8f1c1c7a4b43809142c740c8cad06b', 'request_id': 'req-6d354ac2-c95f-4802-9b39-5d5d6598c93c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:24.205245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] The token cache is being invalidate because project dd8f1c1c7a4b43809142c740c8cad06b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:00:24.205245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:24.205245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:24.217062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1185/2350] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:00:23 2022] DELETE /identity/v3/projects/dd8f1c1c7a4b43809142c740c8cad06b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:25.360359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:25.394726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:26.496745 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:26.760395 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:27.320846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:27.497214 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:28.414831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:28.881300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:29.114907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:29.815812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:29.931916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:31.517796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4219a-08b2-45b1-862e-3a033f7f62af service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:31.519545 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-19d4219a-08b2-45b1-862e-3a033f7f62af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:31.569551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:31.634128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:31.694244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4219a-08b2-45b1-862e-3a033f7f62af service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:31.807945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e87a1-93ea-4613-a943-3c07b46c8570 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b218402abe6540d8b81295676199f6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:31.808768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e87a1-93ea-4613-a943-3c07b46c8570 service placement] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:31.809053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e87a1-93ea-4613-a943-3c07b46c8570 service placement] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:31.809327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e87a1-93ea-4613-a943-3c07b46c8570 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:31.811771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b73e87a1-93ea-4613-a943-3c07b46c8570 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:31.828629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e87a1-93ea-4613-a943-3c07b46c8570 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:31.831030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e87a1-93ea-4613-a943-3c07b46c8570 service placement] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:31.846313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1166/2351] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:00:32.249525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:32.251803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:32.339395 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d354ac2-c95f-4802-9b39-5d5d6598c93c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:32.348346 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6508f-e3a7-4d44-8a7a-71199c50fba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:32.349323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6508f-e3a7-4d44-8a7a-71199c50fba7 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:32.350010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6508f-e3a7-4d44-8a7a-71199c50fba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:32.350607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6508f-e3a7-4d44-8a7a-71199c50fba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:32.362144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5cd6508f-e3a7-4d44-8a7a-71199c50fba7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:32.449775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6508f-e3a7-4d44-8a7a-71199c50fba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:32.451850 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6508f-e3a7-4d44-8a7a-71199c50fba7 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:32.468685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1186/2352] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:00:32.691580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:32.802866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:34.128367 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:34.869314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:35.755469 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:35.965789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:36.054466 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cecef-69f6-44ac-a9ce-f582d5e248b2 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:36.055596 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cecef-69f6-44ac-a9ce-f582d5e248b2 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:36.056412 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cecef-69f6-44ac-a9ce-f582d5e248b2 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:36.059771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1167/2353] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 18:00:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 18:00:36.074864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36150dc2-39cc-470b-8bc3-728c44a9f327 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:36.075788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36150dc2-39cc-470b-8bc3-728c44a9f327 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:36.076451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36150dc2-39cc-470b-8bc3-728c44a9f327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:36.102297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-36150dc2-39cc-470b-8bc3-728c44a9f327 None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:36.103830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-36150dc2-39cc-470b-8bc3-728c44a9f327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:36.190225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1187/2354] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 18:00:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:36.202710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cecef-69f6-44ac-a9ce-f582d5e248b2 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:36.205265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e89cecef-69f6-44ac-a9ce-f582d5e248b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:36.274991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cecef-69f6-44ac-a9ce-f582d5e248b2 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:36.278543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d3388-ccc1-406b-832f-b257744e8ab6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '259d506eb54e4766a8fe3fa5bb514e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:36.279221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3388-ccc1-406b-832f-b257744e8ab6 service glance] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:36.279503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3388-ccc1-406b-832f-b257744e8ab6 service glance] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:36.279776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d3388-ccc1-406b-832f-b257744e8ab6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:36.292148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d3388-ccc1-406b-832f-b257744e8ab6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:36.293654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d3388-ccc1-406b-832f-b257744e8ab6 service glance] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:36.307887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1168/2355] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:00:36.828794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1ff98-0562-4c42-a9af-0fd2287a9bfb None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:36.829225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1ff98-0562-4c42-a9af-0fd2287a9bfb None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:36.829674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1ff98-0562-4c42-a9af-0fd2287a9bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:36.862179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a3c1ff98-0562-4c42-a9af-0fd2287a9bfb None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:36.864103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a3c1ff98-0562-4c42-a9af-0fd2287a9bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:36.874046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2256ebe-d6bf-434d-892d-cc5bc0f3a0e8 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:36.874715 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2256ebe-d6bf-434d-892d-cc5bc0f3a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:36.875103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2256ebe-d6bf-434d-892d-cc5bc0f3a0e8 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:36.878240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1169/2356] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 18:00:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 18:00:36.885074 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2d37-9b0c-4975-ae9a-a6dd024e5bd4 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:36.885676 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2d37-9b0c-4975-ae9a-a6dd024e5bd4 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:36.886221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2d37-9b0c-4975-ae9a-a6dd024e5bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:36.910883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-eb1c2d37-9b0c-4975-ae9a-a6dd024e5bd4 None None] MFA Rules not processed for user `11930f08a1324902a083436649660130`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:36.911627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-eb1c2d37-9b0c-4975-ae9a-a6dd024e5bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:36.942621 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1188/2357] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 18:00:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:36.961285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1ff98-0562-4c42-a9af-0fd2287a9bfb None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:36.977184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a3c1ff98-0562-4c42-a9af-0fd2287a9bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:36.990830 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1170/2358] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 18:00:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:00:37.005002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2d37-9b0c-4975-ae9a-a6dd024e5bd4 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:37.006524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-eb1c2d37-9b0c-4975-ae9a-a6dd024e5bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:37.017983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2d37-9b0c-4975-ae9a-a6dd024e5bd4 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:37.021635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af1f7-1f31-430d-bc8d-7643ed1acbe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:37.022300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af1f7-1f31-430d-bc8d-7643ed1acbe7 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:37.022576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af1f7-1f31-430d-bc8d-7643ed1acbe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:37.022853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af1f7-1f31-430d-bc8d-7643ed1acbe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:37.030915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007af1f7-1f31-430d-bc8d-7643ed1acbe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:37.032984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007af1f7-1f31-430d-bc8d-7643ed1acbe7 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:37.046821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1171/2359] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:00:37.066857 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1ff98-0562-4c42-a9af-0fd2287a9bfb None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:37.073844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74471aee-45a4-482a-9a39-a7cd30fc6c2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:37.074434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74471aee-45a4-482a-9a39-a7cd30fc6c2a service swift] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:37.074711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74471aee-45a4-482a-9a39-a7cd30fc6c2a service swift] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:37.075655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74471aee-45a4-482a-9a39-a7cd30fc6c2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:37.085927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74471aee-45a4-482a-9a39-a7cd30fc6c2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:37.087948 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74471aee-45a4-482a-9a39-a7cd30fc6c2a service swift] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:37.101493 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1189/2360] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:00:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 18:00:37.172380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:37.180375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e5106-e7cc-4fb2-a475-76ebf0d6fce2 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:37.181013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e5106-e7cc-4fb2-a475-76ebf0d6fce2 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:37.181299 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e5106-e7cc-4fb2-a475-76ebf0d6fce2 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:37.182843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1172/2361] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 18:00:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 18:00:37.205151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae77f5c-3fe7-498f-b3ce-c9734a2f2604 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:37.205640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae77f5c-3fe7-498f-b3ce-c9734a2f2604 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:37.206139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae77f5c-3fe7-498f-b3ce-c9734a2f2604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:37.237883 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-cae77f5c-3fe7-498f-b3ce-c9734a2f2604 None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:37.239153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-cae77f5c-3fe7-498f-b3ce-c9734a2f2604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:37.254378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1190/2362] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 18:00:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:37.265530 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e5106-e7cc-4fb2-a475-76ebf0d6fce2 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:37.279344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e5106-e7cc-4fb2-a475-76ebf0d6fce2 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:37.284268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1ea0d-8f82-4f98-84a2-a4f9c0ab6885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:37.284971 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1ea0d-8f82-4f98-84a2-a4f9c0ab6885 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:37.285274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1ea0d-8f82-4f98-84a2-a4f9c0ab6885 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:37.285557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1ea0d-8f82-4f98-84a2-a4f9c0ab6885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:37.316624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1ea0d-8f82-4f98-84a2-a4f9c0ab6885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:37.321017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1ea0d-8f82-4f98-84a2-a4f9c0ab6885 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:37.371317 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1173/2363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:00:37.537162 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:37.639526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:37.789743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:37.987384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:38.379001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:38.919988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:39.176802 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:39.314288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:39.905913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:40.027900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:40.423740 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:40.670946 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:41.106668 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae77f5c-3fe7-498f-b3ce-c9734a2f2604 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:41.110029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-cae77f5c-3fe7-498f-b3ce-c9734a2f2604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:41.123703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:41.148163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:41.259522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae77f5c-3fe7-498f-b3ce-c9734a2f2604 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:41.270039 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:41.272688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:41.272977 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:41.273262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] PATH_INFO: `/v3/users/8acaca49b9974f70b44ac5b708954d57` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:41.275408 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8acaca49b9974f70b44ac5b708954d57)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:41.277864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:41.292868 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:41.324954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:41.545142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8acaca49b9974f70b44ac5b708954d57'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:41.549142 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:41.583778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8acaca49b9974f70b44ac5b708954d57'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:41.609585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8acaca49b9974f70b44ac5b708954d57'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:41.737089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8acaca49b9974f70b44ac5b708954d57'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:41.737783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8acaca49b9974f70b44ac5b708954d57'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:41.744869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1191/2364] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:00:41 2022] DELETE /identity/v3/users/8acaca49b9974f70b44ac5b708954d57 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:41.749397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222ecee-d3a6-458b-a0cd-55d046031daf None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:41.749944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222ecee-d3a6-458b-a0cd-55d046031daf None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:41.749944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222ecee-d3a6-458b-a0cd-55d046031daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:41.765715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:41.776342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-0222ecee-d3a6-458b-a0cd-55d046031daf None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:41.777689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0222ecee-d3a6-458b-a0cd-55d046031daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:41.809103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:41.875855 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1174/2365] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:41.889010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:41.900833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:41.948674 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:41.983219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:42.056667 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8fc05-ffcf-4f63-a5b7-2cfd0a6fc455 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:42.065003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632086d-6342-47bc-a209-6b946bcfa8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:42.066240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632086d-6342-47bc-a209-6b946bcfa8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:42.066427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:42.066940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632086d-6342-47bc-a209-6b946bcfa8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:42.067554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632086d-6342-47bc-a209-6b946bcfa8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:42.087991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632086d-6342-47bc-a209-6b946bcfa8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:42.094389 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632086d-6342-47bc-a209-6b946bcfa8f4 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:42.119013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1192/2366] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:00:42.182433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:42.208420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:42.692628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:42.914215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:43.008696 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222ecee-d3a6-458b-a0cd-55d046031daf None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:43.010772 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0222ecee-d3a6-458b-a0cd-55d046031daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:43.032284 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222ecee-d3a6-458b-a0cd-55d046031daf None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:43.045197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:43.048301 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:43.051431 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:43.052380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6 admin admin] PATH_INFO: `/v3/projects/f57b37f31964437dba4bf5d1f73adc7a` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:43.055640 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57b37f31964437dba4bf5d1f73adc7a)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:43.060964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:43.193018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57b37f31964437dba4bf5d1f73adc7a', 'request_id': 'req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:43.202181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57b37f31964437dba4bf5d1f73adc7a', 'request_id': 'req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:43.290972 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57b37f31964437dba4bf5d1f73adc7a', 'request_id': 'req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:43.313122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6 admin admin] The token cache is being invalidate because project f57b37f31964437dba4bf5d1f73adc7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:00:43.313629 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:43.315255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-1da49cba-10fc-4c98-aff9-ad31ddf64ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:43.318794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1175/2367] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:00:43 2022] DELETE /identity/v3/projects/f57b37f31964437dba4bf5d1f73adc7a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:00:43.324436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632086d-6342-47bc-a209-6b946bcfa8f4 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:43.343318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632086d-6342-47bc-a209-6b946bcfa8f4 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:43.387935 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:43.420466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:43.482416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:43.484193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:43.485941 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:43.486924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] PATH_INFO: `/v3/users/731410aa82444df48c35816d536a7c60` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:43.489728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=731410aa82444df48c35816d536a7c60)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:43.492004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:43.505200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:43.519602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:43.652328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:43.719154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731410aa82444df48c35816d536a7c60'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:43.749151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731410aa82444df48c35816d536a7c60'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:43.769326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731410aa82444df48c35816d536a7c60'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:43.795760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:43.868020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731410aa82444df48c35816d536a7c60'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:43.868705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731410aa82444df48c35816d536a7c60'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:43.887629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1193/2368] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:00:43 2022] DELETE /identity/v3/users/731410aa82444df48c35816d536a7c60 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:44.534981 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:44.632710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a6473-1a06-46bb-91c6-b65fdc55d5d4 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:44.633322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a6473-1a06-46bb-91c6-b65fdc55d5d4 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:44.633322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a6473-1a06-46bb-91c6-b65fdc55d5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:44.655514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-1c8a6473-1a06-46bb-91c6-b65fdc55d5d4 None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:44.659847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-1c8a6473-1a06-46bb-91c6-b65fdc55d5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:44.689657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:44.691207 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:44.715674 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:44.819379 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dd006-d8f0-4735-a244-8d7a3d625d13 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:44.825119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47e672-212b-4eed-8e30-aeb00122a968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:44.825999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47e672-212b-4eed-8e30-aeb00122a968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:44.826313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47e672-212b-4eed-8e30-aeb00122a968 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:44.826837 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47e672-212b-4eed-8e30-aeb00122a968 admin admin] PATH_INFO: `/v3/projects/a05bff2b6d364bd0878b057848b34cda` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:44.830240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47e672-212b-4eed-8e30-aeb00122a968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05bff2b6d364bd0878b057848b34cda)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:44.832246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47e672-212b-4eed-8e30-aeb00122a968 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:44.926249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1176/2369] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 18:00:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:44.958538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a6473-1a06-46bb-91c6-b65fdc55d5d4 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:44.958538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-1c8a6473-1a06-46bb-91c6-b65fdc55d5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:45.026562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:45.045985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0c47e672-212b-4eed-8e30-aeb00122a968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05bff2b6d364bd0878b057848b34cda', 'request_id': 'req-0c47e672-212b-4eed-8e30-aeb00122a968'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:45.055379 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0c47e672-212b-4eed-8e30-aeb00122a968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05bff2b6d364bd0878b057848b34cda', 'request_id': 'req-0c47e672-212b-4eed-8e30-aeb00122a968'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:45.064622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0c47e672-212b-4eed-8e30-aeb00122a968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05bff2b6d364bd0878b057848b34cda', 'request_id': 'req-0c47e672-212b-4eed-8e30-aeb00122a968'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:45.104135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a6473-1a06-46bb-91c6-b65fdc55d5d4 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:45.173334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0c47e672-212b-4eed-8e30-aeb00122a968 admin admin] The token cache is being invalidate because project a05bff2b6d364bd0878b057848b34cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:00:45.177769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0c47e672-212b-4eed-8e30-aeb00122a968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:45.180264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0c47e672-212b-4eed-8e30-aeb00122a968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:00:45.187359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1194/2370] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:00:44 2022] DELETE /identity/v3/projects/a05bff2b6d364bd0878b057848b34cda => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:45.193601 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660857be-1cef-4b8b-b4c6-c02b177dafbf None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:45.193920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660857be-1cef-4b8b-b4c6-c02b177dafbf None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:45.194224 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660857be-1cef-4b8b-b4c6-c02b177dafbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:45.224139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-660857be-1cef-4b8b-b4c6-c02b177dafbf None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:45.225940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-660857be-1cef-4b8b-b4c6-c02b177dafbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:45.261168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d490ef-5876-4dde-97d4-e6bac05c406f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:45.262867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d490ef-5876-4dde-97d4-e6bac05c406f service swift] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:45.263623 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d490ef-5876-4dde-97d4-e6bac05c406f service swift] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:45.264506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d490ef-5876-4dde-97d4-e6bac05c406f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:45.267243 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-72d490ef-5876-4dde-97d4-e6bac05c406f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:45.332163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1195/2371] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:45.341470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbc219-9620-4cac-ba35-1d1f7f389cde None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:45.341470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbc219-9620-4cac-ba35-1d1f7f389cde None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:45.341805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbc219-9620-4cac-ba35-1d1f7f389cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:45.363878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-8bbbc219-9620-4cac-ba35-1d1f7f389cde None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:45.365140 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-8bbbc219-9620-4cac-ba35-1d1f7f389cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:45.373883 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1196/2372] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:00:45.378445 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbc219-9620-4cac-ba35-1d1f7f389cde None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:45.389017 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbc219-9620-4cac-ba35-1d1f7f389cde None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:45.395223 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8149171-59f4-4daa-8596-e6b583f22e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:45.400916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d490ef-5876-4dde-97d4-e6bac05c406f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:45.401625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149171-59f4-4daa-8596-e6b583f22e7f admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:45.401625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149171-59f4-4daa-8596-e6b583f22e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:45.401625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8149171-59f4-4daa-8596-e6b583f22e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:45.401865 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d490ef-5876-4dde-97d4-e6bac05c406f service swift] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:45.401966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8149171-59f4-4daa-8596-e6b583f22e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:00:45.401966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8149171-59f4-4daa-8596-e6b583f22e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:45.401966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8149171-59f4-4daa-8596-e6b583f22e7f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:45.409548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1177/2373] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:00:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 18:00:45.423897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1197/2374] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 18:00:45.428607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d490ef-5876-4dde-97d4-e6bac05c406f service swift] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:45.439779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d490ef-5876-4dde-97d4-e6bac05c406f service swift] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:45.444930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653993b5-b0a5-4e7f-8a36-a79cdf4dd7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:45.445599 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653993b5-b0a5-4e7f-8a36-a79cdf4dd7bb admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:45.445885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653993b5-b0a5-4e7f-8a36-a79cdf4dd7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:45.456506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653993b5-b0a5-4e7f-8a36-a79cdf4dd7bb admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:45.456506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653993b5-b0a5-4e7f-8a36-a79cdf4dd7bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:45.456506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653993b5-b0a5-4e7f-8a36-a79cdf4dd7bb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:45.547258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1178/2375] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:00:45 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:00:45.548502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8149171-59f4-4daa-8596-e6b583f22e7f admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:45.559273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8149171-59f4-4daa-8596-e6b583f22e7f admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:45.698423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dd55f-9d7f-429c-9fec-b80ecc611c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:45.702006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dd55f-9d7f-429c-9fec-b80ecc611c2e admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:45.704696 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dd55f-9d7f-429c-9fec-b80ecc611c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:45.717308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dd55f-9d7f-429c-9fec-b80ecc611c2e admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:45.718634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dd55f-9d7f-429c-9fec-b80ecc611c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:45.730696 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dd55f-9d7f-429c-9fec-b80ecc611c2e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:45.736840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:45.860637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1198/2376] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:00:45 2022] POST /identity/v3/users => generated 289 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:00:45.866433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653993b5-b0a5-4e7f-8a36-a79cdf4dd7bb admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:45.895802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653993b5-b0a5-4e7f-8a36-a79cdf4dd7bb admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:45.903312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960b54c-4d5f-4f26-9478-cdad2ab70350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:45.904790 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960b54c-4d5f-4f26-9478-cdad2ab70350 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:45.905824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960b54c-4d5f-4f26-9478-cdad2ab70350 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:45.906381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960b54c-4d5f-4f26-9478-cdad2ab70350 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:45.908970 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960b54c-4d5f-4f26-9478-cdad2ab70350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:45.913900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960b54c-4d5f-4f26-9478-cdad2ab70350 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:45.949028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1179/2377] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:00:45.949708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dd55f-9d7f-429c-9fec-b80ecc611c2e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:45.965407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dd55f-9d7f-429c-9fec-b80ecc611c2e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:45.993529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b83ec3-374a-418b-b9c9-de0d84b9e904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:45.994336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b83ec3-374a-418b-b9c9-de0d84b9e904 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:45.994666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b83ec3-374a-418b-b9c9-de0d84b9e904 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:45.994798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b83ec3-374a-418b-b9c9-de0d84b9e904 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:45.995622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b83ec3-374a-418b-b9c9-de0d84b9e904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:45.997315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b83ec3-374a-418b-b9c9-de0d84b9e904 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:46.020805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1199/2378] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:00:46.030694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960b54c-4d5f-4f26-9478-cdad2ab70350 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:46.053965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960b54c-4d5f-4f26-9478-cdad2ab70350 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:46.061783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba43da-d760-4878-81d0-c2c226c111d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:46.062920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba43da-d760-4878-81d0-c2c226c111d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:46.064327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba43da-d760-4878-81d0-c2c226c111d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:46.064928 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba43da-d760-4878-81d0-c2c226c111d1 admin admin] PATH_INFO: `/v3/projects/1f81fa833229461db6fa5163e16fe1e8/users/88f35102d0bd4bb4bdb10ba8a70f5ff7/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:46.087231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba43da-d760-4878-81d0-c2c226c111d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f81fa833229461db6fa5163e16fe1e8, user_id=88f35102d0bd4bb4bdb10ba8a70f5ff7, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:46.090174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba43da-d760-4878-81d0-c2c226c111d1 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:46.201004 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1180/2379] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:00:46 2022] PUT /identity/v3/projects/1f81fa833229461db6fa5163e16fe1e8/users/88f35102d0bd4bb4bdb10ba8a70f5ff7/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:46.206293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e1da6-c254-4840-9de0-b61ec6d53894 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:46.206792 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e1da6-c254-4840-9de0-b61ec6d53894 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:46.207299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e1da6-c254-4840-9de0-b61ec6d53894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:46.232141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:46.251249 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-364e1da6-c254-4840-9de0-b61ec6d53894 None None] MFA Rules not processed for user `88f35102d0bd4bb4bdb10ba8a70f5ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:46.253336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-364e1da6-c254-4840-9de0-b61ec6d53894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:46.296874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:46.349613 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1200/2380] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:00:46.354640 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba43da-d760-4878-81d0-c2c226c111d1 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:46.519778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:46.549965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba43da-d760-4878-81d0-c2c226c111d1 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:46.571238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dbe5f-a82f-4c79-82cf-10c270b67ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:46.571882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dbe5f-a82f-4c79-82cf-10c270b67ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:46.572174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dbe5f-a82f-4c79-82cf-10c270b67ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:46.572455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dbe5f-a82f-4c79-82cf-10c270b67ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:46.573194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17dbe5f-a82f-4c79-82cf-10c270b67ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:46.575355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17dbe5f-a82f-4c79-82cf-10c270b67ef8 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:46.632144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:46.715740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1181/2381] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:00:46 2022] POST /identity/v3/projects => generated 377 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:00:46.716098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e1da6-c254-4840-9de0-b61ec6d53894 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:46.736680 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e1da6-c254-4840-9de0-b61ec6d53894 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:46.865485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cf7eb-ce3f-4322-96e0-1302e1de9b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:46.866287 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cf7eb-ce3f-4322-96e0-1302e1de9b96 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:46.866567 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cf7eb-ce3f-4322-96e0-1302e1de9b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:46.866842 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cf7eb-ce3f-4322-96e0-1302e1de9b96 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:46.868069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cf7eb-ce3f-4322-96e0-1302e1de9b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:46.871055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cf7eb-ce3f-4322-96e0-1302e1de9b96 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:46.972791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1201/2382] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:00:46 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:00:46.977368 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dbe5f-a82f-4c79-82cf-10c270b67ef8 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:47.003308 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dbe5f-a82f-4c79-82cf-10c270b67ef8 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:47.019122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fdd4d-f718-4a13-bac5-9c61e3fd323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:47.020081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fdd4d-f718-4a13-bac5-9c61e3fd323d admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:47.020256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fdd4d-f718-4a13-bac5-9c61e3fd323d admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:47.021036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fdd4d-f718-4a13-bac5-9c61e3fd323d admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:47.021476 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fdd4d-f718-4a13-bac5-9c61e3fd323d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:47.023059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fdd4d-f718-4a13-bac5-9c61e3fd323d admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:47.055471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1182/2383] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:00:47.056995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cf7eb-ce3f-4322-96e0-1302e1de9b96 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:47.061478 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:47.075573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cf7eb-ce3f-4322-96e0-1302e1de9b96 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:47.099014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d2d0f-47a9-4250-8bc9-e604f4b03142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:47.099719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d2d0f-47a9-4250-8bc9-e604f4b03142 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:47.102589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:47.103550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d2d0f-47a9-4250-8bc9-e604f4b03142 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:47.103860 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d2d0f-47a9-4250-8bc9-e604f4b03142 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:47.106254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d2d0f-47a9-4250-8bc9-e604f4b03142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:47.106454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d2d0f-47a9-4250-8bc9-e604f4b03142 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:47.131489 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1202/2384] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:00:47.135740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fdd4d-f718-4a13-bac5-9c61e3fd323d admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:47.155734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fdd4d-f718-4a13-bac5-9c61e3fd323d admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:47.178559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8fa4-42cb-417b-942a-5efdeefc5886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:47.179718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8fa4-42cb-417b-942a-5efdeefc5886 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:47.180135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8fa4-42cb-417b-942a-5efdeefc5886 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:47.181006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8fa4-42cb-417b-942a-5efdeefc5886 admin admin] PATH_INFO: `/v3/projects/c8f9725beb5d499b9ad3a15078ba0fbc/users/78889a48455a4e6390e1eff6867fdc91/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:47.214063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a8fa4-42cb-417b-942a-5efdeefc5886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f9725beb5d499b9ad3a15078ba0fbc, user_id=78889a48455a4e6390e1eff6867fdc91, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:47.225710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a8fa4-42cb-417b-942a-5efdeefc5886 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:47.343607 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1183/2385] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:00:47 2022] PUT /identity/v3/projects/c8f9725beb5d499b9ad3a15078ba0fbc/users/78889a48455a4e6390e1eff6867fdc91/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:47.355470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694766eb-26be-447f-a8cd-182c257c9b93 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:47.355747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694766eb-26be-447f-a8cd-182c257c9b93 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:47.356066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694766eb-26be-447f-a8cd-182c257c9b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:47.457992 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-694766eb-26be-447f-a8cd-182c257c9b93 None None] MFA Rules not processed for user `78889a48455a4e6390e1eff6867fdc91`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:47.459335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-694766eb-26be-447f-a8cd-182c257c9b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:47.530165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:47.636836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1203/2386] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:00:47.637987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8fa4-42cb-417b-942a-5efdeefc5886 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:47.685024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:47.853456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8fa4-42cb-417b-942a-5efdeefc5886 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:47.853456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ade36-4e1d-4032-86f1-9e81b4cf81d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:47.853456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ade36-4e1d-4032-86f1-9e81b4cf81d7 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:47.853456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ade36-4e1d-4032-86f1-9e81b4cf81d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:47.854235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ade36-4e1d-4032-86f1-9e81b4cf81d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:47.854235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ade36-4e1d-4032-86f1-9e81b4cf81d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:47.854235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ade36-4e1d-4032-86f1-9e81b4cf81d7 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:48.057057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:48.243795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:48.255743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1184/2387] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:00:47 2022] POST /identity/v3/projects => generated 377 bytes in 614 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:00:48.259105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694766eb-26be-447f-a8cd-182c257c9b93 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:48.271867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694766eb-26be-447f-a8cd-182c257c9b93 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:48.364825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5f432-0922-4d1e-9f2c-83c05dc916e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:48.365773 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5f432-0922-4d1e-9f2c-83c05dc916e6 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:48.366010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5f432-0922-4d1e-9f2c-83c05dc916e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:48.366321 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5f432-0922-4d1e-9f2c-83c05dc916e6 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:48.367085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5f432-0922-4d1e-9f2c-83c05dc916e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:48.383266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5f432-0922-4d1e-9f2c-83c05dc916e6 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:48.513721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1204/2388] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:00:48 2022] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:00:48.517096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ade36-4e1d-4032-86f1-9e81b4cf81d7 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:48.541555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ade36-4e1d-4032-86f1-9e81b4cf81d7 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:48.557468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468dc5-4e17-4b34-b1e8-bb806660aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:48.558774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468dc5-4e17-4b34-b1e8-bb806660aea1 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:48.559224 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468dc5-4e17-4b34-b1e8-bb806660aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:48.559677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468dc5-4e17-4b34-b1e8-bb806660aea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:48.561592 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da468dc5-4e17-4b34-b1e8-bb806660aea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:48.566808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da468dc5-4e17-4b34-b1e8-bb806660aea1 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:48.612551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1185/2389] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:00:48.615065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5f432-0922-4d1e-9f2c-83c05dc916e6 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:48.640587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5f432-0922-4d1e-9f2c-83c05dc916e6 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:48.656422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206ebe5-017c-4d47-99e6-5df26a7fa348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:48.669002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206ebe5-017c-4d47-99e6-5df26a7fa348 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:48.669831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206ebe5-017c-4d47-99e6-5df26a7fa348 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:48.670333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206ebe5-017c-4d47-99e6-5df26a7fa348 admin admin] PATH_INFO: `/v3/projects/7896f289d4784a0aaad516f04e28b31a/users/4e875113b5ef4607a41348f3581131de/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:48.710512 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206ebe5-017c-4d47-99e6-5df26a7fa348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7896f289d4784a0aaad516f04e28b31a, user_id=4e875113b5ef4607a41348f3581131de, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:48.724709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206ebe5-017c-4d47-99e6-5df26a7fa348 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:48.822352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:48.847766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468dc5-4e17-4b34-b1e8-bb806660aea1 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:48.857461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1205/2390] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:00:48 2022] PUT /identity/v3/projects/7896f289d4784a0aaad516f04e28b31a/users/4e875113b5ef4607a41348f3581131de/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:48.867165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468dc5-4e17-4b34-b1e8-bb806660aea1 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:48.966567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e6011-1511-4ed6-ba32-ed460c634b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:48.967682 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6011-1511-4ed6-ba32-ed460c634b15 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:48.968191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6011-1511-4ed6-ba32-ed460c634b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:48.968774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6011-1511-4ed6-ba32-ed460c634b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:48.970463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e6011-1511-4ed6-ba32-ed460c634b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:48.972892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e6011-1511-4ed6-ba32-ed460c634b15 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:48.993358 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206ebe5-017c-4d47-99e6-5df26a7fa348 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:48.995794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1186/2391] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:00:49.006545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206ebe5-017c-4d47-99e6-5df26a7fa348 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:49.029339 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0290a-a1cc-493e-aabe-c76a33679bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:49.030396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0290a-a1cc-493e-aabe-c76a33679bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:49.030870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0290a-a1cc-493e-aabe-c76a33679bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:49.031112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0290a-a1cc-493e-aabe-c76a33679bd9 admin admin] PATH_INFO: `/v3/projects/7896f289d4784a0aaad516f04e28b31a/users/4e875113b5ef4607a41348f3581131de/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:49.035174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0290a-a1cc-493e-aabe-c76a33679bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7896f289d4784a0aaad516f04e28b31a, user_id=4e875113b5ef4607a41348f3581131de, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:49.050485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0290a-a1cc-493e-aabe-c76a33679bd9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:49.133297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1206/2392] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:00:48 2022] PUT /identity/v3/projects/7896f289d4784a0aaad516f04e28b31a/users/4e875113b5ef4607a41348f3581131de/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:00:49.252337 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df1b64-bd2d-4817-9524-03b836454ac5 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:49.278834 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df1b64-bd2d-4817-9524-03b836454ac5 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:49.282744 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df1b64-bd2d-4817-9524-03b836454ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:49.371481 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-82df1b64-bd2d-4817-9524-03b836454ac5 None None] MFA Rules not processed for user `4e875113b5ef4607a41348f3581131de`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:00:49.373900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-82df1b64-bd2d-4817-9524-03b836454ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:49.476653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1187/2393] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:00:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:00:49.489367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0290a-a1cc-493e-aabe-c76a33679bd9 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:49.491317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-45f0290a-a1cc-493e-aabe-c76a33679bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:49.561533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0290a-a1cc-493e-aabe-c76a33679bd9 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:49.566313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df387f-b3cf-4422-864f-0f55e7c2760c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:49.567009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df387f-b3cf-4422-864f-0f55e7c2760c service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:49.567297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df387f-b3cf-4422-864f-0f55e7c2760c service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:49.567573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df387f-b3cf-4422-864f-0f55e7c2760c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:49.654273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df387f-b3cf-4422-864f-0f55e7c2760c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:49.655929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df387f-b3cf-4422-864f-0f55e7c2760c service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:49.677081 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1207/2394] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:00:50.693245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:51.081054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:51.537657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:52.321688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:52.634423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:53.849277 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df1b64-bd2d-4817-9524-03b836454ac5 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:53.868021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df1b64-bd2d-4817-9524-03b836454ac5 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:53.872534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed845bab-d769-42d4-8360-3ede0564d0d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:53.873305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed845bab-d769-42d4-8360-3ede0564d0d7 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:53.873663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed845bab-d769-42d4-8360-3ede0564d0d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:53.874678 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed845bab-d769-42d4-8360-3ede0564d0d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:54.000878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed845bab-d769-42d4-8360-3ede0564d0d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:54.003799 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed845bab-d769-42d4-8360-3ede0564d0d7 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:54.016296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1188/2395] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:00:56.243619 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df387f-b3cf-4422-864f-0f55e7c2760c service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:56.260927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df387f-b3cf-4422-864f-0f55e7c2760c service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:56.330051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e22f1-f3a9-4783-a4fe-4d3d948c8783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:56.331433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e22f1-f3a9-4783-a4fe-4d3d948c8783 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:56.334179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e22f1-f3a9-4783-a4fe-4d3d948c8783 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:56.334825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e22f1-f3a9-4783-a4fe-4d3d948c8783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:56.388416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e22f1-f3a9-4783-a4fe-4d3d948c8783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:56.392090 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e22f1-f3a9-4783-a4fe-4d3d948c8783 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:56.430709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1208/2396] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:00:57.223156 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed845bab-d769-42d4-8360-3ede0564d0d7 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:00:57.227388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ed845bab-d769-42d4-8360-3ede0564d0d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:57.245257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:00:57.299723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed845bab-d769-42d4-8360-3ede0564d0d7 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:00:57.303527 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbee7a-c51c-40dd-94bc-f89b609e5b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:00:57.304181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbee7a-c51c-40dd-94bc-f89b609e5b1e service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:00:57.304526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbee7a-c51c-40dd-94bc-f89b609e5b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:00:57.304832 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbee7a-c51c-40dd-94bc-f89b609e5b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:00:57.306719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-46cbee7a-c51c-40dd-94bc-f89b609e5b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:00:57.398903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbee7a-c51c-40dd-94bc-f89b609e5b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:00:57.400589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbee7a-c51c-40dd-94bc-f89b609e5b1e service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:00:57.411105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1189/2397] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:00:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:01:00.873646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093c06-57bf-470c-81b1-289b5822bddc None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:00.875112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093c06-57bf-470c-81b1-289b5822bddc None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:00.875556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093c06-57bf-470c-81b1-289b5822bddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:00.898277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-01093c06-57bf-470c-81b1-289b5822bddc None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:00.899847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-01093c06-57bf-470c-81b1-289b5822bddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:00.932577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:01.039526 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbee7a-c51c-40dd-94bc-f89b609e5b1e service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:01.055797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1209/2398] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jul 20 18:01:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:01:01.056203 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-46cbee7a-c51c-40dd-94bc-f89b609e5b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:01.169218 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbee7a-c51c-40dd-94bc-f89b609e5b1e service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:01.176316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c31ff-8d27-4636-a91f-a26e1b752bf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:01.177115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c31ff-8d27-4636-a91f-a26e1b752bf7 service swift] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:01.177415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c31ff-8d27-4636-a91f-a26e1b752bf7 service swift] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:01.177711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c31ff-8d27-4636-a91f-a26e1b752bf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:01.188468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c31ff-8d27-4636-a91f-a26e1b752bf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:01.190363 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c31ff-8d27-4636-a91f-a26e1b752bf7 service swift] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:01.201435 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1190/2399] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:01:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 18:01:03.361539 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093c06-57bf-470c-81b1-289b5822bddc None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:03.455629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093c06-57bf-470c-81b1-289b5822bddc None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:03.460125 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:03.461250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:03.461250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:03.462136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] PATH_INFO: `/v3/users/88f35102d0bd4bb4bdb10ba8a70f5ff7` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:03.462866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f35102d0bd4bb4bdb10ba8a70f5ff7)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:03.464852 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:03.707858 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f35102d0bd4bb4bdb10ba8a70f5ff7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:03.722428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f35102d0bd4bb4bdb10ba8a70f5ff7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:03.729576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f35102d0bd4bb4bdb10ba8a70f5ff7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:03.837848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f35102d0bd4bb4bdb10ba8a70f5ff7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:03.838622 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f35102d0bd4bb4bdb10ba8a70f5ff7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:03.846248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1210/2400] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:01:03 2022] DELETE /identity/v3/users/88f35102d0bd4bb4bdb10ba8a70f5ff7 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:01:03.853910 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1354011-9a83-4f47-9a9a-0c9256611505 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:03.854481 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1354011-9a83-4f47-9a9a-0c9256611505 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:03.854643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1354011-9a83-4f47-9a9a-0c9256611505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:03.878001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c1354011-9a83-4f47-9a9a-0c9256611505 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:03.879334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c1354011-9a83-4f47-9a9a-0c9256611505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:03.963035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:03.988043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1191/2401] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:01:04.002801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:04.004602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:04.116630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a45222-44ef-48a9-be8c-43e738d890dd admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:04.120783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d03dd-e490-4afe-bb74-90399f95ec99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:04.121454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d03dd-e490-4afe-bb74-90399f95ec99 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:04.121793 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d03dd-e490-4afe-bb74-90399f95ec99 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:04.122080 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d03dd-e490-4afe-bb74-90399f95ec99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:04.129377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:04.135926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d03dd-e490-4afe-bb74-90399f95ec99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:04.135926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d03dd-e490-4afe-bb74-90399f95ec99 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:04.147331 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1211/2402] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:01:04.796928 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1354011-9a83-4f47-9a9a-0c9256611505 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:04.798605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c1354011-9a83-4f47-9a9a-0c9256611505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:04.815600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1354011-9a83-4f47-9a9a-0c9256611505 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:04.847270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:04.849233 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:04.851615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:04.852749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] PATH_INFO: `/v3/projects/1f81fa833229461db6fa5163e16fe1e8` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:04.855873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f81fa833229461db6fa5163e16fe1e8)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:04.860696 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:05.022745 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f81fa833229461db6fa5163e16fe1e8', 'request_id': 'req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.028617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f81fa833229461db6fa5163e16fe1e8', 'request_id': 'req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.114133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d03dd-e490-4afe-bb74-90399f95ec99 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:05.115746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-314d03dd-e490-4afe-bb74-90399f95ec99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:05.125374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f81fa833229461db6fa5163e16fe1e8', 'request_id': 'req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.160171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d03dd-e490-4afe-bb74-90399f95ec99 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:05.160983 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] The token cache is being invalidate because project 1f81fa833229461db6fa5163e16fe1e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:01:05.161544 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.164458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.167993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1192/2403] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:01:04 2022] DELETE /identity/v3/projects/1f81fa833229461db6fa5163e16fe1e8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:01:05.172507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:05.176508 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:05.275890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:05.277152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:05.277770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:05.278050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] PATH_INFO: `/v3/users/ae98633baddd4dd19516a1ee4cff0e32` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:05.280246 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae98633baddd4dd19516a1ee4cff0e32)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:05.282295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:05.294376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aeb78-f24d-4fe8-a63c-2f2fe9fece1c admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:05.301380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:05.302437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:05.302824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:05.303202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] PATH_INFO: `/v3/users/78889a48455a4e6390e1eff6867fdc91` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:05.305024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78889a48455a4e6390e1eff6867fdc91)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:05.307210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:05.441193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae98633baddd4dd19516a1ee4cff0e32'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.453868 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae98633baddd4dd19516a1ee4cff0e32'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.457480 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78889a48455a4e6390e1eff6867fdc91'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.460645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae98633baddd4dd19516a1ee4cff0e32'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.470704 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78889a48455a4e6390e1eff6867fdc91'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.477925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78889a48455a4e6390e1eff6867fdc91'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.482608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:05.529152 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae98633baddd4dd19516a1ee4cff0e32'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.529751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae98633baddd4dd19516a1ee4cff0e32'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.536922 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1212/2404] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:01:05 2022] DELETE /identity/v3/users/ae98633baddd4dd19516a1ee4cff0e32 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:01:05.586273 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78889a48455a4e6390e1eff6867fdc91'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.587030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78889a48455a4e6390e1eff6867fdc91'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:05.594415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1193/2405] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:01:05 2022] DELETE /identity/v3/users/78889a48455a4e6390e1eff6867fdc91 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:01:05.908773 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:05.910376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:05.991297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b58ee1-6e39-4503-88c1-43bc8c5bb242 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:06.008598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:06.060373 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41183e6-71ae-43b4-802d-199c1ec9b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:06.061207 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41183e6-71ae-43b4-802d-199c1ec9b2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:06.061486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41183e6-71ae-43b4-802d-199c1ec9b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:06.062284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41183e6-71ae-43b4-802d-199c1ec9b2c4 admin admin] PATH_INFO: `/v3/projects/dce83dfedf94430eb9a35ef4e8c199d3` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:06.063499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41183e6-71ae-43b4-802d-199c1ec9b2c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce83dfedf94430eb9a35ef4e8c199d3)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:06.065650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41183e6-71ae-43b4-802d-199c1ec9b2c4 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:06.109597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:06.111242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:06.126307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39213bfa-2eab-4907-8dbd-e7b91a677cc5 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:06.131648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:06.132635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:06.132915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:06.133188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] PATH_INFO: `/v3/projects/c8f9725beb5d499b9ad3a15078ba0fbc` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:06.135015 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f9725beb5d499b9ad3a15078ba0fbc)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:06.137023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:06.228751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c41183e6-71ae-43b4-802d-199c1ec9b2c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce83dfedf94430eb9a35ef4e8c199d3', 'request_id': 'req-c41183e6-71ae-43b4-802d-199c1ec9b2c4'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.235664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c41183e6-71ae-43b4-802d-199c1ec9b2c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce83dfedf94430eb9a35ef4e8c199d3', 'request_id': 'req-c41183e6-71ae-43b4-802d-199c1ec9b2c4'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.242226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c41183e6-71ae-43b4-802d-199c1ec9b2c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce83dfedf94430eb9a35ef4e8c199d3', 'request_id': 'req-c41183e6-71ae-43b4-802d-199c1ec9b2c4'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.278003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f9725beb5d499b9ad3a15078ba0fbc', 'request_id': 'req-8e758034-5333-48ef-a764-392c388db0e9'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.286666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f9725beb5d499b9ad3a15078ba0fbc', 'request_id': 'req-8e758034-5333-48ef-a764-392c388db0e9'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.389728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c41183e6-71ae-43b4-802d-199c1ec9b2c4 admin admin] The token cache is being invalidate because project dce83dfedf94430eb9a35ef4e8c199d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:01:06.390394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c41183e6-71ae-43b4-802d-199c1ec9b2c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.391608 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-c41183e6-71ae-43b4-802d-199c1ec9b2c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.395635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1213/2406] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:01:05 2022] DELETE /identity/v3/projects/dce83dfedf94430eb9a35ef4e8c199d3 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:01:06.400411 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ef305-4907-4727-bb6f-aca0c4306925 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:06.401027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ef305-4907-4727-bb6f-aca0c4306925 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:06.401541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ef305-4907-4727-bb6f-aca0c4306925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:06.429766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-296ef305-4907-4727-bb6f-aca0c4306925 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:06.431369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-296ef305-4907-4727-bb6f-aca0c4306925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:06.506805 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f9725beb5d499b9ad3a15078ba0fbc', 'request_id': 'req-8e758034-5333-48ef-a764-392c388db0e9'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.511497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1214/2407] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:01:06.519309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e2f2b-4c0e-4423-8e9b-640573d0ae3a None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:06.519309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e2f2b-4c0e-4423-8e9b-640573d0ae3a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:06.519528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e2f2b-4c0e-4423-8e9b-640573d0ae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:06.523562 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] The token cache is being invalidate because project c8f9725beb5d499b9ad3a15078ba0fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:01:06.524062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.525026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.528376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1194/2408] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:01:06 2022] DELETE /identity/v3/projects/c8f9725beb5d499b9ad3a15078ba0fbc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:01:06.532881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:06.541751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a46e2f2b-4c0e-4423-8e9b-640573d0ae3a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:06.544072 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a46e2f2b-4c0e-4423-8e9b-640573d0ae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:06.560407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1215/2409] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:01:06.560643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:06.561697 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e2f2b-4c0e-4423-8e9b-640573d0ae3a None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:06.582042 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e2f2b-4c0e-4423-8e9b-640573d0ae3a None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:06.588786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71999d8-a2fa-4aaf-a695-bd8b37156617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:06.589636 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71999d8-a2fa-4aaf-a695-bd8b37156617 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:06.589924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71999d8-a2fa-4aaf-a695-bd8b37156617 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:06.590198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71999d8-a2fa-4aaf-a695-bd8b37156617 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:06.591084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71999d8-a2fa-4aaf-a695-bd8b37156617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:01:06.591440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71999d8-a2fa-4aaf-a695-bd8b37156617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:06.593638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71999d8-a2fa-4aaf-a695-bd8b37156617 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:06.594841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e758034-5333-48ef-a764-392c388db0e9 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:06.602414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:06.602414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:06.602414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:06.602414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] PATH_INFO: `/v3/users/4e875113b5ef4607a41348f3581131de` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:06.603656 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e875113b5ef4607a41348f3581131de)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:06.606808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:06.608313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1216/2410] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:01:06.614063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71999d8-a2fa-4aaf-a695-bd8b37156617 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:06.632169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71999d8-a2fa-4aaf-a695-bd8b37156617 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:06.643359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d9fa8-0921-4094-95f8-65ff9436ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:06.643585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d9fa8-0921-4094-95f8-65ff9436ebd6 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:06.648598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d9fa8-0921-4094-95f8-65ff9436ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:06.648598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d9fa8-0921-4094-95f8-65ff9436ebd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:06.648598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d9fa8-0921-4094-95f8-65ff9436ebd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:06.648598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d9fa8-0921-4094-95f8-65ff9436ebd6 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:06.766994 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1217/2411] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:01:06 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:01:06.771737 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d9fa8-0921-4094-95f8-65ff9436ebd6 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:06.836897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e875113b5ef4607a41348f3581131de'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.843405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d9fa8-0921-4094-95f8-65ff9436ebd6 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:06.847859 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6520554-dff3-4c4c-b25b-a8340aa8369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:06.850983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6520554-dff3-4c4c-b25b-a8340aa8369a admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:06.850983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6520554-dff3-4c4c-b25b-a8340aa8369a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:06.850983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6520554-dff3-4c4c-b25b-a8340aa8369a admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:06.850983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6520554-dff3-4c4c-b25b-a8340aa8369a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:06.852052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:06.852557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e875113b5ef4607a41348f3581131de'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.855655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6520554-dff3-4c4c-b25b-a8340aa8369a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:06.860342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e875113b5ef4607a41348f3581131de'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.917881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e875113b5ef4607a41348f3581131de'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.918580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e875113b5ef4607a41348f3581131de'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:06.924774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1218/2412] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:01:06 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:01:06.929406 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1195/2413] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:01:06 2022] DELETE /identity/v3/users/4e875113b5ef4607a41348f3581131de => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:01:06.929996 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6520554-dff3-4c4c-b25b-a8340aa8369a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:06.931070 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d6520554-dff3-4c4c-b25b-a8340aa8369a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:06.945517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6520554-dff3-4c4c-b25b-a8340aa8369a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:07.011250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f8ddf-4243-4108-af60-4cff46959eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:07.012019 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f8ddf-4243-4108-af60-4cff46959eeb admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:07.012295 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f8ddf-4243-4108-af60-4cff46959eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:07.012598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f8ddf-4243-4108-af60-4cff46959eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:07.013368 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f8ddf-4243-4108-af60-4cff46959eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:07.016270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f8ddf-4243-4108-af60-4cff46959eeb admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:07.027428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1219/2414] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:01:07.032358 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:07.042886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6be37-f9bb-420f-b922-8d8bc92583b7 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:07.048240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a3111-93d8-4bfe-b154-ad38df48422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:07.048943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a3111-93d8-4bfe-b154-ad38df48422f admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:07.049253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a3111-93d8-4bfe-b154-ad38df48422f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:07.055274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a3111-93d8-4bfe-b154-ad38df48422f admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:07.055274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a3111-93d8-4bfe-b154-ad38df48422f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:07.055274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a3111-93d8-4bfe-b154-ad38df48422f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:07.063719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1196/2415] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:01:07.067942 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f8ddf-4243-4108-af60-4cff46959eeb admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:07.079335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f8ddf-4243-4108-af60-4cff46959eeb admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:07.084382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c2d09-29b4-40ed-a365-bce0aa3cf008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:07.085327 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c2d09-29b4-40ed-a365-bce0aa3cf008 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:07.085603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c2d09-29b4-40ed-a365-bce0aa3cf008 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:07.085873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c2d09-29b4-40ed-a365-bce0aa3cf008 admin admin] PATH_INFO: `/v3/projects/8dca3028700c4fdcb01c5460ea6d5f1a/users/0c7779b77889406ab578a3690d8ede29/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:07.107370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c2d09-29b4-40ed-a365-bce0aa3cf008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dca3028700c4fdcb01c5460ea6d5f1a, user_id=0c7779b77889406ab578a3690d8ede29, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:07.111912 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c2d09-29b4-40ed-a365-bce0aa3cf008 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:07.181230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1220/2416] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:01:07 2022] PUT /identity/v3/projects/8dca3028700c4fdcb01c5460ea6d5f1a/users/0c7779b77889406ab578a3690d8ede29/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:01:07.192230 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d79bc4-152b-4e7f-ad90-d39b2d447888 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:07.192794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d79bc4-152b-4e7f-ad90-d39b2d447888 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:07.192891 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d79bc4-152b-4e7f-ad90-d39b2d447888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:07.221923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e4d79bc4-152b-4e7f-ad90-d39b2d447888 None None] MFA Rules not processed for user `0c7779b77889406ab578a3690d8ede29`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:07.223165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e4d79bc4-152b-4e7f-ad90-d39b2d447888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:07.250608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:INSERT=3,keystone:DELETE=18,keystone:SELECT=79 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:07.299844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1197/2417] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:01:07.311197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c2d09-29b4-40ed-a365-bce0aa3cf008 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:07.317429 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-bd5c2d09-29b4-40ed-a365-bce0aa3cf008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:07.399012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c2d09-29b4-40ed-a365-bce0aa3cf008 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:07.403979 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c3a6e-4cfd-4b6f-a610-862a2343de31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '259d506eb54e4766a8fe3fa5bb514e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:07.404340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c3a6e-4cfd-4b6f-a610-862a2343de31 service glance] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:07.404437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c3a6e-4cfd-4b6f-a610-862a2343de31 service glance] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:07.404715 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c3a6e-4cfd-4b6f-a610-862a2343de31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:07.413988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c3a6e-4cfd-4b6f-a610-862a2343de31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:07.415423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c3a6e-4cfd-4b6f-a610-862a2343de31 service glance] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:07.425761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1221/2418] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:01:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:01:07.434825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d79bc4-152b-4e7f-ad90-d39b2d447888 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:07.438306 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e4d79bc4-152b-4e7f-ad90-d39b2d447888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:07.528237 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d79bc4-152b-4e7f-ad90-d39b2d447888 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:07.533268 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5dee5-bb46-4332-bb8c-cc317ba27714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:07.534138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5dee5-bb46-4332-bb8c-cc317ba27714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:07.534424 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5dee5-bb46-4332-bb8c-cc317ba27714 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:07.534700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5dee5-bb46-4332-bb8c-cc317ba27714 admin admin] PATH_INFO: `/v3/projects/7896f289d4784a0aaad516f04e28b31a` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:07.535916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5dee5-bb46-4332-bb8c-cc317ba27714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7896f289d4784a0aaad516f04e28b31a)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:07.537893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5dee5-bb46-4332-bb8c-cc317ba27714 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:07.700143 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fee5dee5-bb46-4332-bb8c-cc317ba27714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7896f289d4784a0aaad516f04e28b31a', 'request_id': 'req-fee5dee5-bb46-4332-bb8c-cc317ba27714'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:07.707882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fee5dee5-bb46-4332-bb8c-cc317ba27714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7896f289d4784a0aaad516f04e28b31a', 'request_id': 'req-fee5dee5-bb46-4332-bb8c-cc317ba27714'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:07.815814 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fee5dee5-bb46-4332-bb8c-cc317ba27714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7896f289d4784a0aaad516f04e28b31a', 'request_id': 'req-fee5dee5-bb46-4332-bb8c-cc317ba27714'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:07.833770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fee5dee5-bb46-4332-bb8c-cc317ba27714 admin admin] The token cache is being invalidate because project 7896f289d4784a0aaad516f04e28b31a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:01:07.834028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fee5dee5-bb46-4332-bb8c-cc317ba27714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:07.835135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-fee5dee5-bb46-4332-bb8c-cc317ba27714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:07.837084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1198/2419] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:01:07 2022] DELETE /identity/v3/projects/7896f289d4784a0aaad516f04e28b31a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:01:07.842638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dc059-d765-48e9-bf57-396fef05a597 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:07.843611 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dc059-d765-48e9-bf57-396fef05a597 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:07.843899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dc059-d765-48e9-bf57-396fef05a597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:07.872869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ba6dc059-d765-48e9-bf57-396fef05a597 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:07.872869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ba6dc059-d765-48e9-bf57-396fef05a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:07.883096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:07.951880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1222/2420] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:01:07.961021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbb938-8914-4066-a6df-7b80bbfbc9d8 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:07.961312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbb938-8914-4066-a6df-7b80bbfbc9d8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:07.961594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbb938-8914-4066-a6df-7b80bbfbc9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:07.987132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e8dbb938-8914-4066-a6df-7b80bbfbc9d8 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:07.989482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e8dbb938-8914-4066-a6df-7b80bbfbc9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:08.006756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1199/2421] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:01:08.006869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dc059-d765-48e9-bf57-396fef05a597 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:08.018779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dc059-d765-48e9-bf57-396fef05a597 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:08.023754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa44e0-d2e4-4b99-9bdb-0fe81fb3e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:08.024576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa44e0-d2e4-4b99-9bdb-0fe81fb3e544 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:08.024944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa44e0-d2e4-4b99-9bdb-0fe81fb3e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:08.025283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa44e0-d2e4-4b99-9bdb-0fe81fb3e544 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:08.026110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa44e0-d2e4-4b99-9bdb-0fe81fb3e544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:01:08.026492 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa44e0-d2e4-4b99-9bdb-0fe81fb3e544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:08.028188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa44e0-d2e4-4b99-9bdb-0fe81fb3e544 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:08.043169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1223/2422] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:01:08.048137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbb938-8914-4066-a6df-7b80bbfbc9d8 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:08.058536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbb938-8914-4066-a6df-7b80bbfbc9d8 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:08.063642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61589c97-79cd-467f-ba13-dcc6dc1615d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:08.064318 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61589c97-79cd-467f-ba13-dcc6dc1615d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:08.064773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61589c97-79cd-467f-ba13-dcc6dc1615d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:08.065058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61589c97-79cd-467f-ba13-dcc6dc1615d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:08.065780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61589c97-79cd-467f-ba13-dcc6dc1615d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:08.067714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61589c97-79cd-467f-ba13-dcc6dc1615d9 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:08.178756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1200/2423] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:01:08 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:01:08.184756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa44e0-d2e4-4b99-9bdb-0fe81fb3e544 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:08.196746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa44e0-d2e4-4b99-9bdb-0fe81fb3e544 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:08.276745 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d59b9-52e0-4df8-be90-3a3b12640939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:08.277708 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d59b9-52e0-4df8-be90-3a3b12640939 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:08.277995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d59b9-52e0-4df8-be90-3a3b12640939 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:08.278277 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d59b9-52e0-4df8-be90-3a3b12640939 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:08.278993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d59b9-52e0-4df8-be90-3a3b12640939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:08.281927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d59b9-52e0-4df8-be90-3a3b12640939 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:08.395165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1224/2424] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:01:08 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:01:08.402068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61589c97-79cd-467f-ba13-dcc6dc1615d9 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:08.417906 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61589c97-79cd-467f-ba13-dcc6dc1615d9 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:08.424026 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0c632-5557-45aa-b719-6500c81af7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:08.424874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0c632-5557-45aa-b719-6500c81af7bd admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:08.425327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0c632-5557-45aa-b719-6500c81af7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:08.425698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0c632-5557-45aa-b719-6500c81af7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:08.427241 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0c632-5557-45aa-b719-6500c81af7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:08.428976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0c632-5557-45aa-b719-6500c81af7bd admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:08.443077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1201/2425] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:01:08.448525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d59b9-52e0-4df8-be90-3a3b12640939 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:08.462056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d59b9-52e0-4df8-be90-3a3b12640939 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:08.469809 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b12c1a-f28f-4850-bca7-bae0eaca299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:08.470516 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b12c1a-f28f-4850-bca7-bae0eaca299d admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:08.470805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b12c1a-f28f-4850-bca7-bae0eaca299d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:08.471384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b12c1a-f28f-4850-bca7-bae0eaca299d admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:08.472584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b12c1a-f28f-4850-bca7-bae0eaca299d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:08.474233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b12c1a-f28f-4850-bca7-bae0eaca299d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:08.489242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1225/2426] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:01:08.493931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0c632-5557-45aa-b719-6500c81af7bd admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:08.509187 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0c632-5557-45aa-b719-6500c81af7bd admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:08.514770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb528de6-d491-4b27-8290-6ab7e3986d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:08.517384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb528de6-d491-4b27-8290-6ab7e3986d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:08.517968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb528de6-d491-4b27-8290-6ab7e3986d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:08.518401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb528de6-d491-4b27-8290-6ab7e3986d19 admin admin] PATH_INFO: `/v3/projects/e56fb66af8654665b5869624adb1c8c8/users/faf9bdc76439428ab5e3c40d33a88425/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:08.535555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:08.539316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb528de6-d491-4b27-8290-6ab7e3986d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56fb66af8654665b5869624adb1c8c8, user_id=faf9bdc76439428ab5e3c40d33a88425, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:08.542095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb528de6-d491-4b27-8290-6ab7e3986d19 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:08.645357 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1202/2427] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:01:08 2022] PUT /identity/v3/projects/e56fb66af8654665b5869624adb1c8c8/users/faf9bdc76439428ab5e3c40d33a88425/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:01:08.655665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763fc1-828f-41f2-96b9-fbaae9abdb39 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:08.655949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763fc1-828f-41f2-96b9-fbaae9abdb39 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:08.656235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763fc1-828f-41f2-96b9-fbaae9abdb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:08.680854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a6763fc1-828f-41f2-96b9-fbaae9abdb39 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:08.680854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a6763fc1-828f-41f2-96b9-fbaae9abdb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:08.743856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1226/2428] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:01:08.754274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb528de6-d491-4b27-8290-6ab7e3986d19 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:08.756183 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-fb528de6-d491-4b27-8290-6ab7e3986d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:08.969802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb528de6-d491-4b27-8290-6ab7e3986d19 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:08.974114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966f9c0-d41b-4dc7-b17a-796beddc21e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:08.974783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966f9c0-d41b-4dc7-b17a-796beddc21e9 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:08.975065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966f9c0-d41b-4dc7-b17a-796beddc21e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:08.975347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966f9c0-d41b-4dc7-b17a-796beddc21e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:08.989743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966f9c0-d41b-4dc7-b17a-796beddc21e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:08.991222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966f9c0-d41b-4dc7-b17a-796beddc21e9 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:09.003623 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1203/2429] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:01:10.194984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586f314-c1b6-4acd-9227-b59005221bd9 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:10.195489 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586f314-c1b6-4acd-9227-b59005221bd9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:10.196111 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586f314-c1b6-4acd-9227-b59005221bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:10.219931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-7586f314-c1b6-4acd-9227-b59005221bd9 None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:10.221402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7586f314-c1b6-4acd-9227-b59005221bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:10.248175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:10.319789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1227/2430] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jul 20 18:01:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:01:10.334188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966f9c0-d41b-4dc7-b17a-796beddc21e9 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:10.335530 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0966f9c0-d41b-4dc7-b17a-796beddc21e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:10.460872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966f9c0-d41b-4dc7-b17a-796beddc21e9 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:10.470903 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adacf1b-153f-4717-bf7b-d38c8cf1b3c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:10.471604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adacf1b-153f-4717-bf7b-d38c8cf1b3c7 service swift] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:10.471887 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adacf1b-153f-4717-bf7b-d38c8cf1b3c7 service swift] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:10.472162 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adacf1b-153f-4717-bf7b-d38c8cf1b3c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:10.482191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adacf1b-153f-4717-bf7b-d38c8cf1b3c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:10.483993 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adacf1b-153f-4717-bf7b-d38c8cf1b3c7 service swift] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:10.495163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1204/2431] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:01:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 18:01:10.920381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c29ad-6801-4e97-ad72-f61d5140b149 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:10.921265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c29ad-6801-4e97-ad72-f61d5140b149 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:10.921738 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c29ad-6801-4e97-ad72-f61d5140b149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:10.955217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-572c29ad-6801-4e97-ad72-f61d5140b149 None None] MFA Rules not processed for user `faf9bdc76439428ab5e3c40d33a88425`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:10.956645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-572c29ad-6801-4e97-ad72-f61d5140b149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:11.039946 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1228/2432] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:01:11.055821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adacf1b-153f-4717-bf7b-d38c8cf1b3c7 service swift] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:11.057404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0adacf1b-153f-4717-bf7b-d38c8cf1b3c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:11.174399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adacf1b-153f-4717-bf7b-d38c8cf1b3c7 service swift] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:11.178497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132246f9-43ce-45fe-8045-13d97cdb06c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:11.179682 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132246f9-43ce-45fe-8045-13d97cdb06c9 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:11.180207 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132246f9-43ce-45fe-8045-13d97cdb06c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:11.182563 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132246f9-43ce-45fe-8045-13d97cdb06c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:11.197917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132246f9-43ce-45fe-8045-13d97cdb06c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:11.200936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132246f9-43ce-45fe-8045-13d97cdb06c9 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:11.222129 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1205/2433] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:01:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:01:13.287150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01ce44-7699-4b3c-853a-3468591ccc5b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:13.287767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01ce44-7699-4b3c-853a-3468591ccc5b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:13.288385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01ce44-7699-4b3c-853a-3468591ccc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:13.308009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-5f01ce44-7699-4b3c-853a-3468591ccc5b None None] MFA Rules not processed for user `faf9bdc76439428ab5e3c40d33a88425`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:13.309286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5f01ce44-7699-4b3c-853a-3468591ccc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:13.316333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1229/2434] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:01:18.371872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa40a51-f306-4f78-8f35-2437f72a9110 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:18.372497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa40a51-f306-4f78-8f35-2437f72a9110 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:18.372497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa40a51-f306-4f78-8f35-2437f72a9110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:18.396875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-efa40a51-f306-4f78-8f35-2437f72a9110 None None] MFA Rules not processed for user `fed263f071864582ba96d79f75fbfb36`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:18.398111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-efa40a51-f306-4f78-8f35-2437f72a9110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:18.424837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:18.466505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1206/2435] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:01:23.302823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=51 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:28.586312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=13 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:37.552089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01ce44-7699-4b3c-853a-3468591ccc5b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:37.555711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5f01ce44-7699-4b3c-853a-3468591ccc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:37.587077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01ce44-7699-4b3c-853a-3468591ccc5b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:37.593250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:37.595078 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:37.595536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:37.595808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] PATH_INFO: `/v3/users/0c7779b77889406ab578a3690d8ede29` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:37.597376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c7779b77889406ab578a3690d8ede29)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:37.600272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:37.894899 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c7779b77889406ab578a3690d8ede29'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:37.912669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c7779b77889406ab578a3690d8ede29'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:37.921203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c7779b77889406ab578a3690d8ede29'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:38.035655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c7779b77889406ab578a3690d8ede29'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:38.036837 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c7779b77889406ab578a3690d8ede29'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:38.064939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1230/2436] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:01:37 2022] DELETE /identity/v3/users/0c7779b77889406ab578a3690d8ede29 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:01:38.067232 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f74a8-45d7-49ff-a652-cb98b4ce3baf None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:38.067775 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f74a8-45d7-49ff-a652-cb98b4ce3baf None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:38.067880 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f74a8-45d7-49ff-a652-cb98b4ce3baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:38.106075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-b13f74a8-45d7-49ff-a652-cb98b4ce3baf None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:38.109113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b13f74a8-45d7-49ff-a652-cb98b4ce3baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:38.222548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1207/2437] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:01:38.235652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:38.239673 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:38.331702 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0947d4-8177-43cc-a00f-43a2cdbc65bc admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:38.336627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856ca9b-195d-4354-a4ae-19800eedeab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:38.337315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856ca9b-195d-4354-a4ae-19800eedeab2 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:38.337600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856ca9b-195d-4354-a4ae-19800eedeab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:38.337881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856ca9b-195d-4354-a4ae-19800eedeab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:38.349671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856ca9b-195d-4354-a4ae-19800eedeab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:38.351159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856ca9b-195d-4354-a4ae-19800eedeab2 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:38.372792 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1231/2438] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:01:39.048738 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f74a8-45d7-49ff-a652-cb98b4ce3baf None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:39.051084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b13f74a8-45d7-49ff-a652-cb98b4ce3baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:39.067423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f74a8-45d7-49ff-a652-cb98b4ce3baf None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:39.072817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:39.073802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:39.074158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:39.074488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94 admin admin] PATH_INFO: `/v3/projects/8dca3028700c4fdcb01c5460ea6d5f1a` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:39.076071 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dca3028700c4fdcb01c5460ea6d5f1a)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:39.078455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:39.247024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dca3028700c4fdcb01c5460ea6d5f1a', 'request_id': 'req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:39.257231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dca3028700c4fdcb01c5460ea6d5f1a', 'request_id': 'req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:39.438378 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dca3028700c4fdcb01c5460ea6d5f1a', 'request_id': 'req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:39.451509 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94 admin admin] The token cache is being invalidate because project 8dca3028700c4fdcb01c5460ea6d5f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:01:39.451792 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:39.452468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9b040ef9-819b-4c8f-b1bd-a5392c1a1f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:01:39.454047 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1208/2439] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:01:39 2022] DELETE /identity/v3/projects/8dca3028700c4fdcb01c5460ea6d5f1a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:01:39.459168 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e00543-2b28-4cb8-b57c-a25bdcbbca7a None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:39.459681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e00543-2b28-4cb8-b57c-a25bdcbbca7a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:39.459790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e00543-2b28-4cb8-b57c-a25bdcbbca7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:39.478771 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-25e00543-2b28-4cb8-b57c-a25bdcbbca7a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:39.480329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-25e00543-2b28-4cb8-b57c-a25bdcbbca7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:39.549904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1232/2440] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:01:39.561056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb215e-c627-415d-af26-428d75001dc0 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:39.561344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb215e-c627-415d-af26-428d75001dc0 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:39.561630 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb215e-c627-415d-af26-428d75001dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:39.581057 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-cfeb215e-c627-415d-af26-428d75001dc0 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:39.588224 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-cfeb215e-c627-415d-af26-428d75001dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:39.590675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1209/2441] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:01:39.595976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e00543-2b28-4cb8-b57c-a25bdcbbca7a None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:39.607987 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e00543-2b28-4cb8-b57c-a25bdcbbca7a None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:39.616289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1995abe-ed32-4e6a-8ba9-5200d9f28b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:39.617506 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1995abe-ed32-4e6a-8ba9-5200d9f28b8a admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:39.618034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1995abe-ed32-4e6a-8ba9-5200d9f28b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:39.618549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1995abe-ed32-4e6a-8ba9-5200d9f28b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:39.619905 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1995abe-ed32-4e6a-8ba9-5200d9f28b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:01:39.620498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1995abe-ed32-4e6a-8ba9-5200d9f28b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:39.622627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1995abe-ed32-4e6a-8ba9-5200d9f28b8a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:39.635012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1233/2442] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 18:01:39.639673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb215e-c627-415d-af26-428d75001dc0 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:39.650233 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb215e-c627-415d-af26-428d75001dc0 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:39.655231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4623244-657a-4834-95ee-bcefea442045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:39.655770 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4623244-657a-4834-95ee-bcefea442045 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:39.656053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4623244-657a-4834-95ee-bcefea442045 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:39.656915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4623244-657a-4834-95ee-bcefea442045 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:39.657608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4623244-657a-4834-95ee-bcefea442045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:39.659565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4623244-657a-4834-95ee-bcefea442045 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:39.754524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1210/2443] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:01:39 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:01:39.758688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1995abe-ed32-4e6a-8ba9-5200d9f28b8a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:39.763836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:39.770081 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1995abe-ed32-4e6a-8ba9-5200d9f28b8a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:39.836975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e8c4e-40ab-4fff-8092-375645a654d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:39.837653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e8c4e-40ab-4fff-8092-375645a654d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:39.837935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e8c4e-40ab-4fff-8092-375645a654d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:39.838209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e8c4e-40ab-4fff-8092-375645a654d0 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:39.838898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e8c4e-40ab-4fff-8092-375645a654d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:39.840856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e8c4e-40ab-4fff-8092-375645a654d0 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:39.958721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1234/2444] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:01:39 2022] POST /identity/v3/users => generated 282 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:01:39.962700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4623244-657a-4834-95ee-bcefea442045 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:39.974385 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4623244-657a-4834-95ee-bcefea442045 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:39.979151 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5eef3-5676-4ef0-8448-c38ca15b7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:39.979813 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5eef3-5676-4ef0-8448-c38ca15b7a31 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:39.980102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5eef3-5676-4ef0-8448-c38ca15b7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:39.981007 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5eef3-5676-4ef0-8448-c38ca15b7a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:39.981155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5eef3-5676-4ef0-8448-c38ca15b7a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:39.982823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5eef3-5676-4ef0-8448-c38ca15b7a31 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:39.998254 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1211/2445] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:01:40.001154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e8c4e-40ab-4fff-8092-375645a654d0 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:40.011428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e8c4e-40ab-4fff-8092-375645a654d0 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:40.017514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb2461-e3d8-4781-8edb-f7d7e4b8b003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:40.018198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2461-e3d8-4781-8edb-f7d7e4b8b003 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:40.018486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2461-e3d8-4781-8edb-f7d7e4b8b003 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:40.018767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2461-e3d8-4781-8edb-f7d7e4b8b003 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:40.019500 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb2461-e3d8-4781-8edb-f7d7e4b8b003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:40.021206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb2461-e3d8-4781-8edb-f7d7e4b8b003 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:40.033119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1235/2446] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:01:40.037582 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5eef3-5676-4ef0-8448-c38ca15b7a31 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:40.047960 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5eef3-5676-4ef0-8448-c38ca15b7a31 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:40.052730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1da01c-79d5-4db0-b917-2e738ff9f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:40.053787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1da01c-79d5-4db0-b917-2e738ff9f059 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:40.054076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1da01c-79d5-4db0-b917-2e738ff9f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:40.054356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1da01c-79d5-4db0-b917-2e738ff9f059 admin admin] PATH_INFO: `/v3/projects/39004a1072fd4c8a948fe4ce18a8f2bb/users/2af3b3801f2240879ffd28a8e35c173d/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:40.070147 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1da01c-79d5-4db0-b917-2e738ff9f059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39004a1072fd4c8a948fe4ce18a8f2bb, user_id=2af3b3801f2240879ffd28a8e35c173d, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:40.072815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1da01c-79d5-4db0-b917-2e738ff9f059 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:40.152670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1212/2447] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:01:40 2022] PUT /identity/v3/projects/39004a1072fd4c8a948fe4ce18a8f2bb/users/2af3b3801f2240879ffd28a8e35c173d/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:01:40.166747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa61206-bd5b-4b51-b6ca-7501e5cf082d None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:40.167035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa61206-bd5b-4b51-b6ca-7501e5cf082d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:40.167317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa61206-bd5b-4b51-b6ca-7501e5cf082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:40.195855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-2fa61206-bd5b-4b51-b6ca-7501e5cf082d None None] MFA Rules not processed for user `2af3b3801f2240879ffd28a8e35c173d`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:40.197263 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2fa61206-bd5b-4b51-b6ca-7501e5cf082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:40.267240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1236/2448] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:01:40.284833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1da01c-79d5-4db0-b917-2e738ff9f059 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:40.286606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8f1da01c-79d5-4db0-b917-2e738ff9f059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:40.309736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:40.348996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1da01c-79d5-4db0-b917-2e738ff9f059 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:40.355725 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1937ab-56ae-4724-81d4-83cf27af9b75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:40.356599 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1937ab-56ae-4724-81d4-83cf27af9b75 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:40.357032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1937ab-56ae-4724-81d4-83cf27af9b75 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:40.357471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1937ab-56ae-4724-81d4-83cf27af9b75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:40.367531 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1937ab-56ae-4724-81d4-83cf27af9b75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:40.369096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1937ab-56ae-4724-81d4-83cf27af9b75 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:40.379457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1213/2449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:01:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:01:47.293042 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79352d6-5264-4d9e-8753-9b02cdee2811 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:47.298174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79352d6-5264-4d9e-8753-9b02cdee2811 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:47.298174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79352d6-5264-4d9e-8753-9b02cdee2811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:47.317352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b79352d6-5264-4d9e-8753-9b02cdee2811 None None] MFA Rules not processed for user `de47dd54e8fc48ca9411ce4c7906b80b`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:47.318855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b79352d6-5264-4d9e-8753-9b02cdee2811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:47.390169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1237/2450] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:01:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:01:50.425689 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=17 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:57.379543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:01:59.389387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d214da-d0d4-406e-8d4e-3c236a9c291b None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:59.395033 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d214da-d0d4-406e-8d4e-3c236a9c291b None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:59.395033 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d214da-d0d4-406e-8d4e-3c236a9c291b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:59.420153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-99d214da-d0d4-406e-8d4e-3c236a9c291b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:01:59.421481 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-99d214da-d0d4-406e-8d4e-3c236a9c291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:59.504638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1214/2451] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Jul 20 18:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:01:59.541745 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79352d6-5264-4d9e-8753-9b02cdee2811 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:01:59.543218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b79352d6-5264-4d9e-8753-9b02cdee2811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:01:59.643904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79352d6-5264-4d9e-8753-9b02cdee2811 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:01:59.650316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0277cb8-a728-46ee-9dcf-e4fadcacba4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:01:59.650983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0277cb8-a728-46ee-9dcf-e4fadcacba4d service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:01:59.651265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0277cb8-a728-46ee-9dcf-e4fadcacba4d service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:01:59.651538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0277cb8-a728-46ee-9dcf-e4fadcacba4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:01:59.661954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0277cb8-a728-46ee-9dcf-e4fadcacba4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:01:59.663559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0277cb8-a728-46ee-9dcf-e4fadcacba4d service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:01:59.678848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1238/2452] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:02:04.782820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311a29c-1b13-4caa-9818-d853e6f851ba None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:04.783375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311a29c-1b13-4caa-9818-d853e6f851ba None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:04.783375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311a29c-1b13-4caa-9818-d853e6f851ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:04.802883 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e311a29c-1b13-4caa-9818-d853e6f851ba None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:04.804141 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e311a29c-1b13-4caa-9818-d853e6f851ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:04.814652 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1215/2453] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Jul 20 18:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:02:04.844705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0277cb8-a728-46ee-9dcf-e4fadcacba4d service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:04.856383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0277cb8-a728-46ee-9dcf-e4fadcacba4d service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:04.863219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfea98-a9a7-4f63-a5f4-dcc26dcd57d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:04.863878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfea98-a9a7-4f63-a5f4-dcc26dcd57d2 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:04.864156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfea98-a9a7-4f63-a5f4-dcc26dcd57d2 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:04.864429 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfea98-a9a7-4f63-a5f4-dcc26dcd57d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:04.873673 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfea98-a9a7-4f63-a5f4-dcc26dcd57d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:04.875291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfea98-a9a7-4f63-a5f4-dcc26dcd57d2 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:04.887136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1239/2454] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:02:12.516677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943739b5-2e44-46aa-b343-f364ff18304a None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:12.517231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943739b5-2e44-46aa-b343-f364ff18304a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:12.517487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943739b5-2e44-46aa-b343-f364ff18304a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:12.536215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-943739b5-2e44-46aa-b343-f364ff18304a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:12.537463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-943739b5-2e44-46aa-b343-f364ff18304a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:12.545628 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1216/2455] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Jul 20 18:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:02:12.574929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfea98-a9a7-4f63-a5f4-dcc26dcd57d2 service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:12.576422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-74cfea98-a9a7-4f63-a5f4-dcc26dcd57d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:12.591141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfea98-a9a7-4f63-a5f4-dcc26dcd57d2 service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:12.597499 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3d418-0404-4632-8a6c-b6d19f4f90f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:12.598157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3d418-0404-4632-8a6c-b6d19f4f90f4 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:12.598444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3d418-0404-4632-8a6c-b6d19f4f90f4 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:12.598723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3d418-0404-4632-8a6c-b6d19f4f90f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:12.607924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3d418-0404-4632-8a6c-b6d19f4f90f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:12.609538 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3d418-0404-4632-8a6c-b6d19f4f90f4 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:12.620253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1240/2456] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:02:16.064795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb1176-89ce-4332-9ccc-7c502db88c37 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:16.065244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb1176-89ce-4332-9ccc-7c502db88c37 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:16.065646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb1176-89ce-4332-9ccc-7c502db88c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:16.087221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-ebdb1176-89ce-4332-9ccc-7c502db88c37 None None] MFA Rules not processed for user `f1d5e5f7ad994b8481b8c5e885db1739`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:16.087221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ebdb1176-89ce-4332-9ccc-7c502db88c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:16.146862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1217/2457] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:02:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:02:17.369620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cb3c0-104a-4a80-9a0d-f29028b5b397 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:17.370226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cb3c0-104a-4a80-9a0d-f29028b5b397 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:17.370226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cb3c0-104a-4a80-9a0d-f29028b5b397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:17.395015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e77cb3c0-104a-4a80-9a0d-f29028b5b397 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:17.396244 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e77cb3c0-104a-4a80-9a0d-f29028b5b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:17.404305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1241/2458] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Jul 20 18:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:02:17.448147 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb1176-89ce-4332-9ccc-7c502db88c37 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:17.464006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb1176-89ce-4332-9ccc-7c502db88c37 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:17.470597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd0daa-f4b4-440f-adac-14f48e154986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:17.471503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd0daa-f4b4-440f-adac-14f48e154986 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:17.471857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd0daa-f4b4-440f-adac-14f48e154986 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:17.472213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd0daa-f4b4-440f-adac-14f48e154986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:17.482123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd0daa-f4b4-440f-adac-14f48e154986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:17.484057 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd0daa-f4b4-440f-adac-14f48e154986 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:17.495673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1218/2459] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:02:22.776282 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d77cd5-9d1d-4ce4-a63a-971f066d7f59 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:22.776902 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d77cd5-9d1d-4ce4-a63a-971f066d7f59 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:22.776902 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d77cd5-9d1d-4ce4-a63a-971f066d7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:22.798328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-c4d77cd5-9d1d-4ce4-a63a-971f066d7f59 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:22.800101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c4d77cd5-9d1d-4ce4-a63a-971f066d7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:22.810000 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1242/2460] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Jul 20 18:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:02:22.835540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd0daa-f4b4-440f-adac-14f48e154986 service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:22.845060 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=65 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:22.853920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd0daa-f4b4-440f-adac-14f48e154986 service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:22.861406 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0f98-7463-4fa2-9799-f796bc91a59a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:22.862580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0f98-7463-4fa2-9799-f796bc91a59a service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:22.863196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0f98-7463-4fa2-9799-f796bc91a59a service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:22.864229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0f98-7463-4fa2-9799-f796bc91a59a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:22.874099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e0f98-7463-4fa2-9799-f796bc91a59a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:22.875881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e0f98-7463-4fa2-9799-f796bc91a59a service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:22.892775 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1219/2461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:02:28.482843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d77cd5-9d1d-4ce4-a63a-971f066d7f59 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:28.484311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c4d77cd5-9d1d-4ce4-a63a-971f066d7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:28.490096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=53 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:28.559207 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d77cd5-9d1d-4ce4-a63a-971f066d7f59 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:28.567148 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690e88d-a4c2-4d06-8b6a-2008421c66d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:28.567838 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e88d-a4c2-4d06-8b6a-2008421c66d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:28.568133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e88d-a4c2-4d06-8b6a-2008421c66d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:28.568394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e88d-a4c2-4d06-8b6a-2008421c66d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:28.570319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7690e88d-a4c2-4d06-8b6a-2008421c66d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:28.587676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690e88d-a4c2-4d06-8b6a-2008421c66d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:28.589045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690e88d-a4c2-4d06-8b6a-2008421c66d5 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:28.601290 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1243/2462] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:02:28.867417 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0f98-7463-4fa2-9799-f796bc91a59a service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:28.881267 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0f98-7463-4fa2-9799-f796bc91a59a service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:28.888089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2c52e-e752-42f8-a144-05b80a23521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:28.889341 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c52e-e752-42f8-a144-05b80a23521e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:28.889666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c52e-e752-42f8-a144-05b80a23521e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:28.890045 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c52e-e752-42f8-a144-05b80a23521e admin admin] PATH_INFO: `/v3/users/2af3b3801f2240879ffd28a8e35c173d` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:28.891559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2c52e-e752-42f8-a144-05b80a23521e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af3b3801f2240879ffd28a8e35c173d)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:28.899673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2c52e-e752-42f8-a144-05b80a23521e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:29.117497 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-33c2c52e-e752-42f8-a144-05b80a23521e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af3b3801f2240879ffd28a8e35c173d'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:02:29.130822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-33c2c52e-e752-42f8-a144-05b80a23521e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af3b3801f2240879ffd28a8e35c173d'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:02:29.138166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-33c2c52e-e752-42f8-a144-05b80a23521e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af3b3801f2240879ffd28a8e35c173d'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:02:29.163628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2a47f-5bca-4c67-a542-212cb9eee995 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:29.163913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2a47f-5bca-4c67-a542-212cb9eee995 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:29.164218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2a47f-5bca-4c67-a542-212cb9eee995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:29.184422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-2aa2a47f-5bca-4c67-a542-212cb9eee995 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:29.185726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2aa2a47f-5bca-4c67-a542-212cb9eee995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:29.194994 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1244/2463] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Jul 20 18:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:02:29.219845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2a47f-5bca-4c67-a542-212cb9eee995 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:29.233852 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2a47f-5bca-4c67-a542-212cb9eee995 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:29.239546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c363c2-2b04-4042-8b2b-c21bcbaf8557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:29.240211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c363c2-2b04-4042-8b2b-c21bcbaf8557 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:29.240522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c363c2-2b04-4042-8b2b-c21bcbaf8557 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:29.240803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c363c2-2b04-4042-8b2b-c21bcbaf8557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:29.250142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c363c2-2b04-4042-8b2b-c21bcbaf8557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:29.253519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-33c2c52e-e752-42f8-a144-05b80a23521e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af3b3801f2240879ffd28a8e35c173d'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:02:29.253519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-33c2c52e-e752-42f8-a144-05b80a23521e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af3b3801f2240879ffd28a8e35c173d'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:02:29.254230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c363c2-2b04-4042-8b2b-c21bcbaf8557 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:29.259235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1220/2464] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:02:28 2022] DELETE /identity/v3/users/2af3b3801f2240879ffd28a8e35c173d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:02:29.262500 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1245/2465] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:02:29.264104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b642e36-4db0-4347-af27-96094c9a4a03 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:29.264456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b642e36-4db0-4347-af27-96094c9a4a03 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:29.264835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b642e36-4db0-4347-af27-96094c9a4a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:29.286030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-8b642e36-4db0-4347-af27-96094c9a4a03 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:29.290176 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8b642e36-4db0-4347-af27-96094c9a4a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:29.350138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1221/2466] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:02:29.360343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c363c2-2b04-4042-8b2b-c21bcbaf8557 service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:29.372063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c363c2-2b04-4042-8b2b-c21bcbaf8557 service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:29.426151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf75ddb-363c-48a9-a586-1c0272018d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:29.426812 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf75ddb-363c-48a9-a586-1c0272018d35 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:29.427096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf75ddb-363c-48a9-a586-1c0272018d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:29.427383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf75ddb-363c-48a9-a586-1c0272018d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:29.437573 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf75ddb-363c-48a9-a586-1c0272018d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:29.439044 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf75ddb-363c-48a9-a586-1c0272018d35 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:29.449798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1246/2467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:02:29.922627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b642e36-4db0-4347-af27-96094c9a4a03 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:29.922627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8b642e36-4db0-4347-af27-96094c9a4a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:29.937176 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b642e36-4db0-4347-af27-96094c9a4a03 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:29.944956 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12c10f-7215-40f1-9c04-40ba73177a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:29.945841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c10f-7215-40f1-9c04-40ba73177a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:29.946214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c10f-7215-40f1-9c04-40ba73177a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:29.948612 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c10f-7215-40f1-9c04-40ba73177a21 admin admin] PATH_INFO: `/v3/projects/39004a1072fd4c8a948fe4ce18a8f2bb` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:29.955097 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12c10f-7215-40f1-9c04-40ba73177a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39004a1072fd4c8a948fe4ce18a8f2bb)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:29.955097 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12c10f-7215-40f1-9c04-40ba73177a21 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:30.133403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5b12c10f-7215-40f1-9c04-40ba73177a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39004a1072fd4c8a948fe4ce18a8f2bb', 'request_id': 'req-5b12c10f-7215-40f1-9c04-40ba73177a21'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:02:30.139257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:30.140266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5b12c10f-7215-40f1-9c04-40ba73177a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39004a1072fd4c8a948fe4ce18a8f2bb', 'request_id': 'req-5b12c10f-7215-40f1-9c04-40ba73177a21'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:02:30.222731 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5b12c10f-7215-40f1-9c04-40ba73177a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39004a1072fd4c8a948fe4ce18a8f2bb', 'request_id': 'req-5b12c10f-7215-40f1-9c04-40ba73177a21'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:02:30.243568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5b12c10f-7215-40f1-9c04-40ba73177a21 admin admin] The token cache is being invalidate because project 39004a1072fd4c8a948fe4ce18a8f2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:02:30.243919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5b12c10f-7215-40f1-9c04-40ba73177a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:02:30.244648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-5b12c10f-7215-40f1-9c04-40ba73177a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:02:30.246309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1222/2468] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:02:29 2022] DELETE /identity/v3/projects/39004a1072fd4c8a948fe4ce18a8f2bb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:02:30.252016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332357e-3d26-4007-b4eb-32223494e42b None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:30.252626 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332357e-3d26-4007-b4eb-32223494e42b None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:30.252626 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332357e-3d26-4007-b4eb-32223494e42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:30.272633 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-0332357e-3d26-4007-b4eb-32223494e42b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:30.273876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0332357e-3d26-4007-b4eb-32223494e42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:30.340975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1247/2469] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:02:30.407665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ceb02-dd14-4e3c-a8ab-b384d108fd8a None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:30.407950 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ceb02-dd14-4e3c-a8ab-b384d108fd8a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:30.408231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ceb02-dd14-4e3c-a8ab-b384d108fd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:30.431002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-bb6ceb02-dd14-4e3c-a8ab-b384d108fd8a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:30.432322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bb6ceb02-dd14-4e3c-a8ab-b384d108fd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:30.440733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1223/2470] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:02:30.445330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332357e-3d26-4007-b4eb-32223494e42b None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:30.455367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332357e-3d26-4007-b4eb-32223494e42b None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:30.460534 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58001d87-c220-4eff-938b-c5f86b3ec865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:30.461221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58001d87-c220-4eff-938b-c5f86b3ec865 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:30.461504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58001d87-c220-4eff-938b-c5f86b3ec865 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:30.461918 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58001d87-c220-4eff-938b-c5f86b3ec865 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:30.462651 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58001d87-c220-4eff-938b-c5f86b3ec865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:02:30.462967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58001d87-c220-4eff-938b-c5f86b3ec865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:30.464608 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58001d87-c220-4eff-938b-c5f86b3ec865 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:30.479520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1248/2471] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:02:30.486011 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ceb02-dd14-4e3c-a8ab-b384d108fd8a None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:30.496384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ceb02-dd14-4e3c-a8ab-b384d108fd8a None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:30.501116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc5996-b498-4318-9192-b0b8991deba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:30.501823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc5996-b498-4318-9192-b0b8991deba1 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:30.502552 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc5996-b498-4318-9192-b0b8991deba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:30.502836 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc5996-b498-4318-9192-b0b8991deba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:30.504247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc5996-b498-4318-9192-b0b8991deba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:30.506211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc5996-b498-4318-9192-b0b8991deba1 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:30.602219 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1224/2472] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:02:30 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:02:30.606333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58001d87-c220-4eff-938b-c5f86b3ec865 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:30.617907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58001d87-c220-4eff-938b-c5f86b3ec865 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:30.630157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:30.681056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe44b66-4785-4ac6-8820-aae260efc35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:30.681885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe44b66-4785-4ac6-8820-aae260efc35d admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:30.682221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe44b66-4785-4ac6-8820-aae260efc35d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:30.682501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe44b66-4785-4ac6-8820-aae260efc35d admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:30.683263 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe44b66-4785-4ac6-8820-aae260efc35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:30.685199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe44b66-4785-4ac6-8820-aae260efc35d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:30.777536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1249/2473] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:02:30 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:02:30.781638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc5996-b498-4318-9192-b0b8991deba1 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:30.793867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc5996-b498-4318-9192-b0b8991deba1 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:30.798587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0a124-e1e2-4790-add5-677770e4b976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:30.799241 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0a124-e1e2-4790-add5-677770e4b976 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:30.799519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0a124-e1e2-4790-add5-677770e4b976 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:30.799837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0a124-e1e2-4790-add5-677770e4b976 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:30.800949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0a124-e1e2-4790-add5-677770e4b976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:30.802558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0a124-e1e2-4790-add5-677770e4b976 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:30.816005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1225/2474] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:02:30.819898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe44b66-4785-4ac6-8820-aae260efc35d admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:30.830600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe44b66-4785-4ac6-8820-aae260efc35d admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:30.836153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78732d2-8fd0-45ac-925e-f700ade43b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:30.836870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78732d2-8fd0-45ac-925e-f700ade43b3e admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:30.837185 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78732d2-8fd0-45ac-925e-f700ade43b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:30.837461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78732d2-8fd0-45ac-925e-f700ade43b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:30.838217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78732d2-8fd0-45ac-925e-f700ade43b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:30.839822 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78732d2-8fd0-45ac-925e-f700ade43b3e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:30.851728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1250/2475] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:02:30.856164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0a124-e1e2-4790-add5-677770e4b976 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:30.866654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0a124-e1e2-4790-add5-677770e4b976 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:30.871491 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bf3d7-ca91-4464-9f18-767646e521ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:30.872394 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bf3d7-ca91-4464-9f18-767646e521ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:30.872710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bf3d7-ca91-4464-9f18-767646e521ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:30.872987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bf3d7-ca91-4464-9f18-767646e521ce admin admin] PATH_INFO: `/v3/projects/1d7075d41e2349eebee32600a5c57a68/users/ca4a2cc237bd4637bb2b03ae692a401d/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:30.888249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bf3d7-ca91-4464-9f18-767646e521ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7075d41e2349eebee32600a5c57a68, user_id=ca4a2cc237bd4637bb2b03ae692a401d, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:30.891076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bf3d7-ca91-4464-9f18-767646e521ce admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:30.978639 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1226/2476] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:02:30 2022] PUT /identity/v3/projects/1d7075d41e2349eebee32600a5c57a68/users/ca4a2cc237bd4637bb2b03ae692a401d/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:02:30.984261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c89a-6ffd-4e2f-8661-82b8f8dde5c2 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:30.984672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c89a-6ffd-4e2f-8661-82b8f8dde5c2 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:30.985086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c89a-6ffd-4e2f-8661-82b8f8dde5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:31.006373 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-4503c89a-6ffd-4e2f-8661-82b8f8dde5c2 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:31.007625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4503c89a-6ffd-4e2f-8661-82b8f8dde5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:31.077866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1251/2477] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:02:31.088634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bf3d7-ca91-4464-9f18-767646e521ce admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:31.090668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-847bf3d7-ca91-4464-9f18-767646e521ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:31.183027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bf3d7-ca91-4464-9f18-767646e521ce admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:31.186956 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89ad3c-9c03-4bca-b680-79589d5ef499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:31.187618 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89ad3c-9c03-4bca-b680-79589d5ef499 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:31.187907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89ad3c-9c03-4bca-b680-79589d5ef499 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:31.188181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89ad3c-9c03-4bca-b680-79589d5ef499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:31.199229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89ad3c-9c03-4bca-b680-79589d5ef499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:31.200818 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89ad3c-9c03-4bca-b680-79589d5ef499 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:31.202352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503c89a-6ffd-4e2f-8661-82b8f8dde5c2 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:31.203957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4503c89a-6ffd-4e2f-8661-82b8f8dde5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:31.215329 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1227/2478] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:02:31.217483 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503c89a-6ffd-4e2f-8661-82b8f8dde5c2 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:31.221578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba443f9-edeb-4f5b-b83e-add026c2aaea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:31.222481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba443f9-edeb-4f5b-b83e-add026c2aaea service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:31.222747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba443f9-edeb-4f5b-b83e-add026c2aaea service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:31.223118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba443f9-edeb-4f5b-b83e-add026c2aaea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:31.225518 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-dba443f9-edeb-4f5b-b83e-add026c2aaea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:31.303138 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba443f9-edeb-4f5b-b83e-add026c2aaea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:31.304684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba443f9-edeb-4f5b-b83e-add026c2aaea service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:31.321509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1252/2479] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:02:39.833324 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341680aa-7a1b-482e-a43d-4b14ed7de497 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:39.833833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341680aa-7a1b-482e-a43d-4b14ed7de497 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:39.833919 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341680aa-7a1b-482e-a43d-4b14ed7de497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:39.866234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-341680aa-7a1b-482e-a43d-4b14ed7de497 None None] MFA Rules not processed for user `ca4a2cc237bd4637bb2b03ae692a401d`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:39.867554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-341680aa-7a1b-482e-a43d-4b14ed7de497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:39.963705 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1228/2480] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:02:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:02:39.970104 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba443f9-edeb-4f5b-b83e-add026c2aaea service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:39.984987 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba443f9-edeb-4f5b-b83e-add026c2aaea service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:39.990741 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd27d9-aec2-44a1-9db9-101e45faeec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:39.991436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd27d9-aec2-44a1-9db9-101e45faeec7 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:39.991716 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd27d9-aec2-44a1-9db9-101e45faeec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:39.992190 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd27d9-aec2-44a1-9db9-101e45faeec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:39.992973 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd27d9-aec2-44a1-9db9-101e45faeec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:39.995292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd27d9-aec2-44a1-9db9-101e45faeec7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:40.099321 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:40.111008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1253/2481] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:02:39 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:02:40.117810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341680aa-7a1b-482e-a43d-4b14ed7de497 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:40.152318 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341680aa-7a1b-482e-a43d-4b14ed7de497 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:40.198474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:40.288924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49c3d1-3ca9-4bc5-a013-5a2a93c68448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:40.293873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49c3d1-3ca9-4bc5-a013-5a2a93c68448 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:40.293873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49c3d1-3ca9-4bc5-a013-5a2a93c68448 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:40.294213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49c3d1-3ca9-4bc5-a013-5a2a93c68448 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:40.295085 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49c3d1-3ca9-4bc5-a013-5a2a93c68448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:40.301113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f49c3d1-3ca9-4bc5-a013-5a2a93c68448 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:40.432229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1229/2482] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:02:40 2022] POST /identity/v3/users => generated 298 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:02:40.437009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd27d9-aec2-44a1-9db9-101e45faeec7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:40.449727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd27d9-aec2-44a1-9db9-101e45faeec7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:40.455575 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7554c-a05a-49e0-ba79-31e2705d4b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:40.456809 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7554c-a05a-49e0-ba79-31e2705d4b01 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:40.457400 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7554c-a05a-49e0-ba79-31e2705d4b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:40.457974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7554c-a05a-49e0-ba79-31e2705d4b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:40.459013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7554c-a05a-49e0-ba79-31e2705d4b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:40.461033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7554c-a05a-49e0-ba79-31e2705d4b01 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:40.476719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1254/2483] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:02:40.488734 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49c3d1-3ca9-4bc5-a013-5a2a93c68448 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:40.494107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49c3d1-3ca9-4bc5-a013-5a2a93c68448 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:40.500977 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd67a2-5b03-4a29-8008-0f365a8b7d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:40.502481 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd67a2-5b03-4a29-8008-0f365a8b7d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:40.503037 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd67a2-5b03-4a29-8008-0f365a8b7d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:40.503542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd67a2-5b03-4a29-8008-0f365a8b7d72 admin admin] PATH_INFO: `/v3/projects/9d1248b10237426986a001602d6f2eb8/users/f0edb936daaf4ee996212baf348b462b/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:40.533371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd67a2-5b03-4a29-8008-0f365a8b7d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1248b10237426986a001602d6f2eb8, user_id=f0edb936daaf4ee996212baf348b462b, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:40.540464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd67a2-5b03-4a29-8008-0f365a8b7d72 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:40.658638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1230/2484] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:02:40 2022] PUT /identity/v3/projects/9d1248b10237426986a001602d6f2eb8/users/f0edb936daaf4ee996212baf348b462b/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:02:40.666315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7554c-a05a-49e0-ba79-31e2705d4b01 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:40.677604 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7554c-a05a-49e0-ba79-31e2705d4b01 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:40.804768 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42667ca-2d49-4918-b8b6-a671e25cd48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:40.808642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42667ca-2d49-4918-b8b6-a671e25cd48c admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:40.808642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42667ca-2d49-4918-b8b6-a671e25cd48c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:40.808642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42667ca-2d49-4918-b8b6-a671e25cd48c admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:40.810464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42667ca-2d49-4918-b8b6-a671e25cd48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:40.814473 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42667ca-2d49-4918-b8b6-a671e25cd48c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:40.847723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1255/2485] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:02:40.848456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd67a2-5b03-4a29-8008-0f365a8b7d72 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:40.867984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd67a2-5b03-4a29-8008-0f365a8b7d72 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:40.878062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4f9f5-8736-487a-be10-7ec189f7285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:40.880281 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4f9f5-8736-487a-be10-7ec189f7285b admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:40.881486 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4f9f5-8736-487a-be10-7ec189f7285b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:40.882193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4f9f5-8736-487a-be10-7ec189f7285b admin admin] PATH_INFO: `/v3/projects/9d1248b10237426986a001602d6f2eb8/users/f0edb936daaf4ee996212baf348b462b/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:40.886009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4f9f5-8736-487a-be10-7ec189f7285b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1248b10237426986a001602d6f2eb8, user_id=f0edb936daaf4ee996212baf348b462b, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:40.892056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4f9f5-8736-487a-be10-7ec189f7285b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:40.921128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1231/2486] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:02:40 2022] PUT /identity/v3/projects/9d1248b10237426986a001602d6f2eb8/users/f0edb936daaf4ee996212baf348b462b/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:02:42.740779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42667ca-2d49-4918-b8b6-a671e25cd48c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:42.743927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c42667ca-2d49-4918-b8b6-a671e25cd48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:42.903817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42667ca-2d49-4918-b8b6-a671e25cd48c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:43.026434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e555654-dda8-4bf4-b054-d600bd1faa49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:43.027483 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e555654-dda8-4bf4-b054-d600bd1faa49 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:43.027994 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e555654-dda8-4bf4-b054-d600bd1faa49 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:43.028496 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e555654-dda8-4bf4-b054-d600bd1faa49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:43.032174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5e555654-dda8-4bf4-b054-d600bd1faa49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:43.159430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:43.170153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e555654-dda8-4bf4-b054-d600bd1faa49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:43.172580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e555654-dda8-4bf4-b054-d600bd1faa49 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:43.192672 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1256/2487] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:02:47.585003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4f9f5-8736-487a-be10-7ec189f7285b admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:47.588914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6ca4f9f5-8736-487a-be10-7ec189f7285b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:47.746516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4f9f5-8736-487a-be10-7ec189f7285b admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:47.757511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff2211-0c97-4e75-9b73-98047104e5a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:47.758266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff2211-0c97-4e75-9b73-98047104e5a3 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:47.758550 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff2211-0c97-4e75-9b73-98047104e5a3 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:47.758825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff2211-0c97-4e75-9b73-98047104e5a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:47.761077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b0ff2211-0c97-4e75-9b73-98047104e5a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:47.865041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff2211-0c97-4e75-9b73-98047104e5a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:47.867006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff2211-0c97-4e75-9b73-98047104e5a3 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:47.879875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1232/2488] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:02:49.205181 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d3235-6cd3-47e0-93b2-9fa89b70b90c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:49.205629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d3235-6cd3-47e0-93b2-9fa89b70b90c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:49.205747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d3235-6cd3-47e0-93b2-9fa89b70b90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:49.251878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-1d1d3235-6cd3-47e0-93b2-9fa89b70b90c None None] MFA Rules not processed for user `f0edb936daaf4ee996212baf348b462b`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:49.255251 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-1d1d3235-6cd3-47e0-93b2-9fa89b70b90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:49.339739 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1257/2489] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:02:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:02:49.354315 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff2211-0c97-4e75-9b73-98047104e5a3 service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:49.356186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b0ff2211-0c97-4e75-9b73-98047104e5a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:49.361642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:49.437412 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff2211-0c97-4e75-9b73-98047104e5a3 service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:49.442202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba57c6-5b5a-46e4-9013-78a776cb72d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '259d506eb54e4766a8fe3fa5bb514e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:49.442571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba57c6-5b5a-46e4-9013-78a776cb72d1 service glance] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:49.442785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba57c6-5b5a-46e4-9013-78a776cb72d1 service glance] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:49.443035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba57c6-5b5a-46e4-9013-78a776cb72d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:49.519219 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba57c6-5b5a-46e4-9013-78a776cb72d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:49.521436 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba57c6-5b5a-46e4-9013-78a776cb72d1 service glance] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:49.532598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1233/2490] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:02:49.951307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59581a03-9c99-439a-9ffa-8599e5d217db None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:49.951599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59581a03-9c99-439a-9ffa-8599e5d217db None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:49.951879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59581a03-9c99-439a-9ffa-8599e5d217db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:49.976043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-59581a03-9c99-439a-9ffa-8599e5d217db None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:49.977292 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-59581a03-9c99-439a-9ffa-8599e5d217db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:50.049050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1258/2491] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 18:02:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:02:50.205494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba57c6-5b5a-46e4-9013-78a776cb72d1 service glance] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:50.208132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6bba57c6-5b5a-46e4-9013-78a776cb72d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:50.289724 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba57c6-5b5a-46e4-9013-78a776cb72d1 service glance] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:50.297282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59910af4-66c5-4fec-90bc-1928e4464490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:50.297282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59910af4-66c5-4fec-90bc-1928e4464490 service swift] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:50.297508 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59910af4-66c5-4fec-90bc-1928e4464490 service swift] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:50.297801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59910af4-66c5-4fec-90bc-1928e4464490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:50.307819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59910af4-66c5-4fec-90bc-1928e4464490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:50.309513 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59910af4-66c5-4fec-90bc-1928e4464490 service swift] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:50.320252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1234/2492] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:02:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 18:02:54.654368 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f53f7d-97ad-403c-968f-b2c3981f047a None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:54.654852 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f53f7d-97ad-403c-968f-b2c3981f047a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:54.655441 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f53f7d-97ad-403c-968f-b2c3981f047a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:54.687645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-38f53f7d-97ad-403c-968f-b2c3981f047a None None] MFA Rules not processed for user `faf9bdc76439428ab5e3c40d33a88425`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:02:54.691690 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-38f53f7d-97ad-403c-968f-b2c3981f047a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:54.807314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1259/2493] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:02:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:02:55.299517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59910af4-66c5-4fec-90bc-1928e4464490 service swift] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:55.392504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:55.404732 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59910af4-66c5-4fec-90bc-1928e4464490 service swift] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:55.410597 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65488f-9971-4143-9418-6d7f8e0c9977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:55.411723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65488f-9971-4143-9418-6d7f8e0c9977 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:55.412554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65488f-9971-4143-9418-6d7f8e0c9977 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:55.412554 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65488f-9971-4143-9418-6d7f8e0c9977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:55.415118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2c65488f-9971-4143-9418-6d7f8e0c9977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:55.432240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65488f-9971-4143-9418-6d7f8e0c9977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:55.439491 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65488f-9971-4143-9418-6d7f8e0c9977 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:55.451518 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1235/2494] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:02:56.231369 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f53f7d-97ad-403c-968f-b2c3981f047a None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:02:56.233532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-38f53f7d-97ad-403c-968f-b2c3981f047a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:56.327238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:02:56.419889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f53f7d-97ad-403c-968f-b2c3981f047a None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:02:56.433215 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c3e3f-d643-45db-ad87-eb09e03e2b75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b218402abe6540d8b81295676199f6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:02:56.434371 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c3e3f-d643-45db-ad87-eb09e03e2b75 service placement] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:02:56.434882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c3e3f-d643-45db-ad87-eb09e03e2b75 service placement] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:02:56.435526 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c3e3f-d643-45db-ad87-eb09e03e2b75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:02:56.439121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-961c3e3f-d643-45db-ad87-eb09e03e2b75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:02:56.459848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c3e3f-d643-45db-ad87-eb09e03e2b75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:02:56.462849 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c3e3f-d643-45db-ad87-eb09e03e2b75 service placement] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:02:56.478129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1260/2495] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:02:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:02.494587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65488f-9971-4143-9418-6d7f8e0c9977 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:02.511011 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65488f-9971-4143-9418-6d7f8e0c9977 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:02.515194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ab039-5cf7-4cf3-9089-56979848f5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:02.515889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ab039-5cf7-4cf3-9089-56979848f5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:02.516154 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ab039-5cf7-4cf3-9089-56979848f5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:02.516466 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ab039-5cf7-4cf3-9089-56979848f5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:02.518885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-403ab039-5cf7-4cf3-9089-56979848f5e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:02.533748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ab039-5cf7-4cf3-9089-56979848f5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:02.535707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ab039-5cf7-4cf3-9089-56979848f5e3 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:02.562984 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1236/2496] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:04.366525 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5e86-96fe-49d4-8814-09f9495db5e7 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:04.367097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5e86-96fe-49d4-8814-09f9495db5e7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:04.367097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5e86-96fe-49d4-8814-09f9495db5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:04.387233 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-049b5e86-96fe-49d4-8814-09f9495db5e7 None None] MFA Rules not processed for user `ca4a2cc237bd4637bb2b03ae692a401d`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:04.388467 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-049b5e86-96fe-49d4-8814-09f9495db5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:04.401837 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1261/2497] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:03:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:05.419154 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3bca-c752-43ea-a592-87cf5b65ef35 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:05.420381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3bca-c752-43ea-a592-87cf5b65ef35 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:05.420381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3bca-c752-43ea-a592-87cf5b65ef35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:05.441792 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d41d3bca-c752-43ea-a592-87cf5b65ef35 None None] MFA Rules not processed for user `fed263f071864582ba96d79f75fbfb36`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:05.443964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d41d3bca-c752-43ea-a592-87cf5b65ef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:05.451505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1237/2498] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:03:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:09.396643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa000b5b-d76e-42be-8623-9d46fbeb12b5 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:09.397191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa000b5b-d76e-42be-8623-9d46fbeb12b5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:09.397191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa000b5b-d76e-42be-8623-9d46fbeb12b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:09.421260 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-fa000b5b-d76e-42be-8623-9d46fbeb12b5 None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:09.422811 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-fa000b5b-d76e-42be-8623-9d46fbeb12b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:09.431532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1262/2499] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 18:03:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:03:09.453190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3bca-c752-43ea-a592-87cf5b65ef35 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:09.459971 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3bca-c752-43ea-a592-87cf5b65ef35 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:09.466822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca03cf2-8c08-4bc5-adcf-f8e390cb23c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:09.467585 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03cf2-8c08-4bc5-adcf-f8e390cb23c8 service swift] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:09.468121 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03cf2-8c08-4bc5-adcf-f8e390cb23c8 service swift] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:09.468663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03cf2-8c08-4bc5-adcf-f8e390cb23c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:09.481185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca03cf2-8c08-4bc5-adcf-f8e390cb23c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:09.483047 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca03cf2-8c08-4bc5-adcf-f8e390cb23c8 service swift] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:09.493648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1238/2500] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:03:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 18:03:18.116972 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa000b5b-d76e-42be-8623-9d46fbeb12b5 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:18.139511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa000b5b-d76e-42be-8623-9d46fbeb12b5 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:18.150426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4157be-b34a-426c-8369-2032b7d681d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:18.150426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4157be-b34a-426c-8369-2032b7d681d8 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:18.151156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4157be-b34a-426c-8369-2032b7d681d8 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:18.152121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4157be-b34a-426c-8369-2032b7d681d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:18.157810 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ea4157be-b34a-426c-8369-2032b7d681d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:18.713444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4157be-b34a-426c-8369-2032b7d681d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:18.715143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4157be-b34a-426c-8369-2032b7d681d8 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:18.759229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1263/2501] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:03:19.490939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=20 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:20.657642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca03cf2-8c08-4bc5-adcf-f8e390cb23c8 service swift] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:20.662423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-1ca03cf2-8c08-4bc5-adcf-f8e390cb23c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:20.718874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca03cf2-8c08-4bc5-adcf-f8e390cb23c8 service swift] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:20.730343 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee554b5-3157-4c8f-bda2-d106e6428a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:20.732159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee554b5-3157-4c8f-bda2-d106e6428a09 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:20.733146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee554b5-3157-4c8f-bda2-d106e6428a09 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:20.733927 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee554b5-3157-4c8f-bda2-d106e6428a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:20.737929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3ee554b5-3157-4c8f-bda2-d106e6428a09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:20.798002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee554b5-3157-4c8f-bda2-d106e6428a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:20.805168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee554b5-3157-4c8f-bda2-d106e6428a09 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:20.865326 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1239/2502] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:28.102145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4157be-b34a-426c-8369-2032b7d681d8 service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:28.108677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=54 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:28.115964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4157be-b34a-426c-8369-2032b7d681d8 service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:28.120085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea651ff6-05d9-4b04-8c00-690780175a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:28.121214 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea651ff6-05d9-4b04-8c00-690780175a39 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:28.121541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea651ff6-05d9-4b04-8c00-690780175a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:28.122045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea651ff6-05d9-4b04-8c00-690780175a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:28.124663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ea651ff6-05d9-4b04-8c00-690780175a39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:28.269004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea651ff6-05d9-4b04-8c00-690780175a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:28.273151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea651ff6-05d9-4b04-8c00-690780175a39 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:28.311179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1264/2503] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:03:30.848078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=6 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:31.626873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee554b5-3157-4c8f-bda2-d106e6428a09 service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:31.736377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee554b5-3157-4c8f-bda2-d106e6428a09 service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:31.748438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687e246-1d51-4fb4-aacb-6035a56e32e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:31.749646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687e246-1d51-4fb4-aacb-6035a56e32e5 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:31.750144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687e246-1d51-4fb4-aacb-6035a56e32e5 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:31.750627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687e246-1d51-4fb4-aacb-6035a56e32e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:31.754063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5687e246-1d51-4fb4-aacb-6035a56e32e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:31.799359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687e246-1d51-4fb4-aacb-6035a56e32e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:31.801180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687e246-1d51-4fb4-aacb-6035a56e32e5 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:31.815478 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1240/2504] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:32.563205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54656137-8d39-419a-b45d-d58643aa4ac8 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:32.564014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54656137-8d39-419a-b45d-d58643aa4ac8 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:32.564014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54656137-8d39-419a-b45d-d58643aa4ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:32.738551 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-54656137-8d39-419a-b45d-d58643aa4ac8 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:32.745086 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-54656137-8d39-419a-b45d-d58643aa4ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:32.911420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1265/2505] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Jul 20 18:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:03:33.058177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687e246-1d51-4fb4-aacb-6035a56e32e5 service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:33.090846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687e246-1d51-4fb4-aacb-6035a56e32e5 service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:33.100590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b02577-3cdb-4708-a3d2-eeedd7ff44b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:33.101845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b02577-3cdb-4708-a3d2-eeedd7ff44b9 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:33.102344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b02577-3cdb-4708-a3d2-eeedd7ff44b9 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:33.102747 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b02577-3cdb-4708-a3d2-eeedd7ff44b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:33.121337 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b02577-3cdb-4708-a3d2-eeedd7ff44b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:33.125563 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b02577-3cdb-4708-a3d2-eeedd7ff44b9 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:33.187019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1241/2506] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:36.016977 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54656137-8d39-419a-b45d-d58643aa4ac8 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:36.063543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54656137-8d39-419a-b45d-d58643aa4ac8 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:36.070760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f6148-3603-4932-b9d9-5246570481af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:36.071925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f6148-3603-4932-b9d9-5246570481af service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:36.072519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f6148-3603-4932-b9d9-5246570481af service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:36.072962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f6148-3603-4932-b9d9-5246570481af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:36.076374 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ff7f6148-3603-4932-b9d9-5246570481af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:36.127227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f6148-3603-4932-b9d9-5246570481af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:36.131140 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f6148-3603-4932-b9d9-5246570481af service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:36.149313 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1266/2507] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:03:36.359162 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b02577-3cdb-4708-a3d2-eeedd7ff44b9 service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:36.365536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-38b02577-3cdb-4708-a3d2-eeedd7ff44b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:36.400206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b02577-3cdb-4708-a3d2-eeedd7ff44b9 service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:36.415314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4a12-8a1a-4b60-aebb-264e09bc861b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:36.416441 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4a12-8a1a-4b60-aebb-264e09bc861b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:36.416842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4a12-8a1a-4b60-aebb-264e09bc861b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:36.417338 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4a12-8a1a-4b60-aebb-264e09bc861b admin admin] PATH_INFO: `/v3/users/de47dd54e8fc48ca9411ce4c7906b80b` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:36.427869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4a12-8a1a-4b60-aebb-264e09bc861b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de47dd54e8fc48ca9411ce4c7906b80b)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:36.427869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4a12-8a1a-4b60-aebb-264e09bc861b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:36.690270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e204c-0d0b-4c4a-a655-43bb0b976fac None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:36.691321 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e204c-0d0b-4c4a-a655-43bb0b976fac None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:36.692974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e204c-0d0b-4c4a-a655-43bb0b976fac None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:36.696821 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1267/2508] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 18:03:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 18:03:36.718605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b149545-c934-4a23-818f-e99d82b81f73 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:36.719065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b149545-c934-4a23-818f-e99d82b81f73 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:36.719557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b149545-c934-4a23-818f-e99d82b81f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:36.749602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-3b149545-c934-4a23-818f-e99d82b81f73 None None] MFA Rules not processed for user `11930f08a1324902a083436649660130`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:36.752966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3b149545-c934-4a23-818f-e99d82b81f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:36.776392 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1268/2509] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 18:03:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:03:36.808230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b149545-c934-4a23-818f-e99d82b81f73 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:36.811573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-862c4a12-8a1a-4b60-aebb-264e09bc861b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de47dd54e8fc48ca9411ce4c7906b80b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:36.836632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b149545-c934-4a23-818f-e99d82b81f73 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:36.845344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-862c4a12-8a1a-4b60-aebb-264e09bc861b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de47dd54e8fc48ca9411ce4c7906b80b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:36.849296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5cbed-0405-4513-b04a-a9086e3fd4b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:36.850470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5cbed-0405-4513-b04a-a9086e3fd4b9 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:36.850978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5cbed-0405-4513-b04a-a9086e3fd4b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:36.851488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5cbed-0405-4513-b04a-a9086e3fd4b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:36.866521 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-862c4a12-8a1a-4b60-aebb-264e09bc861b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de47dd54e8fc48ca9411ce4c7906b80b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:36.868175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5cbed-0405-4513-b04a-a9086e3fd4b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:36.871073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5cbed-0405-4513-b04a-a9086e3fd4b9 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:36.889111 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1269/2510] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:03:36.956199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-862c4a12-8a1a-4b60-aebb-264e09bc861b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de47dd54e8fc48ca9411ce4c7906b80b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:36.957333 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-862c4a12-8a1a-4b60-aebb-264e09bc861b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de47dd54e8fc48ca9411ce4c7906b80b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:36.969567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1242/2511] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:03:36 2022] DELETE /identity/v3/users/de47dd54e8fc48ca9411ce4c7906b80b => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:03:37.002811 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec755b1-0166-4df4-a2db-2f97627a5cc2 None None] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:37.003676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec755b1-0166-4df4-a2db-2f97627a5cc2 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:37.006577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec755b1-0166-4df4-a2db-2f97627a5cc2 None None] PATH_INFO: `/` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:37.009203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1270/2512] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 18:03:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 18:03:37.016397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a66de-075a-446b-99c7-2fe98a7ae35a None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:37.016947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a66de-075a-446b-99c7-2fe98a7ae35a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:37.017126 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a66de-075a-446b-99c7-2fe98a7ae35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:37.040202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-9c9a66de-075a-446b-99c7-2fe98a7ae35a None None] MFA Rules not processed for user `3b52e88df44d49b186d54a8d045595ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:37.041558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9c9a66de-075a-446b-99c7-2fe98a7ae35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:37.129057 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:37.159617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1243/2513] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 18:03:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:03:37.186099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec755b1-0166-4df4-a2db-2f97627a5cc2 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:37.188207 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9ec755b1-0166-4df4-a2db-2f97627a5cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:37.314444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec755b1-0166-4df4-a2db-2f97627a5cc2 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:37.334586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064456bb-071e-4737-a99a-c8b84e0ff0ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:37.337403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064456bb-071e-4737-a99a-c8b84e0ff0ce service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:37.340649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064456bb-071e-4737-a99a-c8b84e0ff0ce service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:37.341444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064456bb-071e-4737-a99a-c8b84e0ff0ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:37.380915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064456bb-071e-4737-a99a-c8b84e0ff0ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:37.385000 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064456bb-071e-4737-a99a-c8b84e0ff0ce service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:37.410004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1271/2514] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:37.464446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a66de-075a-446b-99c7-2fe98a7ae35a None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:37.470216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9c9a66de-075a-446b-99c7-2fe98a7ae35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:37.677498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a66de-075a-446b-99c7-2fe98a7ae35a None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:37.689391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cfdf6-0c3f-4771-8988-4e51a03277cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:37.689391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cfdf6-0c3f-4771-8988-4e51a03277cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:37.689391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cfdf6-0c3f-4771-8988-4e51a03277cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:37.689391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cfdf6-0c3f-4771-8988-4e51a03277cb admin admin] PATH_INFO: `/v3/projects/23d7e15987bd4fb7a54a43002b44c1fc` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:37.690398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cfdf6-0c3f-4771-8988-4e51a03277cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d7e15987bd4fb7a54a43002b44c1fc)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:37.690398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cfdf6-0c3f-4771-8988-4e51a03277cb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:37.935415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f32cfdf6-0c3f-4771-8988-4e51a03277cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d7e15987bd4fb7a54a43002b44c1fc', 'request_id': 'req-f32cfdf6-0c3f-4771-8988-4e51a03277cb'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:37.953339 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f32cfdf6-0c3f-4771-8988-4e51a03277cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d7e15987bd4fb7a54a43002b44c1fc', 'request_id': 'req-f32cfdf6-0c3f-4771-8988-4e51a03277cb'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:38.573581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f32cfdf6-0c3f-4771-8988-4e51a03277cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d7e15987bd4fb7a54a43002b44c1fc', 'request_id': 'req-f32cfdf6-0c3f-4771-8988-4e51a03277cb'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:38.597766 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f32cfdf6-0c3f-4771-8988-4e51a03277cb admin admin] The token cache is being invalidate because project 23d7e15987bd4fb7a54a43002b44c1fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:03:38.598829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f32cfdf6-0c3f-4771-8988-4e51a03277cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:38.600959 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-f32cfdf6-0c3f-4771-8988-4e51a03277cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:38.611052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1244/2515] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:03:37 2022] DELETE /identity/v3/projects/23d7e15987bd4fb7a54a43002b44c1fc => generated 0 bytes in 1150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:03:38.618084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c268b5-5644-425f-821f-83096891829d None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:38.618084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c268b5-5644-425f-821f-83096891829d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:38.618084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c268b5-5644-425f-821f-83096891829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:38.625676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:38.637884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-47c268b5-5644-425f-821f-83096891829d None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:38.639143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-47c268b5-5644-425f-821f-83096891829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:38.733084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1272/2516] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:38.741632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e605fc-cbe4-41fa-aa2b-29db97ad8af1 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:38.742313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e605fc-cbe4-41fa-aa2b-29db97ad8af1 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:38.743044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e605fc-cbe4-41fa-aa2b-29db97ad8af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:38.787538 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-20e605fc-cbe4-41fa-aa2b-29db97ad8af1 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:38.789231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-20e605fc-cbe4-41fa-aa2b-29db97ad8af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:38.798804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1245/2517] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:03:38.805365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c268b5-5644-425f-821f-83096891829d None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:38.828037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c268b5-5644-425f-821f-83096891829d None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:38.837953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f3973-fb5d-43d8-85e9-23446a7631f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:38.839125 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f3973-fb5d-43d8-85e9-23446a7631f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:38.839855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f3973-fb5d-43d8-85e9-23446a7631f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:38.840637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f3973-fb5d-43d8-85e9-23446a7631f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:38.842310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f3973-fb5d-43d8-85e9-23446a7631f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:03:38.843194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f3973-fb5d-43d8-85e9-23446a7631f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:38.846421 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f3973-fb5d-43d8-85e9-23446a7631f2 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:38.874846 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1273/2518] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:03:38.881520 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e605fc-cbe4-41fa-aa2b-29db97ad8af1 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:38.900218 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e605fc-cbe4-41fa-aa2b-29db97ad8af1 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:38.906847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7733f-c5de-4b39-9897-a884cfc0a10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:38.908756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7733f-c5de-4b39-9897-a884cfc0a10f admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:38.909041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7733f-c5de-4b39-9897-a884cfc0a10f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:38.909463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7733f-c5de-4b39-9897-a884cfc0a10f admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:38.910205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7733f-c5de-4b39-9897-a884cfc0a10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:38.914174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7733f-c5de-4b39-9897-a884cfc0a10f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:39.019972 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a311-5077-4952-8459-8e434f85da97 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:39.020303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a311-5077-4952-8459-8e434f85da97 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:39.023757 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a311-5077-4952-8459-8e434f85da97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:39.048858 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-c9c0a311-5077-4952-8459-8e434f85da97 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:39.050701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c9c0a311-5077-4952-8459-8e434f85da97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:39.063724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1274/2519] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Jul 20 18:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:03:39.093447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0a311-5077-4952-8459-8e434f85da97 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:39.093954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1246/2520] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:03:38 2022] POST /identity/v3/projects => generated 399 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:03:39.100278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7733f-c5de-4b39-9897-a884cfc0a10f admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:39.111578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c9c0a311-5077-4952-8459-8e434f85da97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:39.189302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:39.220159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7733f-c5de-4b39-9897-a884cfc0a10f admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:39.229451 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47414efc-1615-4063-b21b-4ff4425f19ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:39.230617 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47414efc-1615-4063-b21b-4ff4425f19ba admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:39.231104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47414efc-1615-4063-b21b-4ff4425f19ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:39.231587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47414efc-1615-4063-b21b-4ff4425f19ba admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:39.232809 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47414efc-1615-4063-b21b-4ff4425f19ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:39.236519 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47414efc-1615-4063-b21b-4ff4425f19ba admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:39.357829 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0a311-5077-4952-8459-8e434f85da97 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:39.482144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1247/2521] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:03:39 2022] POST /identity/v3/users => generated 300 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:03:39.484996 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47414efc-1615-4063-b21b-4ff4425f19ba admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:39.501370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47414efc-1615-4063-b21b-4ff4425f19ba admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:39.515351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001dc7-18bb-4c39-81aa-b49421b46e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:39.515351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001dc7-18bb-4c39-81aa-b49421b46e0f admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:39.515351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001dc7-18bb-4c39-81aa-b49421b46e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:39.515351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001dc7-18bb-4c39-81aa-b49421b46e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:39.515952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19001dc7-18bb-4c39-81aa-b49421b46e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:39.519936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19001dc7-18bb-4c39-81aa-b49421b46e0f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:39.524138 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8aa046-5170-466f-8511-5ce7337e8c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:39.524907 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aa046-5170-466f-8511-5ce7337e8c82 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:39.525198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aa046-5170-466f-8511-5ce7337e8c82 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:39.525475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8aa046-5170-466f-8511-5ce7337e8c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:39.535981 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8aa046-5170-466f-8511-5ce7337e8c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:39.536649 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1248/2522] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:03:39.538001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8aa046-5170-466f-8511-5ce7337e8c82 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:39.544006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001dc7-18bb-4c39-81aa-b49421b46e0f admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:39.550530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1275/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:39.562757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001dc7-18bb-4c39-81aa-b49421b46e0f admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:39.573398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929dd68-fe84-45e1-ba3c-a6af90c8d886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:39.574426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929dd68-fe84-45e1-ba3c-a6af90c8d886 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:39.576174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929dd68-fe84-45e1-ba3c-a6af90c8d886 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:39.576778 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929dd68-fe84-45e1-ba3c-a6af90c8d886 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:39.578018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929dd68-fe84-45e1-ba3c-a6af90c8d886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:39.580552 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929dd68-fe84-45e1-ba3c-a6af90c8d886 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:39.603951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1249/2524] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:03:39.610239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8aa046-5170-466f-8511-5ce7337e8c82 service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:39.630845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8aa046-5170-466f-8511-5ce7337e8c82 service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:39.641947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de0dbf-0ee1-42eb-9d7a-572e678fd8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:39.643157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de0dbf-0ee1-42eb-9d7a-572e678fd8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:39.643916 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de0dbf-0ee1-42eb-9d7a-572e678fd8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:39.644259 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de0dbf-0ee1-42eb-9d7a-572e678fd8c8 admin admin] PATH_INFO: `/v3/projects/cec71458cc9c489aa607ec687eb91ad9/users/efad389dfc51419ab31f33675561d7bd/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:39.650199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:39.667107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de0dbf-0ee1-42eb-9d7a-572e678fd8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec71458cc9c489aa607ec687eb91ad9, user_id=efad389dfc51419ab31f33675561d7bd, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:39.680112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de0dbf-0ee1-42eb-9d7a-572e678fd8c8 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:39.788953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1276/2525] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:03:39 2022] PUT /identity/v3/projects/cec71458cc9c489aa607ec687eb91ad9/users/efad389dfc51419ab31f33675561d7bd/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:03:39.801320 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca2a0a-e152-4396-9cd4-6f4f8c1f2f29 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:39.802391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca2a0a-e152-4396-9cd4-6f4f8c1f2f29 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:39.802505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca2a0a-e152-4396-9cd4-6f4f8c1f2f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:39.844450 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-a6ca2a0a-e152-4396-9cd4-6f4f8c1f2f29 None None] MFA Rules not processed for user `efad389dfc51419ab31f33675561d7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:39.845911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a6ca2a0a-e152-4396-9cd4-6f4f8c1f2f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:39.961810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1250/2526] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:03:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:39.971593 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de0dbf-0ee1-42eb-9d7a-572e678fd8c8 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:40.056712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de0dbf-0ee1-42eb-9d7a-572e678fd8c8 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:40.062012 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df810cc-aa20-4c91-aac2-92b411acfc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:40.062717 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df810cc-aa20-4c91-aac2-92b411acfc31 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:40.063150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df810cc-aa20-4c91-aac2-92b411acfc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:40.063433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df810cc-aa20-4c91-aac2-92b411acfc31 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:40.064164 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df810cc-aa20-4c91-aac2-92b411acfc31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:40.066219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df810cc-aa20-4c91-aac2-92b411acfc31 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:40.184091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1277/2527] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:03:39 2022] POST /identity/v3/projects => generated 405 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:03:40.185437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca2a0a-e152-4396-9cd4-6f4f8c1f2f29 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:40.200827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca2a0a-e152-4396-9cd4-6f4f8c1f2f29 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:40.288182 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c567f-2d8e-4f30-91c4-5ca6818f5d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:40.288182 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c567f-2d8e-4f30-91c4-5ca6818f5d44 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:40.288650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c567f-2d8e-4f30-91c4-5ca6818f5d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:40.288915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c567f-2d8e-4f30-91c4-5ca6818f5d44 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:40.289735 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c567f-2d8e-4f30-91c4-5ca6818f5d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:40.292155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c567f-2d8e-4f30-91c4-5ca6818f5d44 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:40.456131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1251/2528] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:03:40 2022] POST /identity/v3/users => generated 309 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:03:40.461657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df810cc-aa20-4c91-aac2-92b411acfc31 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:40.473767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df810cc-aa20-4c91-aac2-92b411acfc31 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:40.479311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9e7a9-0bd1-49eb-9fa0-9d399c0f28b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:40.480414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e7a9-0bd1-49eb-9fa0-9d399c0f28b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:40.480969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e7a9-0bd1-49eb-9fa0-9d399c0f28b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:40.481458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e7a9-0bd1-49eb-9fa0-9d399c0f28b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:40.482605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9e7a9-0bd1-49eb-9fa0-9d399c0f28b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:40.484562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9e7a9-0bd1-49eb-9fa0-9d399c0f28b7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:40.509236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1278/2529] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:03:40.511624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c567f-2d8e-4f30-91c4-5ca6818f5d44 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:40.525073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c567f-2d8e-4f30-91c4-5ca6818f5d44 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:40.531789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06ec9a-104f-4ad7-8f55-987c894ab414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:40.534091 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06ec9a-104f-4ad7-8f55-987c894ab414 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:40.534890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06ec9a-104f-4ad7-8f55-987c894ab414 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:40.535410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06ec9a-104f-4ad7-8f55-987c894ab414 admin admin] PATH_INFO: `/v3/projects/80b3dadcf7354d80ad64f2c76971ecfa/users/d519777836514ece9b24ef0261c9a247/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:40.570826 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06ec9a-104f-4ad7-8f55-987c894ab414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b3dadcf7354d80ad64f2c76971ecfa, user_id=d519777836514ece9b24ef0261c9a247, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:40.577958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06ec9a-104f-4ad7-8f55-987c894ab414 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:40.673256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1252/2530] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:03:40 2022] PUT /identity/v3/projects/80b3dadcf7354d80ad64f2c76971ecfa/users/d519777836514ece9b24ef0261c9a247/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:03:40.677925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9e7a9-0bd1-49eb-9fa0-9d399c0f28b7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:40.689032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9e7a9-0bd1-49eb-9fa0-9d399c0f28b7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:40.773675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c755a-1bb8-4f49-b164-5cc0f8640adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:40.776920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c755a-1bb8-4f49-b164-5cc0f8640adf admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:40.776920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c755a-1bb8-4f49-b164-5cc0f8640adf admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:40.776920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c755a-1bb8-4f49-b164-5cc0f8640adf admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:40.776920 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c755a-1bb8-4f49-b164-5cc0f8640adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:40.779265 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c755a-1bb8-4f49-b164-5cc0f8640adf admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:40.804354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1279/2531] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:03:40.810404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06ec9a-104f-4ad7-8f55-987c894ab414 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:40.828933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06ec9a-104f-4ad7-8f55-987c894ab414 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:40.849622 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2f6e0-e512-432c-b97d-023e5fe22047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:40.850752 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2f6e0-e512-432c-b97d-023e5fe22047 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:40.851039 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2f6e0-e512-432c-b97d-023e5fe22047 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:40.851320 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2f6e0-e512-432c-b97d-023e5fe22047 admin admin] PATH_INFO: `/v3/projects/80b3dadcf7354d80ad64f2c76971ecfa/users/d519777836514ece9b24ef0261c9a247/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:40.861945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2f6e0-e512-432c-b97d-023e5fe22047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b3dadcf7354d80ad64f2c76971ecfa, user_id=d519777836514ece9b24ef0261c9a247, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:40.868334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2f6e0-e512-432c-b97d-023e5fe22047 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:40.884768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:40.911285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1253/2532] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:03:40 2022] PUT /identity/v3/projects/80b3dadcf7354d80ad64f2c76971ecfa/users/d519777836514ece9b24ef0261c9a247/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:03:40.912986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15545dca-4af7-43fc-bf10-2485bbc1c2e9 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:40.913281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15545dca-4af7-43fc-bf10-2485bbc1c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:40.913699 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15545dca-4af7-43fc-bf10-2485bbc1c2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:41.005222 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-15545dca-4af7-43fc-bf10-2485bbc1c2e9 None None] MFA Rules not processed for user `d519777836514ece9b24ef0261c9a247`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:41.006706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-15545dca-4af7-43fc-bf10-2485bbc1c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:41.091187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:41.132589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1280/2533] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:03:40 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:03:41.141242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2f6e0-e512-432c-b97d-023e5fe22047 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:41.143303 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0de2f6e0-e512-432c-b97d-023e5fe22047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:41.219272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2f6e0-e512-432c-b97d-023e5fe22047 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:41.225206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d873d8-b387-46da-ae29-93729bfd4055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:41.225882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d873d8-b387-46da-ae29-93729bfd4055 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:41.226163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d873d8-b387-46da-ae29-93729bfd4055 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:41.226438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d873d8-b387-46da-ae29-93729bfd4055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:41.238140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d873d8-b387-46da-ae29-93729bfd4055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:41.240192 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d873d8-b387-46da-ae29-93729bfd4055 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:41.252898 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1254/2534] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:41 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:41.443029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15545dca-4af7-43fc-bf10-2485bbc1c2e9 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:41.533291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15545dca-4af7-43fc-bf10-2485bbc1c2e9 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:41.539652 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:41.541243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:41.541566 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:41.541990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] PATH_INFO: `/v3/users/efad389dfc51419ab31f33675561d7bd` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:41.543302 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=efad389dfc51419ab31f33675561d7bd)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:41.546276 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:41.906319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efad389dfc51419ab31f33675561d7bd'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:41.931684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efad389dfc51419ab31f33675561d7bd'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:41.946982 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efad389dfc51419ab31f33675561d7bd'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:42.071111 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efad389dfc51419ab31f33675561d7bd'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:42.072204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efad389dfc51419ab31f33675561d7bd'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:42.082187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1281/2535] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:03:41 2022] DELETE /identity/v3/users/efad389dfc51419ab31f33675561d7bd => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:03:42.087643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb358e-8fa8-4fd9-80ca-24ac9964a28c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:42.088062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb358e-8fa8-4fd9-80ca-24ac9964a28c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:42.088443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb358e-8fa8-4fd9-80ca-24ac9964a28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:42.110599 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-6efb358e-8fa8-4fd9-80ca-24ac9964a28c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:42.118634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6efb358e-8fa8-4fd9-80ca-24ac9964a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:42.215646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1255/2536] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:42.227450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:42.229322 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:42.301004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbfcf9-d3f4-4192-b855-8770eaf387bd admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:42.306045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0388d3-9ea5-4019-b538-fdfb09ebda6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:42.306720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0388d3-9ea5-4019-b538-fdfb09ebda6a service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:42.307002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0388d3-9ea5-4019-b538-fdfb09ebda6a service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:42.307302 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0388d3-9ea5-4019-b538-fdfb09ebda6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:42.318204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0388d3-9ea5-4019-b538-fdfb09ebda6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:42.319680 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0388d3-9ea5-4019-b538-fdfb09ebda6a service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:42.336661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1282/2537] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:42.982127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb358e-8fa8-4fd9-80ca-24ac9964a28c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:42.984507 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6efb358e-8fa8-4fd9-80ca-24ac9964a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:43.006404 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb358e-8fa8-4fd9-80ca-24ac9964a28c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:43.013439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa99018-8265-49e9-8485-c45f47362966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:43.015095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99018-8265-49e9-8485-c45f47362966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:43.016063 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99018-8265-49e9-8485-c45f47362966 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:43.016800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99018-8265-49e9-8485-c45f47362966 admin admin] PATH_INFO: `/v3/projects/cec71458cc9c489aa607ec687eb91ad9` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:43.019144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa99018-8265-49e9-8485-c45f47362966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec71458cc9c489aa607ec687eb91ad9)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:43.024015 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa99018-8265-49e9-8485-c45f47362966 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:43.237282 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-cfa99018-8265-49e9-8485-c45f47362966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec71458cc9c489aa607ec687eb91ad9', 'request_id': 'req-cfa99018-8265-49e9-8485-c45f47362966'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:43.258222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-cfa99018-8265-49e9-8485-c45f47362966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec71458cc9c489aa607ec687eb91ad9', 'request_id': 'req-cfa99018-8265-49e9-8485-c45f47362966'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:43.360781 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-cfa99018-8265-49e9-8485-c45f47362966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec71458cc9c489aa607ec687eb91ad9', 'request_id': 'req-cfa99018-8265-49e9-8485-c45f47362966'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:43.384781 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-cfa99018-8265-49e9-8485-c45f47362966 admin admin] The token cache is being invalidate because project cec71458cc9c489aa607ec687eb91ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:03:43.385111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-cfa99018-8265-49e9-8485-c45f47362966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:43.386090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-cfa99018-8265-49e9-8485-c45f47362966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:43.387787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1256/2538] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:03:42 2022] DELETE /identity/v3/projects/cec71458cc9c489aa607ec687eb91ad9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:03:43.393775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0388d3-9ea5-4019-b538-fdfb09ebda6a service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:43.411210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:43.417650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0388d3-9ea5-4019-b538-fdfb09ebda6a service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:43.521674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:43.528927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:43.528927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:43.528927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] PATH_INFO: `/v3/users/d519777836514ece9b24ef0261c9a247` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:43.528927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d519777836514ece9b24ef0261c9a247)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:43.528927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:43.863869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd519777836514ece9b24ef0261c9a247'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:43.884225 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd519777836514ece9b24ef0261c9a247'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:43.892877 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd519777836514ece9b24ef0261c9a247'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:44.150357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd519777836514ece9b24ef0261c9a247'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:44.150986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd519777836514ece9b24ef0261c9a247'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:44.157676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1283/2539] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:03:43 2022] DELETE /identity/v3/users/d519777836514ece9b24ef0261c9a247 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:03:44.431836 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705f8f8-2244-4cc9-a5cc-2b72b2f7db3f None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:44.432335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705f8f8-2244-4cc9-a5cc-2b72b2f7db3f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:44.432468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705f8f8-2244-4cc9-a5cc-2b72b2f7db3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:44.453559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-1705f8f8-2244-4cc9-a5cc-2b72b2f7db3f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:44.455534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-1705f8f8-2244-4cc9-a5cc-2b72b2f7db3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:44.484320 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:44.541242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1257/2540] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Jul 20 18:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:44.705795 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:44.712791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:44.826735 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55248c-203d-4f2f-9c06-4e7988351de8 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:44.833010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26ea0c-d4f3-44a5-892b-f6ce3f4ac893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:44.833694 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26ea0c-d4f3-44a5-892b-f6ce3f4ac893 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:44.833978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26ea0c-d4f3-44a5-892b-f6ce3f4ac893 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:44.834271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26ea0c-d4f3-44a5-892b-f6ce3f4ac893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:44.843932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26ea0c-d4f3-44a5-892b-f6ce3f4ac893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:44.845674 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26ea0c-d4f3-44a5-892b-f6ce3f4ac893 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:44.857545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1284/2541] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:44.986691 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705f8f8-2244-4cc9-a5cc-2b72b2f7db3f None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:44.988587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-1705f8f8-2244-4cc9-a5cc-2b72b2f7db3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:45.007640 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705f8f8-2244-4cc9-a5cc-2b72b2f7db3f None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:45.017969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f0ee0-a6e2-4867-ae49-e0819f06ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:45.019102 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f0ee0-a6e2-4867-ae49-e0819f06ae17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:45.019457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f0ee0-a6e2-4867-ae49-e0819f06ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:45.019804 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f0ee0-a6e2-4867-ae49-e0819f06ae17 admin admin] PATH_INFO: `/v3/projects/80b3dadcf7354d80ad64f2c76971ecfa` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:45.021777 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f0ee0-a6e2-4867-ae49-e0819f06ae17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b3dadcf7354d80ad64f2c76971ecfa)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:45.024388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f0ee0-a6e2-4867-ae49-e0819f06ae17 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:45.218576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-370f0ee0-a6e2-4867-ae49-e0819f06ae17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b3dadcf7354d80ad64f2c76971ecfa', 'request_id': 'req-370f0ee0-a6e2-4867-ae49-e0819f06ae17'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:45.224036 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-370f0ee0-a6e2-4867-ae49-e0819f06ae17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b3dadcf7354d80ad64f2c76971ecfa', 'request_id': 'req-370f0ee0-a6e2-4867-ae49-e0819f06ae17'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:45.379218 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-370f0ee0-a6e2-4867-ae49-e0819f06ae17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b3dadcf7354d80ad64f2c76971ecfa', 'request_id': 'req-370f0ee0-a6e2-4867-ae49-e0819f06ae17'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:45.407302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-370f0ee0-a6e2-4867-ae49-e0819f06ae17 admin admin] The token cache is being invalidate because project 80b3dadcf7354d80ad64f2c76971ecfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:03:45.407302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-370f0ee0-a6e2-4867-ae49-e0819f06ae17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:45.411376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-370f0ee0-a6e2-4867-ae49-e0819f06ae17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:45.413788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1258/2542] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:03:44 2022] DELETE /identity/v3/projects/80b3dadcf7354d80ad64f2c76971ecfa => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:03:45.421412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a7c3c-5107-4d0d-a7ff-100e6d7ab679 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:45.422385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a7c3c-5107-4d0d-a7ff-100e6d7ab679 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:45.424023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a7c3c-5107-4d0d-a7ff-100e6d7ab679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:45.450611 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:45.463653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b97a7c3c-5107-4d0d-a7ff-100e6d7ab679 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:45.466245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b97a7c3c-5107-4d0d-a7ff-100e6d7ab679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:45.572770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1285/2543] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:45.575058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6cca0-4233-4f44-9193-e6cdfa289d12 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:45.575602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6cca0-4233-4f44-9193-e6cdfa289d12 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:45.576319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6cca0-4233-4f44-9193-e6cdfa289d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:45.615462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-4ef6cca0-4233-4f44-9193-e6cdfa289d12 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:45.616580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4ef6cca0-4233-4f44-9193-e6cdfa289d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:45.627608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1259/2544] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:45.633692 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a7c3c-5107-4d0d-a7ff-100e6d7ab679 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:45.647563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a7c3c-5107-4d0d-a7ff-100e6d7ab679 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:45.654177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6a58f-59ba-4b9a-9139-03593f102c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:45.655045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6a58f-59ba-4b9a-9139-03593f102c1f admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:45.655641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6a58f-59ba-4b9a-9139-03593f102c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:45.656087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6a58f-59ba-4b9a-9139-03593f102c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:45.657008 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6a58f-59ba-4b9a-9139-03593f102c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:03:45.657422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6a58f-59ba-4b9a-9139-03593f102c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:45.659662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6a58f-59ba-4b9a-9139-03593f102c1f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:45.685801 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1286/2545] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:03:45.690980 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6cca0-4233-4f44-9193-e6cdfa289d12 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:45.713762 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6cca0-4233-4f44-9193-e6cdfa289d12 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:45.729235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e258932-4920-4661-acbb-f3ac6c8a9f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:45.730642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e258932-4920-4661-acbb-f3ac6c8a9f64 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:45.731155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e258932-4920-4661-acbb-f3ac6c8a9f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:45.731658 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e258932-4920-4661-acbb-f3ac6c8a9f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:45.732929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e258932-4920-4661-acbb-f3ac6c8a9f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:45.736969 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e258932-4920-4661-acbb-f3ac6c8a9f64 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:45.977664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1260/2546] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:03:45 2022] POST /identity/v3/projects => generated 403 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:03:45.979678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6a58f-59ba-4b9a-9139-03593f102c1f admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:46.004136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6a58f-59ba-4b9a-9139-03593f102c1f admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:46.119855 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5200733-54cf-4875-a840-f1b1963708d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:46.120843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5200733-54cf-4875-a840-f1b1963708d6 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:46.121129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5200733-54cf-4875-a840-f1b1963708d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:46.121473 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5200733-54cf-4875-a840-f1b1963708d6 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:46.122186 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5200733-54cf-4875-a840-f1b1963708d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:46.125144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5200733-54cf-4875-a840-f1b1963708d6 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:46.291949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1287/2547] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:03:45 2022] POST /identity/v3/users => generated 302 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:03:46.298494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e258932-4920-4661-acbb-f3ac6c8a9f64 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:46.324391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e258932-4920-4661-acbb-f3ac6c8a9f64 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:46.335643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de325e-a9cc-4430-ad8d-e268e3701706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:46.338499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de325e-a9cc-4430-ad8d-e268e3701706 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:46.338499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de325e-a9cc-4430-ad8d-e268e3701706 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:46.338499 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de325e-a9cc-4430-ad8d-e268e3701706 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:46.340785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de325e-a9cc-4430-ad8d-e268e3701706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:46.346238 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de325e-a9cc-4430-ad8d-e268e3701706 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:46.361465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1261/2548] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:03:46.366805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5200733-54cf-4875-a840-f1b1963708d6 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:46.380334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5200733-54cf-4875-a840-f1b1963708d6 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:46.386289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a2dfd-7150-41f5-8e81-45c0be6f5003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:46.386998 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a2dfd-7150-41f5-8e81-45c0be6f5003 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:46.390109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a2dfd-7150-41f5-8e81-45c0be6f5003 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:46.390109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a2dfd-7150-41f5-8e81-45c0be6f5003 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:46.390109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a2dfd-7150-41f5-8e81-45c0be6f5003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:46.390109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a2dfd-7150-41f5-8e81-45c0be6f5003 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:46.402339 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1288/2549] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:03:46.408075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de325e-a9cc-4430-ad8d-e268e3701706 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:46.420095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de325e-a9cc-4430-ad8d-e268e3701706 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:46.425930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fde6c-6f89-46d3-98f7-43e0e929a8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:46.427368 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fde6c-6f89-46d3-98f7-43e0e929a8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:46.427813 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fde6c-6f89-46d3-98f7-43e0e929a8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:46.428221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fde6c-6f89-46d3-98f7-43e0e929a8b5 admin admin] PATH_INFO: `/v3/projects/a20df3cccd1f4c5a8187a661da2fe207/users/220ca2f6b3d04913be26ee94d20c635b/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:46.447390 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fde6c-6f89-46d3-98f7-43e0e929a8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20df3cccd1f4c5a8187a661da2fe207, user_id=220ca2f6b3d04913be26ee94d20c635b, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:46.451292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fde6c-6f89-46d3-98f7-43e0e929a8b5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:46.587392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1262/2550] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:03:46 2022] PUT /identity/v3/projects/a20df3cccd1f4c5a8187a661da2fe207/users/220ca2f6b3d04913be26ee94d20c635b/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:03:46.593724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694abe48-3b2b-4c52-a3c1-84638180dd23 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:46.594201 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694abe48-3b2b-4c52-a3c1-84638180dd23 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:46.594694 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694abe48-3b2b-4c52-a3c1-84638180dd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:46.627190 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-694abe48-3b2b-4c52-a3c1-84638180dd23 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:46.629450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-694abe48-3b2b-4c52-a3c1-84638180dd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:46.718227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1289/2551] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:46.730446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fde6c-6f89-46d3-98f7-43e0e929a8b5 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:46.732459 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-382fde6c-6f89-46d3-98f7-43e0e929a8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:46.809719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:46.815211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fde6c-6f89-46d3-98f7-43e0e929a8b5 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:46.820395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a96326-aeb1-4c8d-b3c0-556eff9343cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:46.821122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a96326-aeb1-4c8d-b3c0-556eff9343cc service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:46.821410 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a96326-aeb1-4c8d-b3c0-556eff9343cc service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:46.821709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a96326-aeb1-4c8d-b3c0-556eff9343cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:46.833957 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a96326-aeb1-4c8d-b3c0-556eff9343cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:46.835411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a96326-aeb1-4c8d-b3c0-556eff9343cc service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:46.846615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1263/2552] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:47.670850 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb5ea-7d42-4ea4-9b5b-f71b832392a9 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:47.671726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb5ea-7d42-4ea4-9b5b-f71b832392a9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:47.671726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fb5ea-7d42-4ea4-9b5b-f71b832392a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:47.691605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-650fb5ea-7d42-4ea4-9b5b-f71b832392a9 None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:47.693553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-650fb5ea-7d42-4ea4-9b5b-f71b832392a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:47.703659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:47.767845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1290/2553] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 18:03:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:47.797800 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a96326-aeb1-4c8d-b3c0-556eff9343cc service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:47.800304 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-07a96326-aeb1-4c8d-b3c0-556eff9343cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:47.908967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a96326-aeb1-4c8d-b3c0-556eff9343cc service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:47.916233 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e6794-825a-462a-ad3a-ffb90b0c0607 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:47.922488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e6794-825a-462a-ad3a-ffb90b0c0607 service swift] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:47.922488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e6794-825a-462a-ad3a-ffb90b0c0607 service swift] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:47.922488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e6794-825a-462a-ad3a-ffb90b0c0607 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:47.932569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e6794-825a-462a-ad3a-ffb90b0c0607 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:47.934283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e6794-825a-462a-ad3a-ffb90b0c0607 service swift] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:47.945270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1264/2554] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:03:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 18:03:49.675520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d879cf-7122-4afa-bb1e-93d07d12969f None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:49.678293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d879cf-7122-4afa-bb1e-93d07d12969f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:49.678938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d879cf-7122-4afa-bb1e-93d07d12969f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:49.744253 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-08d879cf-7122-4afa-bb1e-93d07d12969f None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:49.747281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-08d879cf-7122-4afa-bb1e-93d07d12969f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:49.812089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1291/2555] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Jul 20 18:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:49.871270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e6794-825a-462a-ad3a-ffb90b0c0607 service swift] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:49.873728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a69e6794-825a-462a-ad3a-ffb90b0c0607 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:50.033470 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e6794-825a-462a-ad3a-ffb90b0c0607 service swift] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:50.047104 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08973819-3bce-4bbd-863f-6d75a6a5a833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:50.047852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08973819-3bce-4bbd-863f-6d75a6a5a833 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:50.048133 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08973819-3bce-4bbd-863f-6d75a6a5a833 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:50.048407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08973819-3bce-4bbd-863f-6d75a6a5a833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:50.066452 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08973819-3bce-4bbd-863f-6d75a6a5a833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:50.068854 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08973819-3bce-4bbd-863f-6d75a6a5a833 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:50.086948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1265/2556] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:50.418377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0566c8-2ea8-43ac-b9c9-41cb3e56ab6f None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:50.418642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0566c8-2ea8-43ac-b9c9-41cb3e56ab6f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:50.418948 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0566c8-2ea8-43ac-b9c9-41cb3e56ab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:50.459402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ef0566c8-2ea8-43ac-b9c9-41cb3e56ab6f None None] MFA Rules not processed for user `220ca2f6b3d04913be26ee94d20c635b`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:50.460774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ef0566c8-2ea8-43ac-b9c9-41cb3e56ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:50.584832 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1292/2557] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:03:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:50.585917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08973819-3bce-4bbd-863f-6d75a6a5a833 service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:50.606079 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08973819-3bce-4bbd-863f-6d75a6a5a833 service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:50.617336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5417b-de10-429a-aa65-00fff12cced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:50.618260 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5417b-de10-429a-aa65-00fff12cced4 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:50.618618 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5417b-de10-429a-aa65-00fff12cced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:50.619065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5417b-de10-429a-aa65-00fff12cced4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:50.620068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5417b-de10-429a-aa65-00fff12cced4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:50.622635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5417b-de10-429a-aa65-00fff12cced4 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:50.769485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0566c8-2ea8-43ac-b9c9-41cb3e56ab6f None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:50.789618 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1266/2558] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:03:50 2022] POST /identity/v3/projects => generated 403 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:03:50.799646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0566c8-2ea8-43ac-b9c9-41cb3e56ab6f None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:50.894944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e6f7c-a3de-420a-832b-fa6c54002dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:50.896601 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e6f7c-a3de-420a-832b-fa6c54002dda admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:50.897158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e6f7c-a3de-420a-832b-fa6c54002dda admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:50.897606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e6f7c-a3de-420a-832b-fa6c54002dda admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:50.898739 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e6f7c-a3de-420a-832b-fa6c54002dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:50.901981 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e6f7c-a3de-420a-832b-fa6c54002dda admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:51.084848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1293/2559] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:03:50 2022] POST /identity/v3/users => generated 308 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:03:51.089964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5417b-de10-429a-aa65-00fff12cced4 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:51.101576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5417b-de10-429a-aa65-00fff12cced4 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:51.106678 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018b741-4621-44f6-9133-6e47517ba9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:51.120565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018b741-4621-44f6-9133-6e47517ba9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:51.120565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018b741-4621-44f6-9133-6e47517ba9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:51.120565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018b741-4621-44f6-9133-6e47517ba9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:51.120565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018b741-4621-44f6-9133-6e47517ba9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:51.120565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018b741-4621-44f6-9133-6e47517ba9f8 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:51.124227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1267/2560] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:03:51.128785 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e6f7c-a3de-420a-832b-fa6c54002dda admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:51.140567 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e6f7c-a3de-420a-832b-fa6c54002dda admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:51.146324 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d938e-a9d6-4bc7-90ed-3c79be9d4100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:51.147273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d938e-a9d6-4bc7-90ed-3c79be9d4100 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:51.147550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d938e-a9d6-4bc7-90ed-3c79be9d4100 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:51.147851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d938e-a9d6-4bc7-90ed-3c79be9d4100 admin admin] PATH_INFO: `/v3/projects/a759524ddfb64664b193e34399d5c5d8/users/8d07d4c2eac9438c9c90d5323738c226/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:51.168285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d938e-a9d6-4bc7-90ed-3c79be9d4100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a759524ddfb64664b193e34399d5c5d8, user_id=8d07d4c2eac9438c9c90d5323738c226, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:51.172745 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d938e-a9d6-4bc7-90ed-3c79be9d4100 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:51.449081 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1294/2561] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:03:51 2022] PUT /identity/v3/projects/a759524ddfb64664b193e34399d5c5d8/users/8d07d4c2eac9438c9c90d5323738c226/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:03:51.459649 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018b741-4621-44f6-9133-6e47517ba9f8 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:51.471491 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018b741-4621-44f6-9133-6e47517ba9f8 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:51.512659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:51.553599 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886415a-afbe-4893-b79a-ae0425368c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:51.554336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886415a-afbe-4893-b79a-ae0425368c06 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:51.554618 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886415a-afbe-4893-b79a-ae0425368c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:51.554920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886415a-afbe-4893-b79a-ae0425368c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:51.555899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886415a-afbe-4893-b79a-ae0425368c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:51.557540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886415a-afbe-4893-b79a-ae0425368c06 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:51.569492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1268/2562] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:03:51.574117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d938e-a9d6-4bc7-90ed-3c79be9d4100 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:51.591264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d938e-a9d6-4bc7-90ed-3c79be9d4100 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:51.597283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77afa3e-bca5-4482-b793-04720394f767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:51.598355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77afa3e-bca5-4482-b793-04720394f767 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:51.599326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77afa3e-bca5-4482-b793-04720394f767 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:51.599683 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77afa3e-bca5-4482-b793-04720394f767 admin admin] PATH_INFO: `/v3/projects/a759524ddfb64664b193e34399d5c5d8/users/8d07d4c2eac9438c9c90d5323738c226/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:51.601810 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77afa3e-bca5-4482-b793-04720394f767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a759524ddfb64664b193e34399d5c5d8, user_id=8d07d4c2eac9438c9c90d5323738c226, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:51.604794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77afa3e-bca5-4482-b793-04720394f767 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:51.608058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:51.623019 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1295/2563] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:03:51 2022] PUT /identity/v3/projects/a759524ddfb64664b193e34399d5c5d8/users/8d07d4c2eac9438c9c90d5323738c226/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:03:51.908191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886415a-afbe-4893-b79a-ae0425368c06 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:52.038753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886415a-afbe-4893-b79a-ae0425368c06 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:52.133062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989d52a-8e38-46c5-b070-d4adef026410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:52.134959 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989d52a-8e38-46c5-b070-d4adef026410 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:52.135646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989d52a-8e38-46c5-b070-d4adef026410 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:52.136222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989d52a-8e38-46c5-b070-d4adef026410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:52.141255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f989d52a-8e38-46c5-b070-d4adef026410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:52.253178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989d52a-8e38-46c5-b070-d4adef026410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:52.255185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989d52a-8e38-46c5-b070-d4adef026410 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:52.272828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1269/2564] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:53.788301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a323cb4-c583-41e2-a111-d84506f14cc7 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:53.788896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a323cb4-c583-41e2-a111-d84506f14cc7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:53.788896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a323cb4-c583-41e2-a111-d84506f14cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:53.831517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-1a323cb4-c583-41e2-a111-d84506f14cc7 None None] MFA Rules not processed for user `8d07d4c2eac9438c9c90d5323738c226`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:53.835642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-1a323cb4-c583-41e2-a111-d84506f14cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:53.939790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1296/2565] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:03:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:55.737846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989d52a-8e38-46c5-b070-d4adef026410 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:55.738397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f989d52a-8e38-46c5-b070-d4adef026410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:55.788594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:55.847684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989d52a-8e38-46c5-b070-d4adef026410 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:55.856794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648c55c-18f4-467b-a4bd-19b1cea97dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:55.858653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c55c-18f4-467b-a4bd-19b1cea97dcd service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:55.859058 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c55c-18f4-467b-a4bd-19b1cea97dcd service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:55.859444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c55c-18f4-467b-a4bd-19b1cea97dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:55.862559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a648c55c-18f4-467b-a4bd-19b1cea97dcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:55.878409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648c55c-18f4-467b-a4bd-19b1cea97dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:55.880910 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648c55c-18f4-467b-a4bd-19b1cea97dcd service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:55.896660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1270/2566] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:56.211061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7015a2-ca9c-4301-a9fa-95736cd8988e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:56.211978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7015a2-ca9c-4301-a9fa-95736cd8988e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:56.212138 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7015a2-ca9c-4301-a9fa-95736cd8988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:56.263769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-9e7015a2-ca9c-4301-a9fa-95736cd8988e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:03:56.272924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9e7015a2-ca9c-4301-a9fa-95736cd8988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:56.276902 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648c55c-18f4-467b-a4bd-19b1cea97dcd service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:56.466947 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648c55c-18f4-467b-a4bd-19b1cea97dcd service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:56.486749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:56.487730 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1297/2567] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Jul 20 18:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:03:56.489145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:56.489850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:56.490386 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] PATH_INFO: `/v3/users/220ca2f6b3d04913be26ee94d20c635b` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:56.495549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=220ca2f6b3d04913be26ee94d20c635b)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:56.498126 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:56.521457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7015a2-ca9c-4301-a9fa-95736cd8988e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:56.541133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7015a2-ca9c-4301-a9fa-95736cd8988e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:56.549635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87f55e-b8e5-4ccd-80ac-547698c1d2e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:56.550969 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87f55e-b8e5-4ccd-80ac-547698c1d2e7 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:56.551520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87f55e-b8e5-4ccd-80ac-547698c1d2e7 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:56.552462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87f55e-b8e5-4ccd-80ac-547698c1d2e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:56.572325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87f55e-b8e5-4ccd-80ac-547698c1d2e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:56.574856 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87f55e-b8e5-4ccd-80ac-547698c1d2e7 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:56.609743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1298/2568] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:03:56.842338 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '220ca2f6b3d04913be26ee94d20c635b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:56.873909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '220ca2f6b3d04913be26ee94d20c635b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:56.905032 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '220ca2f6b3d04913be26ee94d20c635b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:57.015896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '220ca2f6b3d04913be26ee94d20c635b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:57.018426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '220ca2f6b3d04913be26ee94d20c635b'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:57.039227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1271/2569] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:03:56 2022] DELETE /identity/v3/users/220ca2f6b3d04913be26ee94d20c635b => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:03:57.474153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87f55e-b8e5-4ccd-80ac-547698c1d2e7 service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:57.495494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87f55e-b8e5-4ccd-80ac-547698c1d2e7 service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:57.608171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:57.609346 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:57.609949 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:57.610661 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] PATH_INFO: `/v3/projects/a20df3cccd1f4c5a8187a661da2fe207` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:57.626912 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20df3cccd1f4c5a8187a661da2fe207)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:57.631845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:57.646340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:57.977293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20df3cccd1f4c5a8187a661da2fe207', 'request_id': 'req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:57.993273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20df3cccd1f4c5a8187a661da2fe207', 'request_id': 'req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:58.001732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20df3cccd1f4c5a8187a661da2fe207', 'request_id': 'req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:58.175985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] The token cache is being invalidate because project a20df3cccd1f4c5a8187a661da2fe207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:03:58.178267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:58.178774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:58.185935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1299/2570] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:03:57 2022] DELETE /identity/v3/projects/a20df3cccd1f4c5a8187a661da2fe207 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:03:58.195033 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:58.208711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:58.248656 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4241ee-eb50-45af-8e39-6ddf5d3ab8f3 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:58.340114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:03:58.403034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0ac36-9b18-408a-b56a-fa1e3fb95ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:58.404196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0ac36-9b18-408a-b56a-fa1e3fb95ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:58.404622 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0ac36-9b18-408a-b56a-fa1e3fb95ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:58.405463 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0ac36-9b18-408a-b56a-fa1e3fb95ebd admin admin] PATH_INFO: `/v3/users/8d07d4c2eac9438c9c90d5323738c226` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:58.407551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0ac36-9b18-408a-b56a-fa1e3fb95ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d07d4c2eac9438c9c90d5323738c226)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:58.409391 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0ac36-9b18-408a-b56a-fa1e3fb95ebd admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:03:58.797738 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-53a0ac36-9b18-408a-b56a-fa1e3fb95ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d07d4c2eac9438c9c90d5323738c226'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:58.838281 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-53a0ac36-9b18-408a-b56a-fa1e3fb95ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d07d4c2eac9438c9c90d5323738c226'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:58.849354 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-53a0ac36-9b18-408a-b56a-fa1e3fb95ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d07d4c2eac9438c9c90d5323738c226'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:59.029354 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-53a0ac36-9b18-408a-b56a-fa1e3fb95ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d07d4c2eac9438c9c90d5323738c226'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:59.030498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-53a0ac36-9b18-408a-b56a-fa1e3fb95ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d07d4c2eac9438c9c90d5323738c226'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:03:59.039488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1272/2571] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:03:58 2022] DELETE /identity/v3/users/8d07d4c2eac9438c9c90d5323738c226 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:03:59.531774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:03:59.534460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:03:59.572989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f4135-4ff9-42b9-9dbf-1e725ca508f7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:03:59.706894 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73561bf7-f1fb-4735-a2ba-80abe083ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:03:59.708071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73561bf7-f1fb-4735-a2ba-80abe083ff2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:03:59.708790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73561bf7-f1fb-4735-a2ba-80abe083ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:03:59.709773 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73561bf7-f1fb-4735-a2ba-80abe083ff2d admin admin] PATH_INFO: `/v3/projects/a759524ddfb64664b193e34399d5c5d8` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:03:59.711142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73561bf7-f1fb-4735-a2ba-80abe083ff2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a759524ddfb64664b193e34399d5c5d8)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:03:59.713245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73561bf7-f1fb-4735-a2ba-80abe083ff2d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:00.286684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-73561bf7-f1fb-4735-a2ba-80abe083ff2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a759524ddfb64664b193e34399d5c5d8', 'request_id': 'req-73561bf7-f1fb-4735-a2ba-80abe083ff2d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:00.293934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-73561bf7-f1fb-4735-a2ba-80abe083ff2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a759524ddfb64664b193e34399d5c5d8', 'request_id': 'req-73561bf7-f1fb-4735-a2ba-80abe083ff2d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:00.301030 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-73561bf7-f1fb-4735-a2ba-80abe083ff2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a759524ddfb64664b193e34399d5c5d8', 'request_id': 'req-73561bf7-f1fb-4735-a2ba-80abe083ff2d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:00.498151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-73561bf7-f1fb-4735-a2ba-80abe083ff2d admin admin] The token cache is being invalidate because project a759524ddfb64664b193e34399d5c5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:04:00.512711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-73561bf7-f1fb-4735-a2ba-80abe083ff2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:00.512711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-73561bf7-f1fb-4735-a2ba-80abe083ff2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:00.512711 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1300/2572] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:03:59 2022] DELETE /identity/v3/projects/a759524ddfb64664b193e34399d5c5d8 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:04:00.513069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8523b3-af02-470c-9e62-0862932d1b94 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:00.513069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8523b3-af02-470c-9e62-0862932d1b94 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:00.513069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8523b3-af02-470c-9e62-0862932d1b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:00.528985 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-2b8523b3-af02-470c-9e62-0862932d1b94 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:00.530235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2b8523b3-af02-470c-9e62-0862932d1b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:00.609958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1273/2573] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:00.620071 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55983216-2242-4d6d-b21c-22856753b117 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:00.620706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55983216-2242-4d6d-b21c-22856753b117 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:00.620706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55983216-2242-4d6d-b21c-22856753b117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:00.641138 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-55983216-2242-4d6d-b21c-22856753b117 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:00.642590 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-55983216-2242-4d6d-b21c-22856753b117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:00.655125 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1301/2574] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:00.659976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8523b3-af02-470c-9e62-0862932d1b94 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:00.672003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8523b3-af02-470c-9e62-0862932d1b94 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:00.677853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c920ab7-8e8d-4c35-895c-695124daee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:00.678604 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c920ab7-8e8d-4c35-895c-695124daee51 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:00.678913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c920ab7-8e8d-4c35-895c-695124daee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:00.707485 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c920ab7-8e8d-4c35-895c-695124daee51 admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:00.707485 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c920ab7-8e8d-4c35-895c-695124daee51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:04:00.707485 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c920ab7-8e8d-4c35-895c-695124daee51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:00.707485 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c920ab7-8e8d-4c35-895c-695124daee51 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:00.707485 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1274/2575] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:04:00.712684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55983216-2242-4d6d-b21c-22856753b117 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:00.724534 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55983216-2242-4d6d-b21c-22856753b117 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:00.729678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8574d5c-095a-417f-b153-5156e50946c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:00.730503 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8574d5c-095a-417f-b153-5156e50946c1 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:00.730788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8574d5c-095a-417f-b153-5156e50946c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:00.731069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8574d5c-095a-417f-b153-5156e50946c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:00.731820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8574d5c-095a-417f-b153-5156e50946c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:00.733983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8574d5c-095a-417f-b153-5156e50946c1 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:00.895951 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:00.909454 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1302/2576] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:04:00 2022] POST /identity/v3/projects => generated 399 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:04:00.910769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c920ab7-8e8d-4c35-895c-695124daee51 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:00.930328 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c920ab7-8e8d-4c35-895c-695124daee51 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:01.012125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b850b6-1eaf-4b4c-b08b-540e05b8b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:01.012793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b850b6-1eaf-4b4c-b08b-540e05b8b9eb admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:01.013075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b850b6-1eaf-4b4c-b08b-540e05b8b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:01.013411 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b850b6-1eaf-4b4c-b08b-540e05b8b9eb admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:01.014081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b850b6-1eaf-4b4c-b08b-540e05b8b9eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:01.016100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b850b6-1eaf-4b4c-b08b-540e05b8b9eb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:01.218779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1275/2577] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:04:00 2022] POST /identity/v3/users => generated 300 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:04:01.221797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8574d5c-095a-417f-b153-5156e50946c1 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:01.235167 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8574d5c-095a-417f-b153-5156e50946c1 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:01.242436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba89ab-f464-48e3-91b4-1290384ff5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:01.243542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba89ab-f464-48e3-91b4-1290384ff5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:01.243826 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba89ab-f464-48e3-91b4-1290384ff5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:01.247549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba89ab-f464-48e3-91b4-1290384ff5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:01.247549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba89ab-f464-48e3-91b4-1290384ff5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:01.247549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba89ab-f464-48e3-91b4-1290384ff5c6 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:01.261481 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1303/2578] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:04:01.265985 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b850b6-1eaf-4b4c-b08b-540e05b8b9eb admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:01.285479 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b850b6-1eaf-4b4c-b08b-540e05b8b9eb admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:01.298571 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa35c0-c342-407e-888f-6aa535ac2b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:01.299927 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa35c0-c342-407e-888f-6aa535ac2b81 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:01.300202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa35c0-c342-407e-888f-6aa535ac2b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:01.300591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa35c0-c342-407e-888f-6aa535ac2b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:01.301608 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa35c0-c342-407e-888f-6aa535ac2b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:01.303884 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa35c0-c342-407e-888f-6aa535ac2b81 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:01.327879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1276/2579] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:04:01.333642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba89ab-f464-48e3-91b4-1290384ff5c6 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:01.398149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba89ab-f464-48e3-91b4-1290384ff5c6 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:01.425553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dc204-3f95-49a1-9231-e9b3e811365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:01.429161 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dc204-3f95-49a1-9231-e9b3e811365b admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:01.429640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dc204-3f95-49a1-9231-e9b3e811365b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:01.430157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dc204-3f95-49a1-9231-e9b3e811365b admin admin] PATH_INFO: `/v3/projects/6df6765992ea496d9a2ff9c5aba86169/users/f1c1c598eb184867afcb01da4a12c05a/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:01.484357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dc204-3f95-49a1-9231-e9b3e811365b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df6765992ea496d9a2ff9c5aba86169, user_id=f1c1c598eb184867afcb01da4a12c05a, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:01.492399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dc204-3f95-49a1-9231-e9b3e811365b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:01.493935 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:01.605505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1304/2580] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:04:01 2022] PUT /identity/v3/projects/6df6765992ea496d9a2ff9c5aba86169/users/f1c1c598eb184867afcb01da4a12c05a/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:01.622417 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9a60e-aa9d-4134-b8fa-d33cff091b4c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:01.623018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9a60e-aa9d-4134-b8fa-d33cff091b4c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:01.623018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9a60e-aa9d-4134-b8fa-d33cff091b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:01.656249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-96e9a60e-aa9d-4134-b8fa-d33cff091b4c None None] MFA Rules not processed for user `f1c1c598eb184867afcb01da4a12c05a`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:01.657627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-96e9a60e-aa9d-4134-b8fa-d33cff091b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:01.752829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1277/2581] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:01.763778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dc204-3f95-49a1-9231-e9b3e811365b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:01.878341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dc204-3f95-49a1-9231-e9b3e811365b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:01.888055 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441d631-6ca3-4f27-b378-19291242c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:01.888835 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441d631-6ca3-4f27-b378-19291242c283 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:01.889379 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441d631-6ca3-4f27-b378-19291242c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:01.889914 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441d631-6ca3-4f27-b378-19291242c283 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:01.891296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441d631-6ca3-4f27-b378-19291242c283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:01.899722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441d631-6ca3-4f27-b378-19291242c283 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:02.214776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1305/2582] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:04:01 2022] POST /identity/v3/projects => generated 399 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:04:02.230488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9a60e-aa9d-4134-b8fa-d33cff091b4c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:02.233068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9a60e-aa9d-4134-b8fa-d33cff091b4c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:02.320201 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7edf34-d7f6-46c0-b574-192ea1506081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:02.320886 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7edf34-d7f6-46c0-b574-192ea1506081 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:02.321164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7edf34-d7f6-46c0-b574-192ea1506081 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:02.322256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7edf34-d7f6-46c0-b574-192ea1506081 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:02.322256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7edf34-d7f6-46c0-b574-192ea1506081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:02.324413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7edf34-d7f6-46c0-b574-192ea1506081 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:02.524786 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1278/2583] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:04:02 2022] POST /identity/v3/users => generated 306 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:04:02.525943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441d631-6ca3-4f27-b378-19291242c283 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:02.540430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441d631-6ca3-4f27-b378-19291242c283 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:02.548714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c42c4-d861-45b5-bb74-fe99a2444f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:02.549823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c42c4-d861-45b5-bb74-fe99a2444f85 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:02.550291 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c42c4-d861-45b5-bb74-fe99a2444f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:02.550749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c42c4-d861-45b5-bb74-fe99a2444f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:02.552028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c42c4-d861-45b5-bb74-fe99a2444f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:02.555421 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c42c4-d861-45b5-bb74-fe99a2444f85 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:02.571615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1306/2584] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:02.576076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7edf34-d7f6-46c0-b574-192ea1506081 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:02.587945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7edf34-d7f6-46c0-b574-192ea1506081 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:02.593205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5727d7c-3d2c-4e76-ae25-8f84744d916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:02.594103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5727d7c-3d2c-4e76-ae25-8f84744d916e admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:02.594380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5727d7c-3d2c-4e76-ae25-8f84744d916e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:02.594819 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5727d7c-3d2c-4e76-ae25-8f84744d916e admin admin] PATH_INFO: `/v3/projects/1316c90139694dbb892bda73a937bc6f/users/38364d2acf99474fb7b8b87de2178712/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:02.615556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5727d7c-3d2c-4e76-ae25-8f84744d916e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1316c90139694dbb892bda73a937bc6f, user_id=38364d2acf99474fb7b8b87de2178712, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:02.618476 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5727d7c-3d2c-4e76-ae25-8f84744d916e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:02.752347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1279/2585] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:04:02 2022] PUT /identity/v3/projects/1316c90139694dbb892bda73a937bc6f/users/38364d2acf99474fb7b8b87de2178712/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:02.757340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c42c4-d861-45b5-bb74-fe99a2444f85 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:02.770685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c42c4-d861-45b5-bb74-fe99a2444f85 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:02.872187 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a12cb5-b0f9-4bc3-8603-3ac1775116c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:02.873409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a12cb5-b0f9-4bc3-8603-3ac1775116c1 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:02.874172 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a12cb5-b0f9-4bc3-8603-3ac1775116c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:02.874732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a12cb5-b0f9-4bc3-8603-3ac1775116c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:02.875748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a12cb5-b0f9-4bc3-8603-3ac1775116c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:02.878031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a12cb5-b0f9-4bc3-8603-3ac1775116c1 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:02.892147 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1307/2586] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:02.899183 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5727d7c-3d2c-4e76-ae25-8f84744d916e admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:02.938041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5727d7c-3d2c-4e76-ae25-8f84744d916e admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:02.953634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047640d-e883-4ec5-b620-f7af1a9c7de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:02.955820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047640d-e883-4ec5-b620-f7af1a9c7de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:02.955820 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047640d-e883-4ec5-b620-f7af1a9c7de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:02.956198 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047640d-e883-4ec5-b620-f7af1a9c7de1 admin admin] PATH_INFO: `/v3/projects/1316c90139694dbb892bda73a937bc6f/users/38364d2acf99474fb7b8b87de2178712/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:02.964044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047640d-e883-4ec5-b620-f7af1a9c7de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1316c90139694dbb892bda73a937bc6f, user_id=38364d2acf99474fb7b8b87de2178712, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:02.971590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047640d-e883-4ec5-b620-f7af1a9c7de1 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:03.021090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1280/2587] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:04:02 2022] PUT /identity/v3/projects/1316c90139694dbb892bda73a937bc6f/users/38364d2acf99474fb7b8b87de2178712/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:03.034438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae4e7-cd13-447f-9c70-cd6b847880a6 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:03.034438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae4e7-cd13-447f-9c70-cd6b847880a6 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:03.034438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae4e7-cd13-447f-9c70-cd6b847880a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:03.115093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-070ae4e7-cd13-447f-9c70-cd6b847880a6 None None] MFA Rules not processed for user `38364d2acf99474fb7b8b87de2178712`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:03.122391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-070ae4e7-cd13-447f-9c70-cd6b847880a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:03.260155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1308/2588] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:03.278890 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047640d-e883-4ec5-b620-f7af1a9c7de1 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:03.282097 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6047640d-e883-4ec5-b620-f7af1a9c7de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:03.380885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047640d-e883-4ec5-b620-f7af1a9c7de1 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:03.386737 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebcd05-baec-4cad-958a-91c18342c307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:03.389345 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebcd05-baec-4cad-958a-91c18342c307 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:03.390112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebcd05-baec-4cad-958a-91c18342c307 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:03.390939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebcd05-baec-4cad-958a-91c18342c307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:03.413494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebcd05-baec-4cad-958a-91c18342c307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:03.418791 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebcd05-baec-4cad-958a-91c18342c307 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:03.445606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1281/2589] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:04:03.687226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:04.675024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ae4e7-cd13-447f-9c70-cd6b847880a6 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:04.685843 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ae4e7-cd13-447f-9c70-cd6b847880a6 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:04.689635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cae4be-487e-480f-a5b8-ef2a25ebacbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:04.690298 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cae4be-487e-480f-a5b8-ef2a25ebacbf service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:04.690580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cae4be-487e-480f-a5b8-ef2a25ebacbf service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:04.690908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cae4be-487e-480f-a5b8-ef2a25ebacbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:04.780688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cae4be-487e-480f-a5b8-ef2a25ebacbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:04.782148 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cae4be-487e-480f-a5b8-ef2a25ebacbf service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:04.793137 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1309/2590] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:04:05.430924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:11.634875 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebcd05-baec-4cad-958a-91c18342c307 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:11.744517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebcd05-baec-4cad-958a-91c18342c307 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:11.750389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:11.751508 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:11.756236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:11.756236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] PATH_INFO: `/v3/users/f1c1c598eb184867afcb01da4a12c05a` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:11.756236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c1c598eb184867afcb01da4a12c05a)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:11.756879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:12.103209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c1c598eb184867afcb01da4a12c05a'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:12.119052 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c1c598eb184867afcb01da4a12c05a'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:12.127490 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c1c598eb184867afcb01da4a12c05a'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:12.264874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c1c598eb184867afcb01da4a12c05a'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:12.269465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c1c598eb184867afcb01da4a12c05a'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:12.273809 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1282/2591] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:04:11 2022] DELETE /identity/v3/users/f1c1c598eb184867afcb01da4a12c05a => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:12.279981 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036865d-eea9-4767-be30-24eee5312715 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:12.280881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036865d-eea9-4767-be30-24eee5312715 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:12.280881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036865d-eea9-4767-be30-24eee5312715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:12.302045 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-6036865d-eea9-4767-be30-24eee5312715 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:12.303542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6036865d-eea9-4767-be30-24eee5312715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:12.375551 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1310/2592] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:04:12.385970 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:12.387482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:12.430340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:12.469759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badf24a-7370-451f-870b-32b359960d50 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:12.478920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038885b0-aeaa-4a8a-b14e-602bf7e44a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:12.479598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038885b0-aeaa-4a8a-b14e-602bf7e44a7a service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:12.479879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038885b0-aeaa-4a8a-b14e-602bf7e44a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:12.480150 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038885b0-aeaa-4a8a-b14e-602bf7e44a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:12.492065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038885b0-aeaa-4a8a-b14e-602bf7e44a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:12.493595 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038885b0-aeaa-4a8a-b14e-602bf7e44a7a service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:12.505812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1283/2593] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:04:13.013154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036865d-eea9-4767-be30-24eee5312715 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:13.014772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6036865d-eea9-4767-be30-24eee5312715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:13.032670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036865d-eea9-4767-be30-24eee5312715 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:13.040397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:13.041255 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:13.041529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:13.041870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] PATH_INFO: `/v3/projects/6df6765992ea496d9a2ff9c5aba86169` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:13.043015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df6765992ea496d9a2ff9c5aba86169)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:13.045244 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:13.237799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df6765992ea496d9a2ff9c5aba86169', 'request_id': 'req-f932afe5-c661-44b3-9348-7633e32214fc'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:13.241110 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:13.245767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df6765992ea496d9a2ff9c5aba86169', 'request_id': 'req-f932afe5-c661-44b3-9348-7633e32214fc'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:13.252084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df6765992ea496d9a2ff9c5aba86169', 'request_id': 'req-f932afe5-c661-44b3-9348-7633e32214fc'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:13.426056 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] The token cache is being invalidate because project 6df6765992ea496d9a2ff9c5aba86169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:04:13.429370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:13.429370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:13.429370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1311/2594] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:04:13 2022] DELETE /identity/v3/projects/6df6765992ea496d9a2ff9c5aba86169 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:13.433559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038885b0-aeaa-4a8a-b14e-602bf7e44a7a service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:13.444457 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038885b0-aeaa-4a8a-b14e-602bf7e44a7a service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:13.512968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fa2df-02eb-4b07-af11-e008caabb413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:13.513845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fa2df-02eb-4b07-af11-e008caabb413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:13.514122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fa2df-02eb-4b07-af11-e008caabb413 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:13.514396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fa2df-02eb-4b07-af11-e008caabb413 admin admin] PATH_INFO: `/v3/users/38364d2acf99474fb7b8b87de2178712` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:13.515614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fa2df-02eb-4b07-af11-e008caabb413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38364d2acf99474fb7b8b87de2178712)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:13.517614 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fa2df-02eb-4b07-af11-e008caabb413 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:13.877889 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-ea7fa2df-02eb-4b07-af11-e008caabb413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38364d2acf99474fb7b8b87de2178712'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:13.890456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-ea7fa2df-02eb-4b07-af11-e008caabb413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38364d2acf99474fb7b8b87de2178712'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:13.897757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-ea7fa2df-02eb-4b07-af11-e008caabb413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38364d2acf99474fb7b8b87de2178712'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:14.014051 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-ea7fa2df-02eb-4b07-af11-e008caabb413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38364d2acf99474fb7b8b87de2178712'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:14.014995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-ea7fa2df-02eb-4b07-af11-e008caabb413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38364d2acf99474fb7b8b87de2178712'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:14.026271 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1284/2595] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:04:13 2022] DELETE /identity/v3/users/38364d2acf99474fb7b8b87de2178712 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:14.642890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:14.642890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:14.656084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932afe5-c661-44b3-9348-7633e32214fc admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:14.732389 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6440d7-bbb6-497e-be72-bd55879d7296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:14.733320 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6440d7-bbb6-497e-be72-bd55879d7296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:14.733599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6440d7-bbb6-497e-be72-bd55879d7296 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:14.733874 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6440d7-bbb6-497e-be72-bd55879d7296 admin admin] PATH_INFO: `/v3/projects/1316c90139694dbb892bda73a937bc6f` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:14.735047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6440d7-bbb6-497e-be72-bd55879d7296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1316c90139694dbb892bda73a937bc6f)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:14.737101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6440d7-bbb6-497e-be72-bd55879d7296 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:14.903769 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb6440d7-bbb6-497e-be72-bd55879d7296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1316c90139694dbb892bda73a937bc6f', 'request_id': 'req-bb6440d7-bbb6-497e-be72-bd55879d7296'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:14.909862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb6440d7-bbb6-497e-be72-bd55879d7296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1316c90139694dbb892bda73a937bc6f', 'request_id': 'req-bb6440d7-bbb6-497e-be72-bd55879d7296'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:14.915728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb6440d7-bbb6-497e-be72-bd55879d7296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1316c90139694dbb892bda73a937bc6f', 'request_id': 'req-bb6440d7-bbb6-497e-be72-bd55879d7296'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:15.158914 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb6440d7-bbb6-497e-be72-bd55879d7296 admin admin] The token cache is being invalidate because project 1316c90139694dbb892bda73a937bc6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:04:15.159191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb6440d7-bbb6-497e-be72-bd55879d7296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:15.159860 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-bb6440d7-bbb6-497e-be72-bd55879d7296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:15.161479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1312/2596] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:04:14 2022] DELETE /identity/v3/projects/1316c90139694dbb892bda73a937bc6f => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:15.167231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3572c-6f9d-4019-b61e-24774ccf9819 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:15.167780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3572c-6f9d-4019-b61e-24774ccf9819 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:15.168024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3572c-6f9d-4019-b61e-24774ccf9819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:15.188825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-a4e3572c-6f9d-4019-b61e-24774ccf9819 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:15.190100 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a4e3572c-6f9d-4019-b61e-24774ccf9819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:15.236251 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:15.251897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1285/2597] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:15.260386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e79a-50b3-4a2d-b8c9-bb064a45054a None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:15.264884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e79a-50b3-4a2d-b8c9-bb064a45054a None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:15.264884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e79a-50b3-4a2d-b8c9-bb064a45054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:15.280803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-f8e9e79a-50b3-4a2d-b8c9-bb064a45054a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:15.282023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f8e9e79a-50b3-4a2d-b8c9-bb064a45054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:15.290642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1313/2598] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:15.295356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3572c-6f9d-4019-b61e-24774ccf9819 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:15.306183 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3572c-6f9d-4019-b61e-24774ccf9819 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:15.311173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124eb60-f106-41af-8537-6b03bcd593bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:15.311853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124eb60-f106-41af-8537-6b03bcd593bb admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:15.312125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124eb60-f106-41af-8537-6b03bcd593bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:15.312423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124eb60-f106-41af-8537-6b03bcd593bb admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:15.313181 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124eb60-f106-41af-8537-6b03bcd593bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:04:15.313494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124eb60-f106-41af-8537-6b03bcd593bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:15.315111 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124eb60-f106-41af-8537-6b03bcd593bb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:15.328122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1286/2599] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:04:15.332718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9e79a-50b3-4a2d-b8c9-bb064a45054a None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:15.344102 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9e79a-50b3-4a2d-b8c9-bb064a45054a None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:15.350589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0828a3b-e253-4bb9-89f6-7a1549a987d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:15.351266 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0828a3b-e253-4bb9-89f6-7a1549a987d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:15.351550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0828a3b-e253-4bb9-89f6-7a1549a987d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:15.351820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0828a3b-e253-4bb9-89f6-7a1549a987d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:15.352592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0828a3b-e253-4bb9-89f6-7a1549a987d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:15.354508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0828a3b-e253-4bb9-89f6-7a1549a987d9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:15.530338 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1314/2600] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:04:15 2022] POST /identity/v3/projects => generated 407 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:04:15.534981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124eb60-f106-41af-8537-6b03bcd593bb admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:15.545981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124eb60-f106-41af-8537-6b03bcd593bb admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:15.612805 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47d43-b832-49bc-a43a-01217274e1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:15.615784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47d43-b832-49bc-a43a-01217274e1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:15.615784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47d43-b832-49bc-a43a-01217274e1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:15.615784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47d43-b832-49bc-a43a-01217274e1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:15.616990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd47d43-b832-49bc-a43a-01217274e1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:15.619319 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd47d43-b832-49bc-a43a-01217274e1e8 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:15.731999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1287/2601] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:04:15 2022] POST /identity/v3/users => generated 304 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:04:15.737123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0828a3b-e253-4bb9-89f6-7a1549a987d9 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:15.748245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0828a3b-e253-4bb9-89f6-7a1549a987d9 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:15.753478 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e5012-df41-4c7f-97ac-40970f5ebaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:15.754278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5012-df41-4c7f-97ac-40970f5ebaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:15.754618 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5012-df41-4c7f-97ac-40970f5ebaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:15.754993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e5012-df41-4c7f-97ac-40970f5ebaf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:15.755846 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e5012-df41-4c7f-97ac-40970f5ebaf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:15.757629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e5012-df41-4c7f-97ac-40970f5ebaf7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:15.770437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1315/2602] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:15.776986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47d43-b832-49bc-a43a-01217274e1e8 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:15.795241 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47d43-b832-49bc-a43a-01217274e1e8 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:15.801215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708070a-3338-4917-bfd2-0270bd95d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:15.801915 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708070a-3338-4917-bfd2-0270bd95d708 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:15.802331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708070a-3338-4917-bfd2-0270bd95d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:15.802611 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708070a-3338-4917-bfd2-0270bd95d708 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:15.803344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708070a-3338-4917-bfd2-0270bd95d708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:15.805033 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708070a-3338-4917-bfd2-0270bd95d708 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:15.815881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1288/2603] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:15.831666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e5012-df41-4c7f-97ac-40970f5ebaf7 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:15.842524 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e5012-df41-4c7f-97ac-40970f5ebaf7 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:15.847223 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d27033-0941-4f1d-b044-886b90221987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:15.848112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27033-0941-4f1d-b044-886b90221987 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:15.848390 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27033-0941-4f1d-b044-886b90221987 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:15.848720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27033-0941-4f1d-b044-886b90221987 admin admin] PATH_INFO: `/v3/projects/37455cb2459d44e2951fe0b65aaeb984/users/a3b7f37caa0e41b49127f1bc59400385/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:15.865781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d27033-0941-4f1d-b044-886b90221987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37455cb2459d44e2951fe0b65aaeb984, user_id=a3b7f37caa0e41b49127f1bc59400385, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:15.868430 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d27033-0941-4f1d-b044-886b90221987 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:16.031444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1316/2604] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:04:15 2022] PUT /identity/v3/projects/37455cb2459d44e2951fe0b65aaeb984/users/a3b7f37caa0e41b49127f1bc59400385/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:16.042776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17cf1b-09a7-4a7d-b94a-33e7a42039a0 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:16.043066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17cf1b-09a7-4a7d-b94a-33e7a42039a0 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:16.043347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17cf1b-09a7-4a7d-b94a-33e7a42039a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:16.072729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-cb17cf1b-09a7-4a7d-b94a-33e7a42039a0 None None] MFA Rules not processed for user `a3b7f37caa0e41b49127f1bc59400385`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:16.073970 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-cb17cf1b-09a7-4a7d-b94a-33e7a42039a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:16.148246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1289/2605] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:16.154343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d27033-0941-4f1d-b044-886b90221987 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:16.165213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:16.221972 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d27033-0941-4f1d-b044-886b90221987 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:16.227527 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c7c92-ac82-4438-8ae1-b6ff5fe4f7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:16.228245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c7c92-ac82-4438-8ae1-b6ff5fe4f7ea admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:16.228550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c7c92-ac82-4438-8ae1-b6ff5fe4f7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:16.228827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c7c92-ac82-4438-8ae1-b6ff5fe4f7ea admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:16.229519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c7c92-ac82-4438-8ae1-b6ff5fe4f7ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:16.231411 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c7c92-ac82-4438-8ae1-b6ff5fe4f7ea admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:16.422703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1317/2606] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:04:16 2022] POST /identity/v3/projects => generated 407 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:04:16.427534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17cf1b-09a7-4a7d-b94a-33e7a42039a0 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:16.439019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17cf1b-09a7-4a7d-b94a-33e7a42039a0 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:16.517199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:16.543280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4244-6d1f-459a-8476-a27e01ad19e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:16.543913 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4244-6d1f-459a-8476-a27e01ad19e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:16.544285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4244-6d1f-459a-8476-a27e01ad19e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:16.544788 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4244-6d1f-459a-8476-a27e01ad19e2 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:16.545798 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a4244-6d1f-459a-8476-a27e01ad19e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:16.549544 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a4244-6d1f-459a-8476-a27e01ad19e2 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:16.831704 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1290/2607] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:04:16 2022] POST /identity/v3/users => generated 310 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:04:16.834083 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c7c92-ac82-4438-8ae1-b6ff5fe4f7ea admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:16.845016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c7c92-ac82-4438-8ae1-b6ff5fe4f7ea admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:16.850431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb4771-79e5-4a45-8b63-c14bf7694d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:16.851137 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb4771-79e5-4a45-8b63-c14bf7694d7c admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:16.851509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb4771-79e5-4a45-8b63-c14bf7694d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:16.851880 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb4771-79e5-4a45-8b63-c14bf7694d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:16.852723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb4771-79e5-4a45-8b63-c14bf7694d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:16.854509 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb4771-79e5-4a45-8b63-c14bf7694d7c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:16.866377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1318/2608] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:16.873483 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4244-6d1f-459a-8476-a27e01ad19e2 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:16.884848 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4244-6d1f-459a-8476-a27e01ad19e2 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:16.889878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909c69b-42a6-4f87-bd68-396aa4f81ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:16.890837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909c69b-42a6-4f87-bd68-396aa4f81ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:16.891117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909c69b-42a6-4f87-bd68-396aa4f81ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:16.891427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909c69b-42a6-4f87-bd68-396aa4f81ed6 admin admin] PATH_INFO: `/v3/projects/6bf44a68c5df4908a674e921bbfaac18/users/cbc56469073a49999a705ee0d92ddec7/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:16.909135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909c69b-42a6-4f87-bd68-396aa4f81ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf44a68c5df4908a674e921bbfaac18, user_id=cbc56469073a49999a705ee0d92ddec7, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:16.912565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909c69b-42a6-4f87-bd68-396aa4f81ed6 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:17.047601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1291/2609] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:04:16 2022] PUT /identity/v3/projects/6bf44a68c5df4908a674e921bbfaac18/users/cbc56469073a49999a705ee0d92ddec7/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:17.052670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb4771-79e5-4a45-8b63-c14bf7694d7c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:17.068128 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb4771-79e5-4a45-8b63-c14bf7694d7c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:17.140657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac0f3c-16c0-44cf-ac73-6480c911fa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:17.141337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0f3c-16c0-44cf-ac73-6480c911fa74 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:17.141624 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0f3c-16c0-44cf-ac73-6480c911fa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:17.141932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0f3c-16c0-44cf-ac73-6480c911fa74 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:17.142666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0f3c-16c0-44cf-ac73-6480c911fa74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:17.144405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0f3c-16c0-44cf-ac73-6480c911fa74 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:17.157862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1319/2610] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:17.163205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909c69b-42a6-4f87-bd68-396aa4f81ed6 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:17.176035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909c69b-42a6-4f87-bd68-396aa4f81ed6 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:17.181922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ce20a-f1f5-4672-ae97-a51ea46f6ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:17.182838 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ce20a-f1f5-4672-ae97-a51ea46f6ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:17.183193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ce20a-f1f5-4672-ae97-a51ea46f6ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:17.186843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ce20a-f1f5-4672-ae97-a51ea46f6ce0 admin admin] PATH_INFO: `/v3/projects/6bf44a68c5df4908a674e921bbfaac18/users/cbc56469073a49999a705ee0d92ddec7/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:17.186843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ce20a-f1f5-4672-ae97-a51ea46f6ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf44a68c5df4908a674e921bbfaac18, user_id=cbc56469073a49999a705ee0d92ddec7, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:17.188316 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ce20a-f1f5-4672-ae97-a51ea46f6ce0 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:17.200764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1292/2611] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:04:17 2022] PUT /identity/v3/projects/6bf44a68c5df4908a674e921bbfaac18/users/cbc56469073a49999a705ee0d92ddec7/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:04:17.214961 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32903f56-62a1-459c-80d1-e1e4c4948bf9 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:17.215243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32903f56-62a1-459c-80d1-e1e4c4948bf9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:17.215559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32903f56-62a1-459c-80d1-e1e4c4948bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:17.249382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-32903f56-62a1-459c-80d1-e1e4c4948bf9 None None] MFA Rules not processed for user `cbc56469073a49999a705ee0d92ddec7`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:17.250928 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-32903f56-62a1-459c-80d1-e1e4c4948bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:17.334488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1320/2612] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:17 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:17.346212 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ce20a-f1f5-4672-ae97-a51ea46f6ce0 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:17.348031 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3a9ce20a-f1f5-4672-ae97-a51ea46f6ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:17.418256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ce20a-f1f5-4672-ae97-a51ea46f6ce0 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:17.421990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d239fba-9191-448e-a82f-74b3977023c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:17.422945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d239fba-9191-448e-a82f-74b3977023c3 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:17.423288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d239fba-9191-448e-a82f-74b3977023c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:17.423504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d239fba-9191-448e-a82f-74b3977023c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:17.433354 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d239fba-9191-448e-a82f-74b3977023c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:17.434796 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d239fba-9191-448e-a82f-74b3977023c3 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:17.444916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1293/2613] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:17 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:04:17.932896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32903f56-62a1-459c-80d1-e1e4c4948bf9 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:17.937759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:17.944793 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32903f56-62a1-459c-80d1-e1e4c4948bf9 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:17.948721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e0313-d89c-463d-9890-30a6aa55dfbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:17.949549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e0313-d89c-463d-9890-30a6aa55dfbb service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:17.949885 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e0313-d89c-463d-9890-30a6aa55dfbb service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:17.950239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e0313-d89c-463d-9890-30a6aa55dfbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:18.014047 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e0313-d89c-463d-9890-30a6aa55dfbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:18.015491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e0313-d89c-463d-9890-30a6aa55dfbb service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:18.025919 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1321/2614] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:17 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:04:21.966429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02be6-a08a-45ec-8125-fa1172f67594 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:21.966966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02be6-a08a-45ec-8125-fa1172f67594 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:21.967070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02be6-a08a-45ec-8125-fa1172f67594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:21.987002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-56c02be6-a08a-45ec-8125-fa1172f67594 None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:21.988215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-56c02be6-a08a-45ec-8125-fa1172f67594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:22.048585 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1294/2615] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 18:04:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:22.061508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e0313-d89c-463d-9890-30a6aa55dfbb service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:22.069988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f56e0313-d89c-463d-9890-30a6aa55dfbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:22.140202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e0313-d89c-463d-9890-30a6aa55dfbb service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:22.145552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89a5c0-a65e-470b-9458-18869d597d38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:22.146897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89a5c0-a65e-470b-9458-18869d597d38 service swift] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:22.147198 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89a5c0-a65e-470b-9458-18869d597d38 service swift] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:22.147476 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89a5c0-a65e-470b-9458-18869d597d38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:22.156718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89a5c0-a65e-470b-9458-18869d597d38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:22.158364 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89a5c0-a65e-470b-9458-18869d597d38 service swift] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:22.167600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1322/2616] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:04:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 18:04:28.812606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c02be6-a08a-45ec-8125-fa1172f67594 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:28.902700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:28.943435 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c02be6-a08a-45ec-8125-fa1172f67594 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:28.950318 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:28.951467 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:28.951914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:28.952294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] PATH_INFO: `/v3/users/a3b7f37caa0e41b49127f1bc59400385` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:28.954098 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b7f37caa0e41b49127f1bc59400385)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:28.957301 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:29.237289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b7f37caa0e41b49127f1bc59400385'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:29.255389 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b7f37caa0e41b49127f1bc59400385'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:29.267678 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b7f37caa0e41b49127f1bc59400385'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:29.346918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b7f37caa0e41b49127f1bc59400385'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:29.348772 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b7f37caa0e41b49127f1bc59400385'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:29.370549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1295/2617] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:04:28 2022] DELETE /identity/v3/users/a3b7f37caa0e41b49127f1bc59400385 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:29.374394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b50c49-5c1f-4813-a2b9-5abd0ee53a95 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:29.374394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b50c49-5c1f-4813-a2b9-5abd0ee53a95 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:29.374394 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b50c49-5c1f-4813-a2b9-5abd0ee53a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:29.405084 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a2b50c49-5c1f-4813-a2b9-5abd0ee53a95 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:29.408592 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a2b50c49-5c1f-4813-a2b9-5abd0ee53a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:29.495184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1323/2618] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:29.508576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:29.510605 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:29.593153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cc8ca-e2ea-4c80-951d-71a2639dce0b admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:29.602439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f5ac3-24a8-4ddd-af33-6e5b39881d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:29.603334 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f5ac3-24a8-4ddd-af33-6e5b39881d95 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:29.603847 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f5ac3-24a8-4ddd-af33-6e5b39881d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:29.604263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f5ac3-24a8-4ddd-af33-6e5b39881d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:29.617872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f5ac3-24a8-4ddd-af33-6e5b39881d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:29.619442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f5ac3-24a8-4ddd-af33-6e5b39881d95 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:29.631789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1296/2619] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:04:30.266966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b50c49-5c1f-4813-a2b9-5abd0ee53a95 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:30.268169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a2b50c49-5c1f-4813-a2b9-5abd0ee53a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:30.284387 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b50c49-5c1f-4813-a2b9-5abd0ee53a95 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:30.292654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:30.294578 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:30.295278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:30.295278 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] PATH_INFO: `/v3/projects/37455cb2459d44e2951fe0b65aaeb984` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:30.296699 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37455cb2459d44e2951fe0b65aaeb984)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:30.299930 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:30.828414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:30.854105 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37455cb2459d44e2951fe0b65aaeb984', 'request_id': 'req-740c2d65-0438-40af-b19e-4e9a58cdf7e1'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:30.862655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37455cb2459d44e2951fe0b65aaeb984', 'request_id': 'req-740c2d65-0438-40af-b19e-4e9a58cdf7e1'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:30.868950 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37455cb2459d44e2951fe0b65aaeb984', 'request_id': 'req-740c2d65-0438-40af-b19e-4e9a58cdf7e1'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:30.985472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] The token cache is being invalidate because project 37455cb2459d44e2951fe0b65aaeb984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:04:30.985792 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:30.986488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:30.988087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1324/2620] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:04:30 2022] DELETE /identity/v3/projects/37455cb2459d44e2951fe0b65aaeb984 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:30.992502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f5ac3-24a8-4ddd-af33-6e5b39881d95 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:31.002342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f5ac3-24a8-4ddd-af33-6e5b39881d95 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:31.069964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad25bd1-32d8-4639-9f0f-1cf477b0a90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:31.071043 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25bd1-32d8-4639-9f0f-1cf477b0a90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:31.071458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25bd1-32d8-4639-9f0f-1cf477b0a90e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:31.071769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25bd1-32d8-4639-9f0f-1cf477b0a90e admin admin] PATH_INFO: `/v3/users/cbc56469073a49999a705ee0d92ddec7` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:31.073323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25bd1-32d8-4639-9f0f-1cf477b0a90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc56469073a49999a705ee0d92ddec7)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:31.075501 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25bd1-32d8-4639-9f0f-1cf477b0a90e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:31.082960 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:31.365468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3ad25bd1-32d8-4639-9f0f-1cf477b0a90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc56469073a49999a705ee0d92ddec7'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:31.406987 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3ad25bd1-32d8-4639-9f0f-1cf477b0a90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc56469073a49999a705ee0d92ddec7'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:31.413402 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3ad25bd1-32d8-4639-9f0f-1cf477b0a90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc56469073a49999a705ee0d92ddec7'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:32.780759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3ad25bd1-32d8-4639-9f0f-1cf477b0a90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc56469073a49999a705ee0d92ddec7'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:32.784252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-3ad25bd1-32d8-4639-9f0f-1cf477b0a90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc56469073a49999a705ee0d92ddec7'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:32.788832 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1297/2621] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:04:30 2022] DELETE /identity/v3/users/cbc56469073a49999a705ee0d92ddec7 => generated 0 bytes in 1797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:33.474353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:33.475966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:33.496471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c2d65-0438-40af-b19e-4e9a58cdf7e1 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:33.564157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e4449-bd31-4ba7-847d-1a48f716b8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:33.565050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e4449-bd31-4ba7-847d-1a48f716b8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:33.565329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e4449-bd31-4ba7-847d-1a48f716b8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:33.565602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e4449-bd31-4ba7-847d-1a48f716b8d3 admin admin] PATH_INFO: `/v3/projects/6bf44a68c5df4908a674e921bbfaac18` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:33.566826 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e4449-bd31-4ba7-847d-1a48f716b8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf44a68c5df4908a674e921bbfaac18)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:33.569383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e4449-bd31-4ba7-847d-1a48f716b8d3 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:33.725330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-282e4449-bd31-4ba7-847d-1a48f716b8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf44a68c5df4908a674e921bbfaac18', 'request_id': 'req-282e4449-bd31-4ba7-847d-1a48f716b8d3'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:33.731709 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-282e4449-bd31-4ba7-847d-1a48f716b8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf44a68c5df4908a674e921bbfaac18', 'request_id': 'req-282e4449-bd31-4ba7-847d-1a48f716b8d3'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:33.738422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-282e4449-bd31-4ba7-847d-1a48f716b8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf44a68c5df4908a674e921bbfaac18', 'request_id': 'req-282e4449-bd31-4ba7-847d-1a48f716b8d3'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:33.843296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-282e4449-bd31-4ba7-847d-1a48f716b8d3 admin admin] The token cache is being invalidate because project 6bf44a68c5df4908a674e921bbfaac18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:04:33.843582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-282e4449-bd31-4ba7-847d-1a48f716b8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:33.844223 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-282e4449-bd31-4ba7-847d-1a48f716b8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:33.846381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1325/2622] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:04:33 2022] DELETE /identity/v3/projects/6bf44a68c5df4908a674e921bbfaac18 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:33.852179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07fd51-a210-4b51-bce1-ca725c0ae50a None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:33.852725 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07fd51-a210-4b51-bce1-ca725c0ae50a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:33.852839 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07fd51-a210-4b51-bce1-ca725c0ae50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:33.873179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-ef07fd51-a210-4b51-bce1-ca725c0ae50a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:33.874555 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ef07fd51-a210-4b51-bce1-ca725c0ae50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:33.947920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1298/2623] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:33.956542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c9f7-660a-4295-9044-54f6d39ab671 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:33.956844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c9f7-660a-4295-9044-54f6d39ab671 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:33.957217 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c9f7-660a-4295-9044-54f6d39ab671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:33.978783 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-0910c9f7-660a-4295-9044-54f6d39ab671 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:33.979997 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0910c9f7-660a-4295-9044-54f6d39ab671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:33.988106 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1326/2624] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:33.993941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07fd51-a210-4b51-bce1-ca725c0ae50a None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:34.004567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07fd51-a210-4b51-bce1-ca725c0ae50a None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:34.010041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95ba08-21b3-43fd-9760-5a64688b1d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:34.010840 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95ba08-21b3-43fd-9760-5a64688b1d1a admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:34.011118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95ba08-21b3-43fd-9760-5a64688b1d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:34.011387 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95ba08-21b3-43fd-9760-5a64688b1d1a admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:34.012109 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95ba08-21b3-43fd-9760-5a64688b1d1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:04:34.012413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95ba08-21b3-43fd-9760-5a64688b1d1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:34.014033 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95ba08-21b3-43fd-9760-5a64688b1d1a admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:34.034235 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1299/2625] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:04:34.035159 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c9f7-660a-4295-9044-54f6d39ab671 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:34.046774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c9f7-660a-4295-9044-54f6d39ab671 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:34.052372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecb1c3-9917-4271-8a27-21404dbc42d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:34.053094 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecb1c3-9917-4271-8a27-21404dbc42d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:34.053399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecb1c3-9917-4271-8a27-21404dbc42d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:34.053676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecb1c3-9917-4271-8a27-21404dbc42d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:34.054452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecb1c3-9917-4271-8a27-21404dbc42d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:34.056967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecb1c3-9917-4271-8a27-21404dbc42d3 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:34.204127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1327/2626] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:04:34 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:04:34.209055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95ba08-21b3-43fd-9760-5a64688b1d1a admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:34.220807 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95ba08-21b3-43fd-9760-5a64688b1d1a admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:34.293851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d102c9-425a-403b-ab55-6b7e584e3bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:34.294537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d102c9-425a-403b-ab55-6b7e584e3bdf admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:34.294822 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d102c9-425a-403b-ab55-6b7e584e3bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:34.295099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d102c9-425a-403b-ab55-6b7e584e3bdf admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:34.295860 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d102c9-425a-403b-ab55-6b7e584e3bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:34.297818 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d102c9-425a-403b-ab55-6b7e584e3bdf admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:34.410013 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1300/2627] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:04:34 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:04:34.414373 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecb1c3-9917-4271-8a27-21404dbc42d3 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:34.437054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecb1c3-9917-4271-8a27-21404dbc42d3 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:34.437054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6aa9-8b91-4705-843e-bde73b0f442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:34.437054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6aa9-8b91-4705-843e-bde73b0f442e admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:34.437054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6aa9-8b91-4705-843e-bde73b0f442e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:34.437532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6aa9-8b91-4705-843e-bde73b0f442e admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:34.437532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da6aa9-8b91-4705-843e-bde73b0f442e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:34.437532 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da6aa9-8b91-4705-843e-bde73b0f442e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:34.447309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1328/2628] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:04:34.452123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d102c9-425a-403b-ab55-6b7e584e3bdf admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:34.459513 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:34.465941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d102c9-425a-403b-ab55-6b7e584e3bdf admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:34.470911 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa7d39-8f3b-4cb7-9cbf-7c48c2eb8951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:34.471579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa7d39-8f3b-4cb7-9cbf-7c48c2eb8951 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:34.471967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa7d39-8f3b-4cb7-9cbf-7c48c2eb8951 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:34.472254 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa7d39-8f3b-4cb7-9cbf-7c48c2eb8951 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:34.473229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa7d39-8f3b-4cb7-9cbf-7c48c2eb8951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:34.474760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa7d39-8f3b-4cb7-9cbf-7c48c2eb8951 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:34.486287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1301/2629] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:34.491531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6aa9-8b91-4705-843e-bde73b0f442e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:34.498544 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:34.502491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6aa9-8b91-4705-843e-bde73b0f442e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:34.507647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536a75-cee9-46c8-9a74-51eeaf17a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:34.508563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536a75-cee9-46c8-9a74-51eeaf17a9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:34.508857 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536a75-cee9-46c8-9a74-51eeaf17a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:34.509109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536a75-cee9-46c8-9a74-51eeaf17a9bd admin admin] PATH_INFO: `/v3/projects/91b59465a0ef4cd9ac238f42d5995e03/users/1f5545040b13431598627faccd5ba4a5/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:34.524807 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a536a75-cee9-46c8-9a74-51eeaf17a9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b59465a0ef4cd9ac238f42d5995e03, user_id=1f5545040b13431598627faccd5ba4a5, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:34.528504 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a536a75-cee9-46c8-9a74-51eeaf17a9bd admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:34.655221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1329/2630] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:04:34 2022] PUT /identity/v3/projects/91b59465a0ef4cd9ac238f42d5995e03/users/1f5545040b13431598627faccd5ba4a5/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:34.660193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1f735-98c5-4841-aa1a-db00a9b6d967 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:34.660745 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1f735-98c5-4841-aa1a-db00a9b6d967 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:34.660876 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1f735-98c5-4841-aa1a-db00a9b6d967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:34.680309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-ebd1f735-98c5-4841-aa1a-db00a9b6d967 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:34.681620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ebd1f735-98c5-4841-aa1a-db00a9b6d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:34.758453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1302/2631] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:34.767376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536a75-cee9-46c8-9a74-51eeaf17a9bd admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:34.773698 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0a536a75-cee9-46c8-9a74-51eeaf17a9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:34.850431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536a75-cee9-46c8-9a74-51eeaf17a9bd admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:34.854414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf4640-3ee1-4cb5-bfd3-9f47df70ad4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:34.855061 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf4640-3ee1-4cb5-bfd3-9f47df70ad4d service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:34.855341 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf4640-3ee1-4cb5-bfd3-9f47df70ad4d service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:34.855615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf4640-3ee1-4cb5-bfd3-9f47df70ad4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:34.865597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf4640-3ee1-4cb5-bfd3-9f47df70ad4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:34.867062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf4640-3ee1-4cb5-bfd3-9f47df70ad4d service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:34.877544 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1330/2632] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:04:36.602427 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8808-5df5-4acf-8697-e600cc02fb33 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:36.603164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8808-5df5-4acf-8697-e600cc02fb33 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:36.603164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8808-5df5-4acf-8697-e600cc02fb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:36.644696 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e66a8808-5df5-4acf-8697-e600cc02fb33 None None] MFA Rules not processed for user `1f5545040b13431598627faccd5ba4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:36.646964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e66a8808-5df5-4acf-8697-e600cc02fb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:36.742728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1303/2633] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:36.743712 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf4640-3ee1-4cb5-bfd3-9f47df70ad4d service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:36.754279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf4640-3ee1-4cb5-bfd3-9f47df70ad4d service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:36.760119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee0024-e2cd-4ecd-ab91-e87d434cd0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:36.761078 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee0024-e2cd-4ecd-ab91-e87d434cd0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:36.761359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee0024-e2cd-4ecd-ab91-e87d434cd0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:36.761629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee0024-e2cd-4ecd-ab91-e87d434cd0b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:36.762489 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee0024-e2cd-4ecd-ab91-e87d434cd0b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:36.764406 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee0024-e2cd-4ecd-ab91-e87d434cd0b1 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:36.881599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1331/2634] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:04:36 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:04:36.887634 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8808-5df5-4acf-8697-e600cc02fb33 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:36.899594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8808-5df5-4acf-8697-e600cc02fb33 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:36.959878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e781-5dbf-4b31-ba87-e5262d1cae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:36.960569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e781-5dbf-4b31-ba87-e5262d1cae83 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:36.960862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e781-5dbf-4b31-ba87-e5262d1cae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:36.961140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e781-5dbf-4b31-ba87-e5262d1cae83 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:36.961827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783e781-5dbf-4b31-ba87-e5262d1cae83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:36.963739 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783e781-5dbf-4b31-ba87-e5262d1cae83 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:37.140845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1304/2635] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:04:36 2022] POST /identity/v3/users => generated 291 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:04:37.145318 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee0024-e2cd-4ecd-ab91-e87d434cd0b1 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:37.157272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee0024-e2cd-4ecd-ab91-e87d434cd0b1 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:37.162964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07ce42-f476-4c30-aa7a-3da62a74449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:37.163714 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07ce42-f476-4c30-aa7a-3da62a74449d admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:37.164001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07ce42-f476-4c30-aa7a-3da62a74449d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:37.164281 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07ce42-f476-4c30-aa7a-3da62a74449d admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:37.165136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07ce42-f476-4c30-aa7a-3da62a74449d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:37.166744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd07ce42-f476-4c30-aa7a-3da62a74449d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:37.179635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1332/2636] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:37.187287 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e781-5dbf-4b31-ba87-e5262d1cae83 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:37.198329 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e781-5dbf-4b31-ba87-e5262d1cae83 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:37.203830 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf77665-ad81-4b44-b2c4-abd144ba8262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:37.204844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf77665-ad81-4b44-b2c4-abd144ba8262 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:37.205149 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf77665-ad81-4b44-b2c4-abd144ba8262 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:37.205429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf77665-ad81-4b44-b2c4-abd144ba8262 admin admin] PATH_INFO: `/v3/projects/26eaeb60defa46eb854c1fd74276a581/users/edd26c2f366b4df5aae9f5d4e205647f/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:37.223046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf77665-ad81-4b44-b2c4-abd144ba8262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26eaeb60defa46eb854c1fd74276a581, user_id=edd26c2f366b4df5aae9f5d4e205647f, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:37.224948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf77665-ad81-4b44-b2c4-abd144ba8262 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:37.252252 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:37.338576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1305/2637] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:04:37 2022] PUT /identity/v3/projects/26eaeb60defa46eb854c1fd74276a581/users/edd26c2f366b4df5aae9f5d4e205647f/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:37.343507 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07ce42-f476-4c30-aa7a-3da62a74449d admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:37.354044 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd07ce42-f476-4c30-aa7a-3da62a74449d admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:37.419001 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97050d-1d7a-4c1a-9be3-eaf0d320397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:37.419775 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97050d-1d7a-4c1a-9be3-eaf0d320397f admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:37.420057 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97050d-1d7a-4c1a-9be3-eaf0d320397f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:37.420332 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97050d-1d7a-4c1a-9be3-eaf0d320397f admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:37.421154 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97050d-1d7a-4c1a-9be3-eaf0d320397f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:37.423116 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97050d-1d7a-4c1a-9be3-eaf0d320397f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:37.435378 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1333/2638] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:37.439560 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf77665-ad81-4b44-b2c4-abd144ba8262 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:37.451556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf77665-ad81-4b44-b2c4-abd144ba8262 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:37.456535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125267fd-2f74-4311-8ab9-78cf7916967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:37.457439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125267fd-2f74-4311-8ab9-78cf7916967a admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:37.457724 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125267fd-2f74-4311-8ab9-78cf7916967a admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:37.458005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125267fd-2f74-4311-8ab9-78cf7916967a admin admin] PATH_INFO: `/v3/projects/26eaeb60defa46eb854c1fd74276a581/users/edd26c2f366b4df5aae9f5d4e205647f/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:37.461053 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125267fd-2f74-4311-8ab9-78cf7916967a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26eaeb60defa46eb854c1fd74276a581, user_id=edd26c2f366b4df5aae9f5d4e205647f, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:37.463832 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125267fd-2f74-4311-8ab9-78cf7916967a admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:37.484421 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1306/2639] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:04:37 2022] PUT /identity/v3/projects/26eaeb60defa46eb854c1fd74276a581/users/edd26c2f366b4df5aae9f5d4e205647f/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:39.349753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e82523-2017-4160-94cd-b66674e24580 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:39.354452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e82523-2017-4160-94cd-b66674e24580 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:39.354452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e82523-2017-4160-94cd-b66674e24580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:39.385685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-75e82523-2017-4160-94cd-b66674e24580 None None] MFA Rules not processed for user `edd26c2f366b4df5aae9f5d4e205647f`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:39.388802 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-75e82523-2017-4160-94cd-b66674e24580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:39.422193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:39.460104 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1334/2640] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:39.471632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca20112-8eed-413c-a3d3-f0fd8cc4f5ca None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:39.472163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca20112-8eed-413c-a3d3-f0fd8cc4f5ca None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:39.472276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca20112-8eed-413c-a3d3-f0fd8cc4f5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:39.491533 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-0ca20112-8eed-413c-a3d3-f0fd8cc4f5ca None None] MFA Rules not processed for user `1f5545040b13431598627faccd5ba4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:39.509059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0ca20112-8eed-413c-a3d3-f0fd8cc4f5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:39.550177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1307/2641] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:39.565482 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e82523-2017-4160-94cd-b66674e24580 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:39.567263 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-75e82523-2017-4160-94cd-b66674e24580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:39.641788 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e82523-2017-4160-94cd-b66674e24580 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:39.647122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfa9b0-7390-440f-a13e-49338c2b8e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:39.647759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfa9b0-7390-440f-a13e-49338c2b8e5c service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:39.648041 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfa9b0-7390-440f-a13e-49338c2b8e5c service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:39.648316 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfa9b0-7390-440f-a13e-49338c2b8e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:39.656282 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfa9b0-7390-440f-a13e-49338c2b8e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:39.657896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfa9b0-7390-440f-a13e-49338c2b8e5c service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:39.667365 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1335/2642] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:04:39.874418 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ccd4-4a17-4b4d-ac6c-4aca7e890a19 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:39.874714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ccd4-4a17-4b4d-ac6c-4aca7e890a19 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:39.875002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31ccd4-4a17-4b4d-ac6c-4aca7e890a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:39.896657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-bd31ccd4-4a17-4b4d-ac6c-4aca7e890a19 None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:39.897897 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bd31ccd4-4a17-4b4d-ac6c-4aca7e890a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:39.997190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1308/2643] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jul 20 18:04:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:40.011023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfa9b0-7390-440f-a13e-49338c2b8e5c service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:40.012748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-16bfa9b0-7390-440f-a13e-49338c2b8e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:40.102666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfa9b0-7390-440f-a13e-49338c2b8e5c service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:40.108411 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aacff-05b0-41ab-bd38-9b6024b56b0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:40.109127 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aacff-05b0-41ab-bd38-9b6024b56b0e service swift] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:40.112721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aacff-05b0-41ab-bd38-9b6024b56b0e service swift] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:40.112721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aacff-05b0-41ab-bd38-9b6024b56b0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:40.119382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aacff-05b0-41ab-bd38-9b6024b56b0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:40.121031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aacff-05b0-41ab-bd38-9b6024b56b0e service swift] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:40.132400 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1336/2644] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:04:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 18:04:45.368065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31ccd4-4a17-4b4d-ac6c-4aca7e890a19 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:45.376867 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bd31ccd4-4a17-4b4d-ac6c-4aca7e890a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:45.458557 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31ccd4-4a17-4b4d-ac6c-4aca7e890a19 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:45.464333 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904d8c3-4e84-4b00-8511-87c6c73d2494 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b218402abe6540d8b81295676199f6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:45.465264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904d8c3-4e84-4b00-8511-87c6c73d2494 service placement] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:45.465615 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904d8c3-4e84-4b00-8511-87c6c73d2494 service placement] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:45.465896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904d8c3-4e84-4b00-8511-87c6c73d2494 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:45.467777 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9904d8c3-4e84-4b00-8511-87c6c73d2494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:45.480833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904d8c3-4e84-4b00-8511-87c6c73d2494 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:45.482443 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904d8c3-4e84-4b00-8511-87c6c73d2494 service placement] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:45.494904 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1309/2645] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:04:45.647595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aacff-05b0-41ab-bd38-9b6024b56b0e service swift] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:45.649621 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5f4aacff-05b0-41ab-bd38-9b6024b56b0e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:45.719974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:45.748825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aacff-05b0-41ab-bd38-9b6024b56b0e service swift] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:45.753613 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:45.754565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:45.758335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:45.758335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] PATH_INFO: `/v3/users/faf9bdc76439428ab5e3c40d33a88425` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:45.758335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf9bdc76439428ab5e3c40d33a88425)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:45.759330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:46.084462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf9bdc76439428ab5e3c40d33a88425'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:46.098485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf9bdc76439428ab5e3c40d33a88425'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:46.106601 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf9bdc76439428ab5e3c40d33a88425'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:46.264752 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf9bdc76439428ab5e3c40d33a88425'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:46.265391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf9bdc76439428ab5e3c40d33a88425'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:46.272805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1337/2646] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:04:45 2022] DELETE /identity/v3/users/faf9bdc76439428ab5e3c40d33a88425 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:46.906828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904d8c3-4e84-4b00-8511-87c6c73d2494 service placement] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:46.912297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904d8c3-4e84-4b00-8511-87c6c73d2494 service placement] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:46.922161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:46.988732 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64315a-4986-4e43-911c-98e1d8b2bb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:46.990265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64315a-4986-4e43-911c-98e1d8b2bb3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:46.991740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64315a-4986-4e43-911c-98e1d8b2bb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:46.992028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64315a-4986-4e43-911c-98e1d8b2bb3c admin admin] PATH_INFO: `/v3/projects/e56fb66af8654665b5869624adb1c8c8` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:46.993664 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64315a-4986-4e43-911c-98e1d8b2bb3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56fb66af8654665b5869624adb1c8c8)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:46.995580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64315a-4986-4e43-911c-98e1d8b2bb3c admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:47.186374 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-dd64315a-4986-4e43-911c-98e1d8b2bb3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56fb66af8654665b5869624adb1c8c8', 'request_id': 'req-dd64315a-4986-4e43-911c-98e1d8b2bb3c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:47.192041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-dd64315a-4986-4e43-911c-98e1d8b2bb3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56fb66af8654665b5869624adb1c8c8', 'request_id': 'req-dd64315a-4986-4e43-911c-98e1d8b2bb3c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:47.317414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-dd64315a-4986-4e43-911c-98e1d8b2bb3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56fb66af8654665b5869624adb1c8c8', 'request_id': 'req-dd64315a-4986-4e43-911c-98e1d8b2bb3c'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:47.330113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-dd64315a-4986-4e43-911c-98e1d8b2bb3c admin admin] The token cache is being invalidate because project e56fb66af8654665b5869624adb1c8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:04:47.330398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-dd64315a-4986-4e43-911c-98e1d8b2bb3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:47.331049 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-dd64315a-4986-4e43-911c-98e1d8b2bb3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:47.333005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1310/2647] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:04:46 2022] DELETE /identity/v3/projects/e56fb66af8654665b5869624adb1c8c8 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:51.930182 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:51.931635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:51.994025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb251700-5c8a-47dd-84a3-8bbbec6c1275 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:52.049694 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738396a-c803-4170-8b1c-0dcbd88e98ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:52.050947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738396a-c803-4170-8b1c-0dcbd88e98ee service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:52.050947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738396a-c803-4170-8b1c-0dcbd88e98ee service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:52.050947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738396a-c803-4170-8b1c-0dcbd88e98ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:52.053620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4738396a-c803-4170-8b1c-0dcbd88e98ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:52.101936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:52.156317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738396a-c803-4170-8b1c-0dcbd88e98ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:52.157836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738396a-c803-4170-8b1c-0dcbd88e98ee service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:52.169913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1338/2648] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:04:56.551305 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0035f5-7e5e-43ab-ac88-061e8821f9d8 None None] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:56.552035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0035f5-7e5e-43ab-ac88-061e8821f9d8 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:56.552588 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0035f5-7e5e-43ab-ac88-061e8821f9d8 None None] PATH_INFO: `/` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:56.554885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1311/2649] 10.222.0.27 () {54 vars in 921 bytes} [Wed Jul 20 18:04:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 18:04:56.563777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbcebf-834c-44ad-bbe2-ab202a860e99 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:56.564676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbcebf-834c-44ad-bbe2-ab202a860e99 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:56.564676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbcebf-834c-44ad-bbe2-ab202a860e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:56.584904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-9dbbcebf-834c-44ad-bbe2-ab202a860e99 None None] MFA Rules not processed for user `b218402abe6540d8b81295676199f6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:56.586103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9dbbcebf-834c-44ad-bbe2-ab202a860e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:56.659582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1339/2650] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Jul 20 18:04:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:56.672085 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0035f5-7e5e-43ab-ac88-061e8821f9d8 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:56.673872 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2e0035f5-7e5e-43ab-ac88-061e8821f9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:56.691862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0035f5-7e5e-43ab-ac88-061e8821f9d8 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:56.697710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c1ee7-771c-45f3-8177-6d6947ed67a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b218402abe6540d8b81295676199f6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:56.698369 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c1ee7-771c-45f3-8177-6d6947ed67a1 service placement] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:56.698650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c1ee7-771c-45f3-8177-6d6947ed67a1 service placement] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:56.698924 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c1ee7-771c-45f3-8177-6d6947ed67a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:56.708059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c1ee7-771c-45f3-8177-6d6947ed67a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:56.711155 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c1ee7-771c-45f3-8177-6d6947ed67a1 service placement] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:56.722449 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbcebf-834c-44ad-bbe2-ab202a860e99 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:56.723924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9dbbcebf-834c-44ad-bbe2-ab202a860e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:56.727198 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1312/2651] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:04:56.746565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbcebf-834c-44ad-bbe2-ab202a860e99 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:56.754761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06ae93-e965-4ed1-89b3-ef07cc1736d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:56.756372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06ae93-e965-4ed1-89b3-ef07cc1736d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:56.756940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06ae93-e965-4ed1-89b3-ef07cc1736d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:56.757491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06ae93-e965-4ed1-89b3-ef07cc1736d6 admin admin] PATH_INFO: `/v3/users/fed263f071864582ba96d79f75fbfb36` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:56.760589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06ae93-e965-4ed1-89b3-ef07cc1736d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed263f071864582ba96d79f75fbfb36)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:56.764020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06ae93-e965-4ed1-89b3-ef07cc1736d6 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:57.034229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3e06ae93-e965-4ed1-89b3-ef07cc1736d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed263f071864582ba96d79f75fbfb36'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:57.046722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3e06ae93-e965-4ed1-89b3-ef07cc1736d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed263f071864582ba96d79f75fbfb36'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:57.055802 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3e06ae93-e965-4ed1-89b3-ef07cc1736d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed263f071864582ba96d79f75fbfb36'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:57.196999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3e06ae93-e965-4ed1-89b3-ef07cc1736d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed263f071864582ba96d79f75fbfb36'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:57.197641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3e06ae93-e965-4ed1-89b3-ef07cc1736d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed263f071864582ba96d79f75fbfb36'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:57.204234 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1340/2652] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:04:56 2022] DELETE /identity/v3/users/fed263f071864582ba96d79f75fbfb36 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:57.493955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c1ee7-771c-45f3-8177-6d6947ed67a1 service placement] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:57.511666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c1ee7-771c-45f3-8177-6d6947ed67a1 service placement] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:57.573291 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:57.574038 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:57.574351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:57.574625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255 admin admin] PATH_INFO: `/v3/projects/42a3ef9ead804c5483de2cc4ac8855b3` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:57.575816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a3ef9ead804c5483de2cc4ac8855b3)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:57.577805 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:57.727350 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:57.740298 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a3ef9ead804c5483de2cc4ac8855b3', 'request_id': 'req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:57.746635 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a3ef9ead804c5483de2cc4ac8855b3', 'request_id': 'req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:57.875284 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a3ef9ead804c5483de2cc4ac8855b3', 'request_id': 'req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:57.888249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255 admin admin] The token cache is being invalidate because project 42a3ef9ead804c5483de2cc4ac8855b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:04:57.888577 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:57.889245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-898ed98c-7e7b-43d5-bd6e-d2d5ccd45255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:04:57.890858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1313/2653] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:04:57 2022] DELETE /identity/v3/projects/42a3ef9ead804c5483de2cc4ac8855b3 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:57.895953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ee597-0468-4f27-945c-19f58075f9cf None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:57.897482 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ee597-0468-4f27-945c-19f58075f9cf None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:57.897864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ee597-0468-4f27-945c-19f58075f9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:57.916727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e01ee597-0468-4f27-945c-19f58075f9cf None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:57.917954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e01ee597-0468-4f27-945c-19f58075f9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:57.953904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:57.981052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1341/2654] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:57.988759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994dd2a-7f72-4956-88f3-e775d3f85267 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:57.989080 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994dd2a-7f72-4956-88f3-e775d3f85267 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:57.989331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994dd2a-7f72-4956-88f3-e775d3f85267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:58.010220 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-3994dd2a-7f72-4956-88f3-e775d3f85267 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:58.012698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3994dd2a-7f72-4956-88f3-e775d3f85267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:58.022146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1314/2655] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:58.038092 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ee597-0468-4f27-945c-19f58075f9cf None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:58.049024 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ee597-0468-4f27-945c-19f58075f9cf None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:58.058854 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7af05c-5487-43a8-84bc-f4c4cfaf6e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:58.059565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7af05c-5487-43a8-84bc-f4c4cfaf6e3a admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:58.060112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7af05c-5487-43a8-84bc-f4c4cfaf6e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:58.060637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7af05c-5487-43a8-84bc-f4c4cfaf6e3a admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:58.061620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7af05c-5487-43a8-84bc-f4c4cfaf6e3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:04:58.061966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7af05c-5487-43a8-84bc-f4c4cfaf6e3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:58.063705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7af05c-5487-43a8-84bc-f4c4cfaf6e3a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:58.077962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1342/2656] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 18:04:58.082760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994dd2a-7f72-4956-88f3-e775d3f85267 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:58.093779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994dd2a-7f72-4956-88f3-e775d3f85267 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:58.098627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34804ee-65ab-4aae-af5f-0fea68752127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:58.099314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34804ee-65ab-4aae-af5f-0fea68752127 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:58.099781 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34804ee-65ab-4aae-af5f-0fea68752127 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:58.100206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34804ee-65ab-4aae-af5f-0fea68752127 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:58.100854 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34804ee-65ab-4aae-af5f-0fea68752127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:58.102780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34804ee-65ab-4aae-af5f-0fea68752127 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:58.258482 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1315/2657] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:04:58 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:04:58.263027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7af05c-5487-43a8-84bc-f4c4cfaf6e3a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:58.274879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7af05c-5487-43a8-84bc-f4c4cfaf6e3a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:58.341240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33230b6-0e14-457a-9bf7-e5d1bf52131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:58.342107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33230b6-0e14-457a-9bf7-e5d1bf52131a admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:58.342391 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33230b6-0e14-457a-9bf7-e5d1bf52131a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:58.342734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33230b6-0e14-457a-9bf7-e5d1bf52131a admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:58.343453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33230b6-0e14-457a-9bf7-e5d1bf52131a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:58.350340 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33230b6-0e14-457a-9bf7-e5d1bf52131a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:58.449516 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1343/2658] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:04:58 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:04:58.453744 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34804ee-65ab-4aae-af5f-0fea68752127 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:58.465057 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34804ee-65ab-4aae-af5f-0fea68752127 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:58.470055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49679f1a-ffb9-4daa-8be2-e3a33898f16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:58.470651 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49679f1a-ffb9-4daa-8be2-e3a33898f16e admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:58.470929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49679f1a-ffb9-4daa-8be2-e3a33898f16e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:58.471211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49679f1a-ffb9-4daa-8be2-e3a33898f16e admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:58.471949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49679f1a-ffb9-4daa-8be2-e3a33898f16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:58.473720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49679f1a-ffb9-4daa-8be2-e3a33898f16e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:58.486088 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1316/2659] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:58.493496 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33230b6-0e14-457a-9bf7-e5d1bf52131a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:58.504219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33230b6-0e14-457a-9bf7-e5d1bf52131a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:58.509068 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebf40f-7886-4613-b9f0-a7522f218980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:58.509836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebf40f-7886-4613-b9f0-a7522f218980 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:58.510448 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebf40f-7886-4613-b9f0-a7522f218980 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:58.511002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebf40f-7886-4613-b9f0-a7522f218980 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:58.511751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebf40f-7886-4613-b9f0-a7522f218980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:58.513706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebf40f-7886-4613-b9f0-a7522f218980 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:58.526386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1344/2660] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:58.532152 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49679f1a-ffb9-4daa-8be2-e3a33898f16e admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:58.543879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49679f1a-ffb9-4daa-8be2-e3a33898f16e admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:58.548939 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26288a27-ba49-49ed-85eb-001f1967ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:58.550215 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288a27-ba49-49ed-85eb-001f1967ce48 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:58.550505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288a27-ba49-49ed-85eb-001f1967ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:58.550776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288a27-ba49-49ed-85eb-001f1967ce48 admin admin] PATH_INFO: `/v3/projects/c53ecd8c82a444e48e71096e478f41c5/users/c8d88ed21d774689b104eeaef95607e5/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:58.568413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26288a27-ba49-49ed-85eb-001f1967ce48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53ecd8c82a444e48e71096e478f41c5, user_id=c8d88ed21d774689b104eeaef95607e5, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:58.571255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26288a27-ba49-49ed-85eb-001f1967ce48 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:58.678496 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1317/2661] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:04:58 2022] PUT /identity/v3/projects/c53ecd8c82a444e48e71096e478f41c5/users/c8d88ed21d774689b104eeaef95607e5/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:58.689793 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b977b0-b33f-421d-b043-4cc8ca0e8e16 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:58.690174 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b977b0-b33f-421d-b043-4cc8ca0e8e16 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:58.690475 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b977b0-b33f-421d-b043-4cc8ca0e8e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:58.721496 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-c2b977b0-b33f-421d-b043-4cc8ca0e8e16 None None] MFA Rules not processed for user `c8d88ed21d774689b104eeaef95607e5`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:58.722732 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c2b977b0-b33f-421d-b043-4cc8ca0e8e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:58.797141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1345/2662] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:58.802925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26288a27-ba49-49ed-85eb-001f1967ce48 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:58.878256 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26288a27-ba49-49ed-85eb-001f1967ce48 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:58.884242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a78dc-9aa5-4f99-addd-1450502c3ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:58.885145 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a78dc-9aa5-4f99-addd-1450502c3ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:58.885464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a78dc-9aa5-4f99-addd-1450502c3ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:58.885746 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a78dc-9aa5-4f99-addd-1450502c3ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:58.886487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a78dc-9aa5-4f99-addd-1450502c3ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:58.888428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a78dc-9aa5-4f99-addd-1450502c3ed4 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:58.900122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b977b0-b33f-421d-b043-4cc8ca0e8e16 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:58.901353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c2b977b0-b33f-421d-b043-4cc8ca0e8e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:58.943776 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:58.962183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b977b0-b33f-421d-b043-4cc8ca0e8e16 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:58.966153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f166e1-d027-4291-965a-97042e184c03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:58.966983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f166e1-d027-4291-965a-97042e184c03 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:58.967264 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f166e1-d027-4291-965a-97042e184c03 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:58.967541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f166e1-d027-4291-965a-97042e184c03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:58.969420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-48f166e1-d027-4291-965a-97042e184c03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:59.004698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1318/2663] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:04:58 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:04:59.009870 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a78dc-9aa5-4f99-addd-1450502c3ed4 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:59.038464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f166e1-d027-4291-965a-97042e184c03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:59.044748 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f166e1-d027-4291-965a-97042e184c03 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:59.059898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1346/2664] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:04:59.074432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:59.093435 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a78dc-9aa5-4f99-addd-1450502c3ed4 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:59.098414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc307cbe-85ad-4f9d-8b34-2d35d7f9554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:59.099124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc307cbe-85ad-4f9d-8b34-2d35d7f9554b admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:59.100395 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc307cbe-85ad-4f9d-8b34-2d35d7f9554b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:59.100710 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc307cbe-85ad-4f9d-8b34-2d35d7f9554b admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:59.101430 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc307cbe-85ad-4f9d-8b34-2d35d7f9554b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:59.103381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc307cbe-85ad-4f9d-8b34-2d35d7f9554b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:59.225384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1319/2665] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:04:59 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:04:59.230541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f166e1-d027-4291-965a-97042e184c03 service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:59.248770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f166e1-d027-4291-965a-97042e184c03 service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:59.260145 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8763-e6dd-4e9a-84b7-1e65e3566fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:59.260865 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8763-e6dd-4e9a-84b7-1e65e3566fea admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:59.261270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8763-e6dd-4e9a-84b7-1e65e3566fea admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:59.261632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8763-e6dd-4e9a-84b7-1e65e3566fea admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:59.262890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c8763-e6dd-4e9a-84b7-1e65e3566fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:59.273679 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c8763-e6dd-4e9a-84b7-1e65e3566fea admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:59.283685 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1347/2666] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:59.289078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc307cbe-85ad-4f9d-8b34-2d35d7f9554b admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:59.300014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc307cbe-85ad-4f9d-8b34-2d35d7f9554b admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:59.305899 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5957b0-5734-4f5e-871e-ca3e55962dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:59.306891 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5957b0-5734-4f5e-871e-ca3e55962dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:59.307088 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5957b0-5734-4f5e-871e-ca3e55962dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:59.307364 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5957b0-5734-4f5e-871e-ca3e55962dfb admin admin] PATH_INFO: `/v3/projects/a0ed4a03c99b4690860cfee79ea309df/users/cbff4e339e0e4bbd917929ef5210a9e6/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:59.327517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5957b0-5734-4f5e-871e-ca3e55962dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ed4a03c99b4690860cfee79ea309df, user_id=cbff4e339e0e4bbd917929ef5210a9e6, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:59.330336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5957b0-5734-4f5e-871e-ca3e55962dfb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:59.416878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1320/2667] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:04:59 2022] PUT /identity/v3/projects/a0ed4a03c99b4690860cfee79ea309df/users/cbff4e339e0e4bbd917929ef5210a9e6/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:59.421078 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8763-e6dd-4e9a-84b7-1e65e3566fea admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:59.432792 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8763-e6dd-4e9a-84b7-1e65e3566fea admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:59.498193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f098af-0879-4409-b683-66a397700c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:59.498943 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f098af-0879-4409-b683-66a397700c9e admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:59.499220 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f098af-0879-4409-b683-66a397700c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:59.499500 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f098af-0879-4409-b683-66a397700c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:59.500237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f098af-0879-4409-b683-66a397700c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:59.502073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f098af-0879-4409-b683-66a397700c9e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:59.517021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1348/2668] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:04:59.518846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5957b0-5734-4f5e-871e-ca3e55962dfb admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:59.533247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5957b0-5734-4f5e-871e-ca3e55962dfb admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:59.540239 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024614f-e38a-403f-aae4-03ffd972f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:59.541878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024614f-e38a-403f-aae4-03ffd972f217 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:59.542302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024614f-e38a-403f-aae4-03ffd972f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:59.542817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024614f-e38a-403f-aae4-03ffd972f217 admin admin] PATH_INFO: `/v3/projects/a0ed4a03c99b4690860cfee79ea309df/users/cbff4e339e0e4bbd917929ef5210a9e6/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:59.546484 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024614f-e38a-403f-aae4-03ffd972f217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ed4a03c99b4690860cfee79ea309df, user_id=cbff4e339e0e4bbd917929ef5210a9e6, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:59.551439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024614f-e38a-403f-aae4-03ffd972f217 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:59.565587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1321/2669] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:04:59 2022] PUT /identity/v3/projects/a0ed4a03c99b4690860cfee79ea309df/users/cbff4e339e0e4bbd917929ef5210a9e6/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:04:59.575832 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c28e4a-df35-491c-b204-7d04bb3949f1 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:59.576118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c28e4a-df35-491c-b204-7d04bb3949f1 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:59.576396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c28e4a-df35-491c-b204-7d04bb3949f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:59.606628 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-41c28e4a-df35-491c-b204-7d04bb3949f1 None None] MFA Rules not processed for user `cbff4e339e0e4bbd917929ef5210a9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:04:59.607984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-41c28e4a-df35-491c-b204-7d04bb3949f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:59.675250 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:04:59.686675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1349/2670] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:04:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:04:59.699355 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024614f-e38a-403f-aae4-03ffd972f217 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:04:59.701149 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-f024614f-e38a-403f-aae4-03ffd972f217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:04:59.768166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024614f-e38a-403f-aae4-03ffd972f217 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:04:59.774132 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7935e84-be65-4cb0-bb02-49b6423b8e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:04:59.778794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7935e84-be65-4cb0-bb02-49b6423b8e63 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:04:59.778794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7935e84-be65-4cb0-bb02-49b6423b8e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:04:59.778794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7935e84-be65-4cb0-bb02-49b6423b8e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:04:59.786090 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7935e84-be65-4cb0-bb02-49b6423b8e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:04:59.788419 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7935e84-be65-4cb0-bb02-49b6423b8e63 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:04:59.800231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1322/2671] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:04:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:01.091421 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c28e4a-df35-491c-b204-7d04bb3949f1 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:01.101909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c28e4a-df35-491c-b204-7d04bb3949f1 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:01.107041 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d604e-3f17-4403-8acc-b2cdbb422987 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbff4e339e0e4bbd917929ef5210a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0ed4a03c99b4690860cfee79ea309df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:01.107730 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d604e-3f17-4403-8acc-b2cdbb422987 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:01.108016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d604e-3f17-4403-8acc-b2cdbb422987 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:01.108304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d604e-3f17-4403-8acc-b2cdbb422987 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:01.109085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d604e-3f17-4403-8acc-b2cdbb422987 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:05:01.109401 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d604e-3f17-4403-8acc-b2cdbb422987 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:01.111043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d604e-3f17-4403-8acc-b2cdbb422987 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:01.124988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1350/2672] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:05:01.129841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7935e84-be65-4cb0-bb02-49b6423b8e63 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:01.140893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7935e84-be65-4cb0-bb02-49b6423b8e63 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:01.145576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a8283-39fa-4031-b14f-1db905f93c6d tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbff4e339e0e4bbd917929ef5210a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0ed4a03c99b4690860cfee79ea309df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:01.146327 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8283-39fa-4031-b14f-1db905f93c6d tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:01.146624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8283-39fa-4031-b14f-1db905f93c6d tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:01.146908 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8283-39fa-4031-b14f-1db905f93c6d tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:01.147609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a8283-39fa-4031-b14f-1db905f93c6d tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:01.149562 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a8283-39fa-4031-b14f-1db905f93c6d tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:01.296204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1323/2673] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:05:01 2022] POST /identity/v3/projects => generated 355 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:01.300734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d604e-3f17-4403-8acc-b2cdbb422987 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:01.312472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d604e-3f17-4403-8acc-b2cdbb422987 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:01.388601 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9c769-8990-490d-8ef6-401f5a00365b tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbff4e339e0e4bbd917929ef5210a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0ed4a03c99b4690860cfee79ea309df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:01.389310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9c769-8990-490d-8ef6-401f5a00365b tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:01.389777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9c769-8990-490d-8ef6-401f5a00365b tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:01.389965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9c769-8990-490d-8ef6-401f5a00365b tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:01.390683 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9c769-8990-490d-8ef6-401f5a00365b tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:05:01.390998 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9c769-8990-490d-8ef6-401f5a00365b tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:01.392718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9c769-8990-490d-8ef6-401f5a00365b tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:01.408774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1351/2674] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:05:01.450895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a8283-39fa-4031-b14f-1db905f93c6d tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:01.462322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a8283-39fa-4031-b14f-1db905f93c6d tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:01.467017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbff4e339e0e4bbd917929ef5210a9e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0ed4a03c99b4690860cfee79ea309df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:01.467879 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:01.468166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:01.468445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] PATH_INFO: `/v3/projects/2a202b6b130a44a1aaf6d66b4226f1f0` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:01.469685 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2a202b6b130a44a1aaf6d66b4226f1f0)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:01.471719 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:01.617647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a202b6b130a44a1aaf6d66b4226f1f0', 'request_id': 'req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:01.623347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a202b6b130a44a1aaf6d66b4226f1f0', 'request_id': 'req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:01.727500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a202b6b130a44a1aaf6d66b4226f1f0', 'request_id': 'req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:01.738221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:01.745236 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] The token cache is being invalidate because project 2a202b6b130a44a1aaf6d66b4226f1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:01.746019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:01.746534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-be40ba94-46d3-4ef6-a22c-0a0f7c3fa550 tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:01.748408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1324/2675] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:01 2022] DELETE /identity/v3/projects/2a202b6b130a44a1aaf6d66b4226f1f0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:02.526270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9c769-8990-490d-8ef6-401f5a00365b tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:02.528303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c5c9c769-8990-490d-8ef6-401f5a00365b tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:02.608161 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9c769-8990-490d-8ef6-401f5a00365b tempest-VolumeQuotaClassesTest-815561658 tempest-VolumeQuotaClassesTest-815561658-project-admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:02.677459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:02.678974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:02.679256 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:02.679533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] PATH_INFO: `/v3/users/c8d88ed21d774689b104eeaef95607e5` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:02.680796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d88ed21d774689b104eeaef95607e5)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:02.682706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:02.900271 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:03.192093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d88ed21d774689b104eeaef95607e5'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:03.205562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d88ed21d774689b104eeaef95607e5'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:03.213344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d88ed21d774689b104eeaef95607e5'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:03.390533 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d88ed21d774689b104eeaef95607e5'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:03.391211 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d88ed21d774689b104eeaef95607e5'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:03.404125 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1352/2676] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:02 2022] DELETE /identity/v3/users/c8d88ed21d774689b104eeaef95607e5 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:03.405932 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a0754-278d-4edc-9443-f08ce055366a None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:03.406412 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a0754-278d-4edc-9443-f08ce055366a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:03.406563 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a0754-278d-4edc-9443-f08ce055366a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:03.426348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-8b8a0754-278d-4edc-9443-f08ce055366a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:03.428089 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8b8a0754-278d-4edc-9443-f08ce055366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:03.497185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1325/2677] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:03.509864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:03.511610 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:03.574611 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa00b0-7cd9-4e4e-bce8-a41ce2e8bb9a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:03.579107 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c8b0a-0e78-4b31-ab44-ca3e6a9a3538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:03.579853 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c8b0a-0e78-4b31-ab44-ca3e6a9a3538 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:03.580194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c8b0a-0e78-4b31-ab44-ca3e6a9a3538 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:03.580571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c8b0a-0e78-4b31-ab44-ca3e6a9a3538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:03.591269 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c8b0a-0e78-4b31-ab44-ca3e6a9a3538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:03.592815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c8b0a-0e78-4b31-ab44-ca3e6a9a3538 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:03.602831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1353/2678] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:04.126148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a0754-278d-4edc-9443-f08ce055366a None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:04.128016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8b8a0754-278d-4edc-9443-f08ce055366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:04.144726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a0754-278d-4edc-9443-f08ce055366a None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:04.153598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:04.153598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:04.153598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:04.153598 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] PATH_INFO: `/v3/projects/c53ecd8c82a444e48e71096e478f41c5` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:04.155271 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c53ecd8c82a444e48e71096e478f41c5)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:04.157428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:04.327199 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c53ecd8c82a444e48e71096e478f41c5', 'request_id': 'req-2e2a2911-4771-4145-a41a-abdf4669fd24'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:04.332731 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c53ecd8c82a444e48e71096e478f41c5', 'request_id': 'req-2e2a2911-4771-4145-a41a-abdf4669fd24'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:04.498138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c53ecd8c82a444e48e71096e478f41c5', 'request_id': 'req-2e2a2911-4771-4145-a41a-abdf4669fd24'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:04.512600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] The token cache is being invalidate because project c53ecd8c82a444e48e71096e478f41c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:04.512894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:04.513581 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:04.515178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1326/2679] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:04 2022] DELETE /identity/v3/projects/c53ecd8c82a444e48e71096e478f41c5 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:04.519380 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c8b0a-0e78-4b31-ab44-ca3e6a9a3538 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:04.530139 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c8b0a-0e78-4b31-ab44-ca3e6a9a3538 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:04.605184 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f165dd-3541-4f29-9963-3a40c9cca2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:04.606134 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f165dd-3541-4f29-9963-3a40c9cca2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:04.606368 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f165dd-3541-4f29-9963-3a40c9cca2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:04.606876 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f165dd-3541-4f29-9963-3a40c9cca2f2 admin admin] PATH_INFO: `/v3/users/cbff4e339e0e4bbd917929ef5210a9e6` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:04.607864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f165dd-3541-4f29-9963-3a40c9cca2f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbff4e339e0e4bbd917929ef5210a9e6)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:04.610021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f165dd-3541-4f29-9963-3a40c9cca2f2 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:04.918236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-14f165dd-3541-4f29-9963-3a40c9cca2f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbff4e339e0e4bbd917929ef5210a9e6'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:04.919460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:04.931731 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-14f165dd-3541-4f29-9963-3a40c9cca2f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbff4e339e0e4bbd917929ef5210a9e6'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:04.938954 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-14f165dd-3541-4f29-9963-3a40c9cca2f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbff4e339e0e4bbd917929ef5210a9e6'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:05.050827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-14f165dd-3541-4f29-9963-3a40c9cca2f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbff4e339e0e4bbd917929ef5210a9e6'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:05.051466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-14f165dd-3541-4f29-9963-3a40c9cca2f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbff4e339e0e4bbd917929ef5210a9e6'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:05.058705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1354/2680] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:04 2022] DELETE /identity/v3/users/cbff4e339e0e4bbd917929ef5210a9e6 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:05.533706 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:05.535264 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:05.555390 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a2911-4771-4145-a41a-abdf4669fd24 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:05.632968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f2bfa-fb5f-4605-a980-f5664ef3b835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:05.633943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f2bfa-fb5f-4605-a980-f5664ef3b835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:05.634269 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f2bfa-fb5f-4605-a980-f5664ef3b835 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:05.634632 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f2bfa-fb5f-4605-a980-f5664ef3b835 admin admin] PATH_INFO: `/v3/projects/a0ed4a03c99b4690860cfee79ea309df` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:05.636141 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f2bfa-fb5f-4605-a980-f5664ef3b835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ed4a03c99b4690860cfee79ea309df)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:05.639070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f2bfa-fb5f-4605-a980-f5664ef3b835 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:05.665449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:05.783465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-438f2bfa-fb5f-4605-a980-f5664ef3b835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ed4a03c99b4690860cfee79ea309df', 'request_id': 'req-438f2bfa-fb5f-4605-a980-f5664ef3b835'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:05.789938 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-438f2bfa-fb5f-4605-a980-f5664ef3b835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ed4a03c99b4690860cfee79ea309df', 'request_id': 'req-438f2bfa-fb5f-4605-a980-f5664ef3b835'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:05.935068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-438f2bfa-fb5f-4605-a980-f5664ef3b835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ed4a03c99b4690860cfee79ea309df', 'request_id': 'req-438f2bfa-fb5f-4605-a980-f5664ef3b835'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:05.952029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-438f2bfa-fb5f-4605-a980-f5664ef3b835 admin admin] The token cache is being invalidate because project a0ed4a03c99b4690860cfee79ea309df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:05.952453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-438f2bfa-fb5f-4605-a980-f5664ef3b835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:05.953384 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-438f2bfa-fb5f-4605-a980-f5664ef3b835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:05.955127 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1327/2681] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:05 2022] DELETE /identity/v3/projects/a0ed4a03c99b4690860cfee79ea309df => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:05.960763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42a66-a098-4648-b157-0af86ab12f3c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:05.961306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42a66-a098-4648-b157-0af86ab12f3c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:05.961447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42a66-a098-4648-b157-0af86ab12f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:05.981549 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-28b42a66-a098-4648-b157-0af86ab12f3c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:05.982791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-28b42a66-a098-4648-b157-0af86ab12f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:06.049720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1355/2682] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:06.058509 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54301eb0-0bb0-4552-b87b-4dbf11b26748 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:06.058760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54301eb0-0bb0-4552-b87b-4dbf11b26748 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:06.059010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54301eb0-0bb0-4552-b87b-4dbf11b26748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:06.089679 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-54301eb0-0bb0-4552-b87b-4dbf11b26748 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:06.089679 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-54301eb0-0bb0-4552-b87b-4dbf11b26748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:06.108320 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1328/2683] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:06.111591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b42a66-a098-4648-b157-0af86ab12f3c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:06.122262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b42a66-a098-4648-b157-0af86ab12f3c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:06.126999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0947d1-5c06-48b0-91fc-9d0c3c5ca728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:06.127663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0947d1-5c06-48b0-91fc-9d0c3c5ca728 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:06.128010 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0947d1-5c06-48b0-91fc-9d0c3c5ca728 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:06.128346 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0947d1-5c06-48b0-91fc-9d0c3c5ca728 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:06.129169 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0947d1-5c06-48b0-91fc-9d0c3c5ca728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:05:06.129554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0947d1-5c06-48b0-91fc-9d0c3c5ca728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:06.132083 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0947d1-5c06-48b0-91fc-9d0c3c5ca728 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:06.145062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1356/2684] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:05:06.150408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54301eb0-0bb0-4552-b87b-4dbf11b26748 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:06.160514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54301eb0-0bb0-4552-b87b-4dbf11b26748 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:06.165678 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa830564-46c1-4a75-9233-10d5ec26d2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:06.166380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa830564-46c1-4a75-9233-10d5ec26d2dd admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:06.166663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa830564-46c1-4a75-9233-10d5ec26d2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:06.166940 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa830564-46c1-4a75-9233-10d5ec26d2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:06.167637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa830564-46c1-4a75-9233-10d5ec26d2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:06.169613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa830564-46c1-4a75-9233-10d5ec26d2dd admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:06.355146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1329/2685] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:05:06 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:06.359600 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0947d1-5c06-48b0-91fc-9d0c3c5ca728 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:06.373201 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0947d1-5c06-48b0-91fc-9d0c3c5ca728 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:06.452306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a9dc-b178-495e-998b-4e70f82c4075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:06.453021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a9dc-b178-495e-998b-4e70f82c4075 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:06.453300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a9dc-b178-495e-998b-4e70f82c4075 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:06.453569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a9dc-b178-495e-998b-4e70f82c4075 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:06.454262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8a9dc-b178-495e-998b-4e70f82c4075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:06.456175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8a9dc-b178-495e-998b-4e70f82c4075 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:06.558117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1357/2686] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:05:06 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:06.564977 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa830564-46c1-4a75-9233-10d5ec26d2dd admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:06.576318 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa830564-46c1-4a75-9233-10d5ec26d2dd admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:06.580965 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f672-5d56-47d3-b034-bc540cf77e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:06.581759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f672-5d56-47d3-b034-bc540cf77e77 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:06.582131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f672-5d56-47d3-b034-bc540cf77e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:06.582540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f672-5d56-47d3-b034-bc540cf77e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:06.583396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4f672-5d56-47d3-b034-bc540cf77e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:06.587535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4f672-5d56-47d3-b034-bc540cf77e77 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:06.599362 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1330/2687] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:06.605349 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a9dc-b178-495e-998b-4e70f82c4075 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:06.616450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a9dc-b178-495e-998b-4e70f82c4075 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:06.623149 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885fd8b-4e08-452c-8399-f8acd4972c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:06.624324 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885fd8b-4e08-452c-8399-f8acd4972c3a admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:06.624873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885fd8b-4e08-452c-8399-f8acd4972c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:06.625385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885fd8b-4e08-452c-8399-f8acd4972c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:06.626535 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885fd8b-4e08-452c-8399-f8acd4972c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:06.629671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885fd8b-4e08-452c-8399-f8acd4972c3a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:06.650118 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1358/2688] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:06.654433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f672-5d56-47d3-b034-bc540cf77e77 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:06.666528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f672-5d56-47d3-b034-bc540cf77e77 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:06.671407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b282c-08db-43bd-a092-feb3a9750abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:06.672313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b282c-08db-43bd-a092-feb3a9750abb admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:06.672643 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b282c-08db-43bd-a092-feb3a9750abb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:06.672900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b282c-08db-43bd-a092-feb3a9750abb admin admin] PATH_INFO: `/v3/projects/bd5a09801ab74da6ad05361195157880/users/e8da663f92bc4901a10fce1977e2abdb/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:06.695536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b282c-08db-43bd-a092-feb3a9750abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5a09801ab74da6ad05361195157880, user_id=e8da663f92bc4901a10fce1977e2abdb, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:06.699293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b282c-08db-43bd-a092-feb3a9750abb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:06.797962 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1331/2689] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:05:06 2022] PUT /identity/v3/projects/bd5a09801ab74da6ad05361195157880/users/e8da663f92bc4901a10fce1977e2abdb/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:05:06.809608 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478a82e-43cd-48e9-92ca-ebe2f7a542b7 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:06.809608 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478a82e-43cd-48e9-92ca-ebe2f7a542b7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:06.809608 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478a82e-43cd-48e9-92ca-ebe2f7a542b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:06.838194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-5478a82e-43cd-48e9-92ca-ebe2f7a542b7 None None] MFA Rules not processed for user `e8da663f92bc4901a10fce1977e2abdb`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:06.839455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5478a82e-43cd-48e9-92ca-ebe2f7a542b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:06.859818 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:06.909383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1359/2690] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:06.914224 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b282c-08db-43bd-a092-feb3a9750abb admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:06.981842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b282c-08db-43bd-a092-feb3a9750abb admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:06.987920 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2468b-d74d-42dd-9ab1-b0178ec8f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:06.988682 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2468b-d74d-42dd-9ab1-b0178ec8f125 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:06.999073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2468b-d74d-42dd-9ab1-b0178ec8f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:06.999073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2468b-d74d-42dd-9ab1-b0178ec8f125 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:06.999073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2468b-d74d-42dd-9ab1-b0178ec8f125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:06.999073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2468b-d74d-42dd-9ab1-b0178ec8f125 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:07.111315 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1332/2691] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:05:06 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:05:07.116238 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478a82e-43cd-48e9-92ca-ebe2f7a542b7 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:07.127604 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478a82e-43cd-48e9-92ca-ebe2f7a542b7 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:07.188553 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf53474-2a4c-40b5-bb90-457739c860fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:07.189237 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf53474-2a4c-40b5-bb90-457739c860fc admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:07.189521 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf53474-2a4c-40b5-bb90-457739c860fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:07.189797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf53474-2a4c-40b5-bb90-457739c860fc admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:07.190494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf53474-2a4c-40b5-bb90-457739c860fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:07.192414 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf53474-2a4c-40b5-bb90-457739c860fc admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:07.296713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1360/2692] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:05:07 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:05:07.299953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2468b-d74d-42dd-9ab1-b0178ec8f125 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:07.312073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2468b-d74d-42dd-9ab1-b0178ec8f125 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:07.317296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e95216-ce92-496d-a1fc-3e19c255423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:07.317982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e95216-ce92-496d-a1fc-3e19c255423b admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:07.318271 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e95216-ce92-496d-a1fc-3e19c255423b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:07.319128 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e95216-ce92-496d-a1fc-3e19c255423b admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:07.319888 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e95216-ce92-496d-a1fc-3e19c255423b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:07.321936 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e95216-ce92-496d-a1fc-3e19c255423b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:07.340917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1333/2693] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:07.351561 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf53474-2a4c-40b5-bb90-457739c860fc admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:07.364657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf53474-2a4c-40b5-bb90-457739c860fc admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:07.371733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f6d98-3f3d-4559-90f3-7a7ae7b5f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:07.372684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f6d98-3f3d-4559-90f3-7a7ae7b5f482 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:07.372965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f6d98-3f3d-4559-90f3-7a7ae7b5f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:07.373239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f6d98-3f3d-4559-90f3-7a7ae7b5f482 admin admin] PATH_INFO: `/v3/projects/7dfed0225821420a9fea09228f1d1bd6/users/0725116925a543e2bf10212458286412/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:07.391306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f6d98-3f3d-4559-90f3-7a7ae7b5f482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfed0225821420a9fea09228f1d1bd6, user_id=0725116925a543e2bf10212458286412, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:07.394261 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f6d98-3f3d-4559-90f3-7a7ae7b5f482 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:07.494186 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1361/2694] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:05:07 2022] PUT /identity/v3/projects/7dfed0225821420a9fea09228f1d1bd6/users/0725116925a543e2bf10212458286412/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:07.498956 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e95216-ce92-496d-a1fc-3e19c255423b admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:07.509831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e95216-ce92-496d-a1fc-3e19c255423b admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:07.537549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:07.583846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9563ec1-4065-44a3-ba85-5bd3835c1dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:07.585291 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563ec1-4065-44a3-ba85-5bd3835c1dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:07.588606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563ec1-4065-44a3-ba85-5bd3835c1dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:07.588606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563ec1-4065-44a3-ba85-5bd3835c1dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:07.588606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9563ec1-4065-44a3-ba85-5bd3835c1dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:07.588606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9563ec1-4065-44a3-ba85-5bd3835c1dc0 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:07.599392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1334/2695] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:07.605402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f6d98-3f3d-4559-90f3-7a7ae7b5f482 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:07.619358 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f6d98-3f3d-4559-90f3-7a7ae7b5f482 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:07.626444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7fe63-1151-4b4a-99b1-2231afeaea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:07.627895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7fe63-1151-4b4a-99b1-2231afeaea0a admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:07.628319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7fe63-1151-4b4a-99b1-2231afeaea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:07.628649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7fe63-1151-4b4a-99b1-2231afeaea0a admin admin] PATH_INFO: `/v3/projects/7dfed0225821420a9fea09228f1d1bd6/users/0725116925a543e2bf10212458286412/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:07.631756 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7fe63-1151-4b4a-99b1-2231afeaea0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfed0225821420a9fea09228f1d1bd6, user_id=0725116925a543e2bf10212458286412, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:07.635983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7fe63-1151-4b4a-99b1-2231afeaea0a admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:07.654638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1362/2696] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:05:07 2022] PUT /identity/v3/projects/7dfed0225821420a9fea09228f1d1bd6/users/0725116925a543e2bf10212458286412/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:07.666657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f33c3-7347-4b37-9538-316910c9d1ba None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:07.666944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f33c3-7347-4b37-9538-316910c9d1ba None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:07.667227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f33c3-7347-4b37-9538-316910c9d1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:07.699344 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-ed6f33c3-7347-4b37-9538-316910c9d1ba None None] MFA Rules not processed for user `0725116925a543e2bf10212458286412`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:07.700609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ed6f33c3-7347-4b37-9538-316910c9d1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:07.784360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1335/2697] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:07.795671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7fe63-1151-4b4a-99b1-2231afeaea0a admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:07.797461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-dbd7fe63-1151-4b4a-99b1-2231afeaea0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:07.861760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7fe63-1151-4b4a-99b1-2231afeaea0a admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:07.865589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78b10e-0ed9-438b-8957-8c41aa3a0e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:07.866279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78b10e-0ed9-438b-8957-8c41aa3a0e88 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:07.866558 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78b10e-0ed9-438b-8957-8c41aa3a0e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:07.866832 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78b10e-0ed9-438b-8957-8c41aa3a0e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:07.876933 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78b10e-0ed9-438b-8957-8c41aa3a0e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:07.878442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78b10e-0ed9-438b-8957-8c41aa3a0e88 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:07.889470 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1363/2698] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:07.995341 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f33c3-7347-4b37-9538-316910c9d1ba None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:08.005208 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f33c3-7347-4b37-9538-316910c9d1ba None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:08.009039 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fefb5a-61e6-4f51-878c-1800f68608ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:08.009694 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fefb5a-61e6-4f51-878c-1800f68608ee service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:08.009976 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fefb5a-61e6-4f51-878c-1800f68608ee service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:08.010253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fefb5a-61e6-4f51-878c-1800f68608ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:08.070763 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fefb5a-61e6-4f51-878c-1800f68608ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:08.072229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fefb5a-61e6-4f51-878c-1800f68608ee service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:08.082185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1336/2699] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:12.306494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78b10e-0ed9-438b-8957-8c41aa3a0e88 service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:12.329417 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:12.385142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78b10e-0ed9-438b-8957-8c41aa3a0e88 service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:12.389720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:12.390620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:12.392293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:12.392293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] PATH_INFO: `/v3/users/e8da663f92bc4901a10fce1977e2abdb` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:12.392676 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8da663f92bc4901a10fce1977e2abdb)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:12.400036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:12.628153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8da663f92bc4901a10fce1977e2abdb'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:12.647565 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8da663f92bc4901a10fce1977e2abdb'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:12.656037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8da663f92bc4901a10fce1977e2abdb'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:12.778091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8da663f92bc4901a10fce1977e2abdb'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:12.778794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8da663f92bc4901a10fce1977e2abdb'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:12.786455 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1364/2700] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:12 2022] DELETE /identity/v3/users/e8da663f92bc4901a10fce1977e2abdb => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:12.793506 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b651cf-2acc-488a-839d-a03beb825580 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:12.794353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b651cf-2acc-488a-839d-a03beb825580 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:12.794535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b651cf-2acc-488a-839d-a03beb825580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:12.817789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-96b651cf-2acc-488a-839d-a03beb825580 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:12.819707 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-96b651cf-2acc-488a-839d-a03beb825580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:12.874347 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:12.906638 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1337/2701] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:12.916617 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:12.918299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:12.994427 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2dd80-5550-4c56-9f1e-96ca23c0441e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:12.998648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb868e9-9eea-4a11-be34-1626d1704b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:12.999359 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb868e9-9eea-4a11-be34-1626d1704b36 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:12.999646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb868e9-9eea-4a11-be34-1626d1704b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:12.999924 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb868e9-9eea-4a11-be34-1626d1704b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:13.012054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb868e9-9eea-4a11-be34-1626d1704b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:13.013599 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb868e9-9eea-4a11-be34-1626d1704b36 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:13.025309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1365/2702] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:13.513792 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b651cf-2acc-488a-839d-a03beb825580 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:13.515342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-96b651cf-2acc-488a-839d-a03beb825580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:13.533356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b651cf-2acc-488a-839d-a03beb825580 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:13.546180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:13.546180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:13.546180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:13.546180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] PATH_INFO: `/v3/projects/bd5a09801ab74da6ad05361195157880` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:13.546572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5a09801ab74da6ad05361195157880)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:13.546572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:13.672191 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5a09801ab74da6ad05361195157880', 'request_id': 'req-44bade94-160f-4b2d-a034-3d4df2009216'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:13.679283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5a09801ab74da6ad05361195157880', 'request_id': 'req-44bade94-160f-4b2d-a034-3d4df2009216'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:13.749828 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5a09801ab74da6ad05361195157880', 'request_id': 'req-44bade94-160f-4b2d-a034-3d4df2009216'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:13.764548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] The token cache is being invalidate because project bd5a09801ab74da6ad05361195157880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:13.764726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:13.765370 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:13.766985 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1338/2703] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:13 2022] DELETE /identity/v3/projects/bd5a09801ab74da6ad05361195157880 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:13.771336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb868e9-9eea-4a11-be34-1626d1704b36 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:13.782334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb868e9-9eea-4a11-be34-1626d1704b36 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:13.822830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:13.848635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:13.849585 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:13.849879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:13.850125 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] PATH_INFO: `/v3/users/0725116925a543e2bf10212458286412` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:13.851435 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0725116925a543e2bf10212458286412)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:13.853614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:14.134337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0725116925a543e2bf10212458286412'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:14.148493 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0725116925a543e2bf10212458286412'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:14.155734 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0725116925a543e2bf10212458286412'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:14.294803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0725116925a543e2bf10212458286412'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:14.295460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0725116925a543e2bf10212458286412'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:14.313898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1366/2704] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:13 2022] DELETE /identity/v3/users/0725116925a543e2bf10212458286412 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:05:14.874860 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:14.876739 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:14.889999 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bade94-160f-4b2d-a034-3d4df2009216 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:14.951860 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6431e9c-3f28-449e-a0d6-dca752ca7847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:14.952769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6431e9c-3f28-449e-a0d6-dca752ca7847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:14.953076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6431e9c-3f28-449e-a0d6-dca752ca7847 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:14.953340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6431e9c-3f28-449e-a0d6-dca752ca7847 admin admin] PATH_INFO: `/v3/projects/7dfed0225821420a9fea09228f1d1bd6` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:14.954580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6431e9c-3f28-449e-a0d6-dca752ca7847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dfed0225821420a9fea09228f1d1bd6)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:14.956559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6431e9c-3f28-449e-a0d6-dca752ca7847 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:15.017528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:15.019258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:15.078449 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769713c-18f5-4b04-8766-c8036f28b60d admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:15.082338 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39608b73-65b0-42d6-a15b-4f4aaa354691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:15.083000 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39608b73-65b0-42d6-a15b-4f4aaa354691 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:15.083285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39608b73-65b0-42d6-a15b-4f4aaa354691 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:15.083562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39608b73-65b0-42d6-a15b-4f4aaa354691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:15.086778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-39608b73-65b0-42d6-a15b-4f4aaa354691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:15.149168 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39608b73-65b0-42d6-a15b-4f4aaa354691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:15.150605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39608b73-65b0-42d6-a15b-4f4aaa354691 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:15.154780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e6431e9c-3f28-449e-a0d6-dca752ca7847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dfed0225821420a9fea09228f1d1bd6', 'request_id': 'req-e6431e9c-3f28-449e-a0d6-dca752ca7847'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:15.160910 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e6431e9c-3f28-449e-a0d6-dca752ca7847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dfed0225821420a9fea09228f1d1bd6', 'request_id': 'req-e6431e9c-3f28-449e-a0d6-dca752ca7847'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:15.161155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1367/2705] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:05:15.306244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e6431e9c-3f28-449e-a0d6-dca752ca7847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dfed0225821420a9fea09228f1d1bd6', 'request_id': 'req-e6431e9c-3f28-449e-a0d6-dca752ca7847'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:15.308970 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:15.321524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e6431e9c-3f28-449e-a0d6-dca752ca7847 admin admin] The token cache is being invalidate because project 7dfed0225821420a9fea09228f1d1bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:15.321901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e6431e9c-3f28-449e-a0d6-dca752ca7847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:15.323029 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-e6431e9c-3f28-449e-a0d6-dca752ca7847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:15.324789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1339/2706] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:14 2022] DELETE /identity/v3/projects/7dfed0225821420a9fea09228f1d1bd6 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:15.329878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34951fa-3f71-4a50-b64a-31c8edad94b1 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:15.330170 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34951fa-3f71-4a50-b64a-31c8edad94b1 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:15.330451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34951fa-3f71-4a50-b64a-31c8edad94b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:15.351020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b34951fa-3f71-4a50-b64a-31c8edad94b1 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:15.352317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b34951fa-3f71-4a50-b64a-31c8edad94b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:15.358301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:15.422809 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1368/2707] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:15.432131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab161e9a-8147-4669-bf73-1693d5d1e129 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:15.432420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab161e9a-8147-4669-bf73-1693d5d1e129 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:15.432851 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab161e9a-8147-4669-bf73-1693d5d1e129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:15.453858 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-ab161e9a-8147-4669-bf73-1693d5d1e129 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:15.455186 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ab161e9a-8147-4669-bf73-1693d5d1e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:15.464748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1340/2708] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:05:15.469051 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34951fa-3f71-4a50-b64a-31c8edad94b1 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:15.478815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34951fa-3f71-4a50-b64a-31c8edad94b1 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:15.483574 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996d9a5-403a-48ff-8539-2fe9082f4f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:15.484242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996d9a5-403a-48ff-8539-2fe9082f4f84 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:15.484554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996d9a5-403a-48ff-8539-2fe9082f4f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:15.484913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996d9a5-403a-48ff-8539-2fe9082f4f84 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:15.485584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996d9a5-403a-48ff-8539-2fe9082f4f84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:05:15.485989 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996d9a5-403a-48ff-8539-2fe9082f4f84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:15.487587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996d9a5-403a-48ff-8539-2fe9082f4f84 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:15.499792 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1369/2709] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:05:15.504015 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab161e9a-8147-4669-bf73-1693d5d1e129 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:15.517893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab161e9a-8147-4669-bf73-1693d5d1e129 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:15.527168 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cf6ac-651c-4d51-a30e-adac3f7b354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:15.528000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cf6ac-651c-4d51-a30e-adac3f7b354d admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:15.528619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cf6ac-651c-4d51-a30e-adac3f7b354d admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:15.529137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cf6ac-651c-4d51-a30e-adac3f7b354d admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:15.530589 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cf6ac-651c-4d51-a30e-adac3f7b354d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:15.534460 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cf6ac-651c-4d51-a30e-adac3f7b354d admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:15.644491 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1341/2710] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:05:15 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:05:15.649511 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996d9a5-403a-48ff-8539-2fe9082f4f84 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:15.659631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996d9a5-403a-48ff-8539-2fe9082f4f84 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:15.743644 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9ea6c-d2c7-40bc-afaf-6a8c16d1fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:15.744464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9ea6c-d2c7-40bc-afaf-6a8c16d1fdfb admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:15.744847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9ea6c-d2c7-40bc-afaf-6a8c16d1fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:15.745155 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9ea6c-d2c7-40bc-afaf-6a8c16d1fdfb admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:15.745967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9ea6c-d2c7-40bc-afaf-6a8c16d1fdfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:15.747942 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9ea6c-d2c7-40bc-afaf-6a8c16d1fdfb admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:15.921293 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1370/2711] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:05:15 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:15.925474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cf6ac-651c-4d51-a30e-adac3f7b354d admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:15.947501 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cf6ac-651c-4d51-a30e-adac3f7b354d admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:15.954944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae990b-1a9f-4072-aec5-6f67f346afa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:15.956030 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae990b-1a9f-4072-aec5-6f67f346afa9 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:15.956500 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae990b-1a9f-4072-aec5-6f67f346afa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:15.957001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae990b-1a9f-4072-aec5-6f67f346afa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:15.958220 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae990b-1a9f-4072-aec5-6f67f346afa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:15.961323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae990b-1a9f-4072-aec5-6f67f346afa9 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:15.981852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1342/2712] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:15.985905 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9ea6c-d2c7-40bc-afaf-6a8c16d1fdfb admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:15.997531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9ea6c-d2c7-40bc-afaf-6a8c16d1fdfb admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:16.002895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbe782-3783-44d0-9b65-5636034b4e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:16.009484 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbe782-3783-44d0-9b65-5636034b4e76 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:16.009484 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbe782-3783-44d0-9b65-5636034b4e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:16.009484 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbe782-3783-44d0-9b65-5636034b4e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:16.009484 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbe782-3783-44d0-9b65-5636034b4e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:16.009484 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbe782-3783-44d0-9b65-5636034b4e76 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:16.019895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1371/2713] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:16.024302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae990b-1a9f-4072-aec5-6f67f346afa9 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:16.034678 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae990b-1a9f-4072-aec5-6f67f346afa9 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:16.039695 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f914-554a-4265-abe3-14ff60d2ef1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:16.040659 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f914-554a-4265-abe3-14ff60d2ef1e admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:16.040938 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f914-554a-4265-abe3-14ff60d2ef1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:16.041216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f914-554a-4265-abe3-14ff60d2ef1e admin admin] PATH_INFO: `/v3/projects/5acfd7ee30534d5bb6f755dbdbc68537/users/bbf55ba753a941458dd268e2c09f8779/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:16.058271 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6f914-554a-4265-abe3-14ff60d2ef1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5acfd7ee30534d5bb6f755dbdbc68537, user_id=bbf55ba753a941458dd268e2c09f8779, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:16.061189 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6f914-554a-4265-abe3-14ff60d2ef1e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:16.282103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1343/2714] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:05:16 2022] PUT /identity/v3/projects/5acfd7ee30534d5bb6f755dbdbc68537/users/bbf55ba753a941458dd268e2c09f8779/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:05:16.293850 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac591b-1303-45a9-9e23-03c7d1a85c8d None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:16.294137 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac591b-1303-45a9-9e23-03c7d1a85c8d None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:16.294422 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac591b-1303-45a9-9e23-03c7d1a85c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:16.326346 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-d2ac591b-1303-45a9-9e23-03c7d1a85c8d None None] MFA Rules not processed for user `bbf55ba753a941458dd268e2c09f8779`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:16.327728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-d2ac591b-1303-45a9-9e23-03c7d1a85c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:16.454935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1372/2715] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:16.460407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f914-554a-4265-abe3-14ff60d2ef1e admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:16.575921 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f914-554a-4265-abe3-14ff60d2ef1e admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:16.581647 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d67ee-0f18-49c4-b8b5-e77d3f4b1dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:16.582333 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d67ee-0f18-49c4-b8b5-e77d3f4b1dcb admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:16.583300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d67ee-0f18-49c4-b8b5-e77d3f4b1dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:16.585059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d67ee-0f18-49c4-b8b5-e77d3f4b1dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:16.585059 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d67ee-0f18-49c4-b8b5-e77d3f4b1dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:16.587049 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d67ee-0f18-49c4-b8b5-e77d3f4b1dcb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:16.702670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1344/2716] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:05:16 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:05:16.707798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac591b-1303-45a9-9e23-03c7d1a85c8d None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:16.728078 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac591b-1303-45a9-9e23-03c7d1a85c8d None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:16.732816 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:16.809693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff235b-d299-4d97-b3a0-93964212c8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:16.810597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff235b-d299-4d97-b3a0-93964212c8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:16.810873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff235b-d299-4d97-b3a0-93964212c8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:16.811150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff235b-d299-4d97-b3a0-93964212c8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:16.811866 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff235b-d299-4d97-b3a0-93964212c8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:16.814273 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff235b-d299-4d97-b3a0-93964212c8f3 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:16.932185 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1373/2717] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:05:16 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:16.936419 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d67ee-0f18-49c4-b8b5-e77d3f4b1dcb admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:16.948380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d67ee-0f18-49c4-b8b5-e77d3f4b1dcb admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:16.953492 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e0db8-ee66-43a6-9ddd-8a46e74a6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:16.954300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e0db8-ee66-43a6-9ddd-8a46e74a6330 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:16.955196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e0db8-ee66-43a6-9ddd-8a46e74a6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:16.955196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e0db8-ee66-43a6-9ddd-8a46e74a6330 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:16.956146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e0db8-ee66-43a6-9ddd-8a46e74a6330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:16.958092 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e0db8-ee66-43a6-9ddd-8a46e74a6330 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:16.974454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1345/2718] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:16.976939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff235b-d299-4d97-b3a0-93964212c8f3 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:16.991859 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff235b-d299-4d97-b3a0-93964212c8f3 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:16.998901 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e11417-6ac1-42eb-86fe-9e52b8b8dfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:16.999881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e11417-6ac1-42eb-86fe-9e52b8b8dfc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:17.000191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e11417-6ac1-42eb-86fe-9e52b8b8dfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:17.000465 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e11417-6ac1-42eb-86fe-9e52b8b8dfc5 admin admin] PATH_INFO: `/v3/projects/99a3d4db6ec04cdc9ec286db58a72435/users/70e76d7b9975476991ff360d80040fdc/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:17.032823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e11417-6ac1-42eb-86fe-9e52b8b8dfc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a3d4db6ec04cdc9ec286db58a72435, user_id=70e76d7b9975476991ff360d80040fdc, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:17.032823 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e11417-6ac1-42eb-86fe-9e52b8b8dfc5 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:17.139563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1374/2719] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:05:16 2022] PUT /identity/v3/projects/99a3d4db6ec04cdc9ec286db58a72435/users/70e76d7b9975476991ff360d80040fdc/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:17.144350 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e0db8-ee66-43a6-9ddd-8a46e74a6330 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:17.155190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e0db8-ee66-43a6-9ddd-8a46e74a6330 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:17.226245 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1decf-4123-4f03-b5f9-a1bbc3f05535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:17.226934 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1decf-4123-4f03-b5f9-a1bbc3f05535 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:17.227222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1decf-4123-4f03-b5f9-a1bbc3f05535 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:17.227502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1decf-4123-4f03-b5f9-a1bbc3f05535 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:17.228292 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1decf-4123-4f03-b5f9-a1bbc3f05535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:17.229990 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1decf-4123-4f03-b5f9-a1bbc3f05535 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:17.241892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1346/2720] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:17.246259 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e11417-6ac1-42eb-86fe-9e52b8b8dfc5 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:17.258171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e11417-6ac1-42eb-86fe-9e52b8b8dfc5 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:17.263407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197c6d1-abfa-4f70-8739-686e1a05b2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:17.264433 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197c6d1-abfa-4f70-8739-686e1a05b2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:17.269099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197c6d1-abfa-4f70-8739-686e1a05b2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:17.269099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197c6d1-abfa-4f70-8739-686e1a05b2fc admin admin] PATH_INFO: `/v3/projects/99a3d4db6ec04cdc9ec286db58a72435/users/70e76d7b9975476991ff360d80040fdc/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:17.269099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197c6d1-abfa-4f70-8739-686e1a05b2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a3d4db6ec04cdc9ec286db58a72435, user_id=70e76d7b9975476991ff360d80040fdc, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:17.270344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197c6d1-abfa-4f70-8739-686e1a05b2fc admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:17.283191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1375/2721] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:05:17 2022] PUT /identity/v3/projects/99a3d4db6ec04cdc9ec286db58a72435/users/70e76d7b9975476991ff360d80040fdc/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:17.294803 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd90f9-ee5a-4556-9411-cb637440dc5f None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:17.295097 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd90f9-ee5a-4556-9411-cb637440dc5f None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:17.295414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd90f9-ee5a-4556-9411-cb637440dc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:17.305902 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:17.331230 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-aebd90f9-ee5a-4556-9411-cb637440dc5f None None] MFA Rules not processed for user `70e76d7b9975476991ff360d80040fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:17.332505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-aebd90f9-ee5a-4556-9411-cb637440dc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:17.420388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1347/2722] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:17.433536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197c6d1-abfa-4f70-8739-686e1a05b2fc admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:17.435420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f197c6d1-abfa-4f70-8739-686e1a05b2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:17.503956 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197c6d1-abfa-4f70-8739-686e1a05b2fc admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:17.503956 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cb5a-48a1-4a9e-b415-b218297d5439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:17.504443 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cb5a-48a1-4a9e-b415-b218297d5439 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:17.504739 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cb5a-48a1-4a9e-b415-b218297d5439 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:17.505015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cb5a-48a1-4a9e-b415-b218297d5439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:17.515682 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8cb5a-48a1-4a9e-b415-b218297d5439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:17.517209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8cb5a-48a1-4a9e-b415-b218297d5439 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:17.529210 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1376/2723] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:17.717213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd90f9-ee5a-4556-9411-cb637440dc5f None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:17.803157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd90f9-ee5a-4556-9411-cb637440dc5f None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:17.807742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:17.808738 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:17.809023 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:17.809332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] PATH_INFO: `/v3/users/bbf55ba753a941458dd268e2c09f8779` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:17.810588 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf55ba753a941458dd268e2c09f8779)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:17.812657 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:18.098493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf55ba753a941458dd268e2c09f8779'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:18.113709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf55ba753a941458dd268e2c09f8779'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:18.122380 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf55ba753a941458dd268e2c09f8779'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:18.275460 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf55ba753a941458dd268e2c09f8779'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:18.276202 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf55ba753a941458dd268e2c09f8779'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:18.284748 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1348/2724] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:17 2022] DELETE /identity/v3/users/bbf55ba753a941458dd268e2c09f8779 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:18.288301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de607f-686a-401f-9a6c-65c759c9d6d7 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:18.289226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de607f-686a-401f-9a6c-65c759c9d6d7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:18.289794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de607f-686a-401f-9a6c-65c759c9d6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:18.314826 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-11de607f-686a-401f-9a6c-65c759c9d6d7 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:18.316327 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-11de607f-686a-401f-9a6c-65c759c9d6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:18.422787 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1377/2725] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:18.435356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:18.436922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:18.448308 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:18.501573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83ef76-0d85-46a8-99f3-944d4055fa1e admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:18.508353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96264397-930c-40cf-838a-41468ab0f72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:18.508353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96264397-930c-40cf-838a-41468ab0f72e service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:18.508353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96264397-930c-40cf-838a-41468ab0f72e service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:18.508353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96264397-930c-40cf-838a-41468ab0f72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:18.517204 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96264397-930c-40cf-838a-41468ab0f72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:18.518687 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96264397-930c-40cf-838a-41468ab0f72e service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:18.532216 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1349/2726] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:19.008862 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de607f-686a-401f-9a6c-65c759c9d6d7 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:19.010370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-11de607f-686a-401f-9a6c-65c759c9d6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:19.018962 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:19.025279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de607f-686a-401f-9a6c-65c759c9d6d7 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:19.030476 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:19.031377 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:19.031655 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:19.031925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] PATH_INFO: `/v3/projects/5acfd7ee30534d5bb6f755dbdbc68537` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:19.033161 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5acfd7ee30534d5bb6f755dbdbc68537)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:19.035143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:19.190446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5acfd7ee30534d5bb6f755dbdbc68537', 'request_id': 'req-3952184a-8644-4927-ac13-8e00711ab77e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:19.197536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5acfd7ee30534d5bb6f755dbdbc68537', 'request_id': 'req-3952184a-8644-4927-ac13-8e00711ab77e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:19.204021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5acfd7ee30534d5bb6f755dbdbc68537', 'request_id': 'req-3952184a-8644-4927-ac13-8e00711ab77e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:19.292505 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] The token cache is being invalidate because project 5acfd7ee30534d5bb6f755dbdbc68537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:19.293218 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:19.293489 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:19.295077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1378/2727] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:19 2022] DELETE /identity/v3/projects/5acfd7ee30534d5bb6f755dbdbc68537 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:05:19.299353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96264397-930c-40cf-838a-41468ab0f72e service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:19.309358 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96264397-930c-40cf-838a-41468ab0f72e service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:19.406792 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53dadb-d367-41d7-b317-cc3d7288ae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:19.407907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53dadb-d367-41d7-b317-cc3d7288ae2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:19.408249 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53dadb-d367-41d7-b317-cc3d7288ae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:19.408620 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53dadb-d367-41d7-b317-cc3d7288ae2e admin admin] PATH_INFO: `/v3/users/70e76d7b9975476991ff360d80040fdc` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:19.409964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53dadb-d367-41d7-b317-cc3d7288ae2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e76d7b9975476991ff360d80040fdc)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:19.412159 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53dadb-d367-41d7-b317-cc3d7288ae2e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:19.690267 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6d53dadb-d367-41d7-b317-cc3d7288ae2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e76d7b9975476991ff360d80040fdc'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:19.703784 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6d53dadb-d367-41d7-b317-cc3d7288ae2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e76d7b9975476991ff360d80040fdc'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:19.714549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6d53dadb-d367-41d7-b317-cc3d7288ae2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e76d7b9975476991ff360d80040fdc'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:19.835845 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6d53dadb-d367-41d7-b317-cc3d7288ae2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e76d7b9975476991ff360d80040fdc'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:19.836572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-6d53dadb-d367-41d7-b317-cc3d7288ae2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e76d7b9975476991ff360d80040fdc'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:19.845222 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1350/2728] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:19 2022] DELETE /identity/v3/users/70e76d7b9975476991ff360d80040fdc => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:20.663971 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:20.665671 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:20.682230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952184a-8644-4927-ac13-8e00711ab77e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:20.755049 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07b7ca-df30-42c5-9839-88cb18b5058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:20.755940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07b7ca-df30-42c5-9839-88cb18b5058c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:20.756229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07b7ca-df30-42c5-9839-88cb18b5058c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:20.756632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07b7ca-df30-42c5-9839-88cb18b5058c admin admin] PATH_INFO: `/v3/projects/99a3d4db6ec04cdc9ec286db58a72435` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:20.757910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07b7ca-df30-42c5-9839-88cb18b5058c admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a3d4db6ec04cdc9ec286db58a72435)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:20.759872 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07b7ca-df30-42c5-9839-88cb18b5058c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:20.934002 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-db07b7ca-df30-42c5-9839-88cb18b5058c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a3d4db6ec04cdc9ec286db58a72435', 'request_id': 'req-db07b7ca-df30-42c5-9839-88cb18b5058c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:20.941206 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-db07b7ca-df30-42c5-9839-88cb18b5058c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a3d4db6ec04cdc9ec286db58a72435', 'request_id': 'req-db07b7ca-df30-42c5-9839-88cb18b5058c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:20.947182 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-db07b7ca-df30-42c5-9839-88cb18b5058c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a3d4db6ec04cdc9ec286db58a72435', 'request_id': 'req-db07b7ca-df30-42c5-9839-88cb18b5058c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:21.129245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-db07b7ca-df30-42c5-9839-88cb18b5058c admin admin] The token cache is being invalidate because project 99a3d4db6ec04cdc9ec286db58a72435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:21.129461 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-db07b7ca-df30-42c5-9839-88cb18b5058c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:21.130112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-db07b7ca-df30-42c5-9839-88cb18b5058c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:21.132347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1379/2729] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:20 2022] DELETE /identity/v3/projects/99a3d4db6ec04cdc9ec286db58a72435 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:21.137674 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41088d8a-ae78-4c4f-a818-c56234a5650c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:21.138194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41088d8a-ae78-4c4f-a818-c56234a5650c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:21.138194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41088d8a-ae78-4c4f-a818-c56234a5650c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:21.179688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:21.190998 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-41088d8a-ae78-4c4f-a818-c56234a5650c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:21.192223 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-41088d8a-ae78-4c4f-a818-c56234a5650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:21.326873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1351/2730] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:21.336637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341be0a8-6250-412e-8d7f-fefb5aa81d85 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:21.336932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341be0a8-6250-412e-8d7f-fefb5aa81d85 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:21.337240 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341be0a8-6250-412e-8d7f-fefb5aa81d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:21.363778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-341be0a8-6250-412e-8d7f-fefb5aa81d85 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:21.365050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-341be0a8-6250-412e-8d7f-fefb5aa81d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:21.373235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1380/2731] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:05:21.377726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41088d8a-ae78-4c4f-a818-c56234a5650c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:21.387934 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41088d8a-ae78-4c4f-a818-c56234a5650c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:21.396290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748ed30-eeb4-4d34-8aee-0fad134d9ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:21.396413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748ed30-eeb4-4d34-8aee-0fad134d9ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:21.397454 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748ed30-eeb4-4d34-8aee-0fad134d9ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:21.397745 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748ed30-eeb4-4d34-8aee-0fad134d9ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:21.398502 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748ed30-eeb4-4d34-8aee-0fad134d9ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87026) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:05:21.398812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748ed30-eeb4-4d34-8aee-0fad134d9ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:21.400504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748ed30-eeb4-4d34-8aee-0fad134d9ce1 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:21.413576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1352/2732] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:05:21.421175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341be0a8-6250-412e-8d7f-fefb5aa81d85 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:21.431410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341be0a8-6250-412e-8d7f-fefb5aa81d85 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:21.436457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926a49a-6a03-4783-8a27-132272dbee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:21.437258 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926a49a-6a03-4783-8a27-132272dbee8f admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:21.437441 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926a49a-6a03-4783-8a27-132272dbee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:21.437695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926a49a-6a03-4783-8a27-132272dbee8f admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:21.438383 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926a49a-6a03-4783-8a27-132272dbee8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:21.440931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926a49a-6a03-4783-8a27-132272dbee8f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:21.445950 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:21.613252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1381/2733] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:05:21 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:21.613469 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748ed30-eeb4-4d34-8aee-0fad134d9ce1 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:21.634357 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748ed30-eeb4-4d34-8aee-0fad134d9ce1 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:21.793504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e86db3-c065-4f9e-8c98-770225e6fe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:21.794209 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e86db3-c065-4f9e-8c98-770225e6fe80 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:21.794567 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e86db3-c065-4f9e-8c98-770225e6fe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:21.794918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e86db3-c065-4f9e-8c98-770225e6fe80 admin admin] PATH_INFO: `/v3/users` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:21.795769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e86db3-c065-4f9e-8c98-770225e6fe80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:21.799963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e86db3-c065-4f9e-8c98-770225e6fe80 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:21.924953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1353/2734] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:05:21 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:21.930263 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926a49a-6a03-4783-8a27-132272dbee8f admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:21.942740 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926a49a-6a03-4783-8a27-132272dbee8f admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:21.949400 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ec6bf-e388-49da-9dc6-6598744ef274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:21.950421 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ec6bf-e388-49da-9dc6-6598744ef274 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:21.951109 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ec6bf-e388-49da-9dc6-6598744ef274 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:21.952073 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ec6bf-e388-49da-9dc6-6598744ef274 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:21.953040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ec6bf-e388-49da-9dc6-6598744ef274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:21.959835 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ec6bf-e388-49da-9dc6-6598744ef274 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:21.970859 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1382/2735] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:21.974559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e86db3-c065-4f9e-8c98-770225e6fe80 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:21.989206 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e86db3-c065-4f9e-8c98-770225e6fe80 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:21.995678 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc33b22-7c4c-4a60-b2b1-35fd71ca8d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:21.996989 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc33b22-7c4c-4a60-b2b1-35fd71ca8d22 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:21.997112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc33b22-7c4c-4a60-b2b1-35fd71ca8d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:21.997353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc33b22-7c4c-4a60-b2b1-35fd71ca8d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:22.005280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc33b22-7c4c-4a60-b2b1-35fd71ca8d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:22.028158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc33b22-7c4c-4a60-b2b1-35fd71ca8d22 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:22.044165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1354/2736] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:05:22.045403 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ec6bf-e388-49da-9dc6-6598744ef274 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:22.059453 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ec6bf-e388-49da-9dc6-6598744ef274 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:22.070129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969e4d5-f88f-4548-8115-c8d6df451d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:22.071188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969e4d5-f88f-4548-8115-c8d6df451d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:22.071548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969e4d5-f88f-4548-8115-c8d6df451d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:22.071891 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969e4d5-f88f-4548-8115-c8d6df451d4f admin admin] PATH_INFO: `/v3/projects/6812876596724fdeadc8687ccd947f31/users/a616a4c4612541d9ba31d4926f293f67/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:22.090942 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969e4d5-f88f-4548-8115-c8d6df451d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6812876596724fdeadc8687ccd947f31, user_id=a616a4c4612541d9ba31d4926f293f67, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:22.093751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969e4d5-f88f-4548-8115-c8d6df451d4f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:22.231262 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1383/2737] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:05:22 2022] PUT /identity/v3/projects/6812876596724fdeadc8687ccd947f31/users/a616a4c4612541d9ba31d4926f293f67/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:22.242623 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638d40c-5715-4a4e-8e8b-68ffb185904c None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:22.243196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638d40c-5715-4a4e-8e8b-68ffb185904c None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:22.243196 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638d40c-5715-4a4e-8e8b-68ffb185904c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:22.309764 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-c638d40c-5715-4a4e-8e8b-68ffb185904c None None] MFA Rules not processed for user `a616a4c4612541d9ba31d4926f293f67`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:22.311312 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c638d40c-5715-4a4e-8e8b-68ffb185904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:22.413830 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:22.418433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1355/2738] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:22.432424 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969e4d5-f88f-4548-8115-c8d6df451d4f admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:22.434497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2969e4d5-f88f-4548-8115-c8d6df451d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:22.525581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969e4d5-f88f-4548-8115-c8d6df451d4f admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:22.533050 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f667-02b8-4936-8987-3f7694454116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:22.533845 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f667-02b8-4936-8987-3f7694454116 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:22.534205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f667-02b8-4936-8987-3f7694454116 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:22.537935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f667-02b8-4936-8987-3f7694454116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:22.556677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6f667-02b8-4936-8987-3f7694454116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:22.558643 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6f667-02b8-4936-8987-3f7694454116 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:22.583324 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1384/2739] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:24.413322 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638d40c-5715-4a4e-8e8b-68ffb185904c None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:24.415257 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c638d40c-5715-4a4e-8e8b-68ffb185904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:24.480024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638d40c-5715-4a4e-8e8b-68ffb185904c None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:24.483603 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f47da-d5d4-4ef1-8212-e6c04fcce416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:24.484250 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f47da-d5d4-4ef1-8212-e6c04fcce416 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:24.484572 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f47da-d5d4-4ef1-8212-e6c04fcce416 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:24.484914 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f47da-d5d4-4ef1-8212-e6c04fcce416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:24.486763 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3a3f47da-d5d4-4ef1-8212-e6c04fcce416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:24.557579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f47da-d5d4-4ef1-8212-e6c04fcce416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:24.559171 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f47da-d5d4-4ef1-8212-e6c04fcce416 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:24.569744 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1356/2740] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:27.010915 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f667-02b8-4936-8987-3f7694454116 service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:27.028764 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f667-02b8-4936-8987-3f7694454116 service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:27.041342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719f6cb-99dd-4679-82dd-17b42ba6afb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:27.042088 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719f6cb-99dd-4679-82dd-17b42ba6afb3 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:27.042372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719f6cb-99dd-4679-82dd-17b42ba6afb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:27.042692 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719f6cb-99dd-4679-82dd-17b42ba6afb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:27.044781 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c719f6cb-99dd-4679-82dd-17b42ba6afb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:27.080947 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719f6cb-99dd-4679-82dd-17b42ba6afb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:27.082408 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719f6cb-99dd-4679-82dd-17b42ba6afb3 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:27.100936 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1385/2741] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:27.676653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f47da-d5d4-4ef1-8212-e6c04fcce416 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:27.679772 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3a3f47da-d5d4-4ef1-8212-e6c04fcce416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:27.705808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f47da-d5d4-4ef1-8212-e6c04fcce416 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:27.715358 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62030471-3785-483a-8166-c5272667c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:27.717180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62030471-3785-483a-8166-c5272667c938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:27.718414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62030471-3785-483a-8166-c5272667c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:27.718863 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62030471-3785-483a-8166-c5272667c938 admin admin] PATH_INFO: `/v3/users/1f5545040b13431598627faccd5ba4a5` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:27.728968 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62030471-3785-483a-8166-c5272667c938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5545040b13431598627faccd5ba4a5)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:27.730948 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62030471-3785-483a-8166-c5272667c938 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:28.014338 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-62030471-3785-483a-8166-c5272667c938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5545040b13431598627faccd5ba4a5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:28.038853 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-62030471-3785-483a-8166-c5272667c938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5545040b13431598627faccd5ba4a5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:28.073785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-62030471-3785-483a-8166-c5272667c938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5545040b13431598627faccd5ba4a5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:28.148438 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-62030471-3785-483a-8166-c5272667c938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5545040b13431598627faccd5ba4a5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:28.150270 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-62030471-3785-483a-8166-c5272667c938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5545040b13431598627faccd5ba4a5'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:28.165641 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1357/2742] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:27 2022] DELETE /identity/v3/users/1f5545040b13431598627faccd5ba4a5 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:28.561663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719f6cb-99dd-4679-82dd-17b42ba6afb3 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:28.581753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719f6cb-99dd-4679-82dd-17b42ba6afb3 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:28.728325 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:28.729335 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:28.729678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:28.729934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] PATH_INFO: `/v3/projects/91b59465a0ef4cd9ac238f42d5995e03` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:28.731528 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b59465a0ef4cd9ac238f42d5995e03)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:28.734428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:28.938485 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:28.949520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b59465a0ef4cd9ac238f42d5995e03', 'request_id': 'req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:28.963326 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b59465a0ef4cd9ac238f42d5995e03', 'request_id': 'req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:28.979623 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b59465a0ef4cd9ac238f42d5995e03', 'request_id': 'req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:29.129248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] The token cache is being invalidate because project 91b59465a0ef4cd9ac238f42d5995e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:29.129611 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:29.130309 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:29.133361 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1386/2743] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:28 2022] DELETE /identity/v3/projects/91b59465a0ef4cd9ac238f42d5995e03 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:29.137585 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62030471-3785-483a-8166-c5272667c938 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:29.139861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-62030471-3785-483a-8166-c5272667c938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:29.157773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62030471-3785-483a-8166-c5272667c938 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:29.191169 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:29.285646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:29.308055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:29.309266 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:29.310816 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] PATH_INFO: `/v3/users/edd26c2f366b4df5aae9f5d4e205647f` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:29.315878 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd26c2f366b4df5aae9f5d4e205647f)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:29.318498 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:29.579046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd26c2f366b4df5aae9f5d4e205647f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:29.595905 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd26c2f366b4df5aae9f5d4e205647f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:29.614653 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd26c2f366b4df5aae9f5d4e205647f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:29.751941 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd26c2f366b4df5aae9f5d4e205647f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:29.755783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd26c2f366b4df5aae9f5d4e205647f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:29.769122 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1358/2744] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:29 2022] DELETE /identity/v3/users/edd26c2f366b4df5aae9f5d4e205647f => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:30.553750 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:30.556963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:30.586642 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65a2fc-89fa-41f0-ba14-c8220b8df9c1 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:30.685763 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89198f8-cf7e-414f-adc3-00884a22fb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:30.686666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89198f8-cf7e-414f-adc3-00884a22fb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:30.687033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89198f8-cf7e-414f-adc3-00884a22fb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:30.687375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89198f8-cf7e-414f-adc3-00884a22fb76 admin admin] PATH_INFO: `/v3/projects/26eaeb60defa46eb854c1fd74276a581` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:30.688976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89198f8-cf7e-414f-adc3-00884a22fb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26eaeb60defa46eb854c1fd74276a581)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:30.690970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89198f8-cf7e-414f-adc3-00884a22fb76 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:30.870447 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e89198f8-cf7e-414f-adc3-00884a22fb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26eaeb60defa46eb854c1fd74276a581', 'request_id': 'req-e89198f8-cf7e-414f-adc3-00884a22fb76'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:30.877242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:30.878753 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:30.879439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e89198f8-cf7e-414f-adc3-00884a22fb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26eaeb60defa46eb854c1fd74276a581', 'request_id': 'req-e89198f8-cf7e-414f-adc3-00884a22fb76'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:30.888178 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e89198f8-cf7e-414f-adc3-00884a22fb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26eaeb60defa46eb854c1fd74276a581', 'request_id': 'req-e89198f8-cf7e-414f-adc3-00884a22fb76'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:30.894562 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a9f73-8176-49ae-ad64-87739b830407 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:30.962665 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85217ab3-16a8-4f27-9d03-4574f8344140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:30.963648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217ab3-16a8-4f27-9d03-4574f8344140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:30.964010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217ab3-16a8-4f27-9d03-4574f8344140 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:30.964403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217ab3-16a8-4f27-9d03-4574f8344140 admin admin] PATH_INFO: `/v3/users/a616a4c4612541d9ba31d4926f293f67` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:30.965958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85217ab3-16a8-4f27-9d03-4574f8344140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a616a4c4612541d9ba31d4926f293f67)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:30.967944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85217ab3-16a8-4f27-9d03-4574f8344140 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:31.000925 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e89198f8-cf7e-414f-adc3-00884a22fb76 admin admin] The token cache is being invalidate because project 26eaeb60defa46eb854c1fd74276a581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:31.001323 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e89198f8-cf7e-414f-adc3-00884a22fb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:31.002005 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-e89198f8-cf7e-414f-adc3-00884a22fb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:31.003587 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1387/2745] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:30 2022] DELETE /identity/v3/projects/26eaeb60defa46eb854c1fd74276a581 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:31.010368 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66e583-c80e-41fe-9d36-4b1fcf166021 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:31.010625 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66e583-c80e-41fe-9d36-4b1fcf166021 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:31.011093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66e583-c80e-41fe-9d36-4b1fcf166021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:31.042297 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-7e66e583-c80e-41fe-9d36-4b1fcf166021 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:31.047656 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-7e66e583-c80e-41fe-9d36-4b1fcf166021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:31.074153 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1388/2746] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:05:31.080034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e56578-1fc6-47aa-b675-f67881ae76af None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:31.080382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e56578-1fc6-47aa-b675-f67881ae76af None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:31.080772 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e56578-1fc6-47aa-b675-f67881ae76af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:31.120432 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-59e56578-1fc6-47aa-b675-f67881ae76af None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:31.122833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-59e56578-1fc6-47aa-b675-f67881ae76af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:31.136555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1389/2747] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:31.145479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e56578-1fc6-47aa-b675-f67881ae76af None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:31.156640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e56578-1fc6-47aa-b675-f67881ae76af None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:31.161822 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee9401-bee3-40ae-98bf-2f424b6d5edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:31.163530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee9401-bee3-40ae-98bf-2f424b6d5edb admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:31.163878 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee9401-bee3-40ae-98bf-2f424b6d5edb admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:31.164162 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee9401-bee3-40ae-98bf-2f424b6d5edb admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:31.164985 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee9401-bee3-40ae-98bf-2f424b6d5edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:05:31.165329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee9401-bee3-40ae-98bf-2f424b6d5edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:31.167254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee9401-bee3-40ae-98bf-2f424b6d5edb admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:31.188559 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1390/2748] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:05:31.189903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee9401-bee3-40ae-98bf-2f424b6d5edb admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:31.215029 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee9401-bee3-40ae-98bf-2f424b6d5edb admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:31.226756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:31.226994 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1611050-fb18-4244-bd10-a5c3e31dd245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:31.227817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611050-fb18-4244-bd10-a5c3e31dd245 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:31.228131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611050-fb18-4244-bd10-a5c3e31dd245 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:31.228531 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611050-fb18-4244-bd10-a5c3e31dd245 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:31.229254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1611050-fb18-4244-bd10-a5c3e31dd245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:31.231855 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-85217ab3-16a8-4f27-9d03-4574f8344140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a616a4c4612541d9ba31d4926f293f67'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:31.232649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1611050-fb18-4244-bd10-a5c3e31dd245 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:31.254731 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-85217ab3-16a8-4f27-9d03-4574f8344140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a616a4c4612541d9ba31d4926f293f67'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:31.268967 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-85217ab3-16a8-4f27-9d03-4574f8344140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a616a4c4612541d9ba31d4926f293f67'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:31.386434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-85217ab3-16a8-4f27-9d03-4574f8344140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a616a4c4612541d9ba31d4926f293f67'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:31.386434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-85217ab3-16a8-4f27-9d03-4574f8344140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a616a4c4612541d9ba31d4926f293f67'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:31.386630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1391/2750] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:05:31 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:05:31.387456 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1359/2750] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:30 2022] DELETE /identity/v3/users/a616a4c4612541d9ba31d4926f293f67 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:05:31.388199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1611050-fb18-4244-bd10-a5c3e31dd245 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:31.391959 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a1611050-fb18-4244-bd10-a5c3e31dd245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:31.404684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8bc2-7138-460e-8540-c87b7eccfe6e None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:31.405018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8bc2-7138-460e-8540-c87b7eccfe6e None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:31.405299 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8bc2-7138-460e-8540-c87b7eccfe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:31.437221 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-6fde8bc2-7138-460e-8540-c87b7eccfe6e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:31.443173 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6fde8bc2-7138-460e-8540-c87b7eccfe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:31.482257 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:31.544684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1360/2751] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:31.545825 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde8bc2-7138-460e-8540-c87b7eccfe6e None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:31.549429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6fde8bc2-7138-460e-8540-c87b7eccfe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:31.653000 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde8bc2-7138-460e-8540-c87b7eccfe6e None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:31.658234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c50f16-e144-480b-9495-1e705df9bedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:31.659294 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c50f16-e144-480b-9495-1e705df9bedd service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:31.659754 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c50f16-e144-480b-9495-1e705df9bedd service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:31.660034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c50f16-e144-480b-9495-1e705df9bedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:31.671904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1611050-fb18-4244-bd10-a5c3e31dd245 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:31.673821 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c50f16-e144-480b-9495-1e705df9bedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:31.675602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c50f16-e144-480b-9495-1e705df9bedd service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:31.677984 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7edee-6f05-4dbd-b658-a42619a0f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:31.679517 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7edee-6f05-4dbd-b658-a42619a0f6ba admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:31.679814 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7edee-6f05-4dbd-b658-a42619a0f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:31.680136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7edee-6f05-4dbd-b658-a42619a0f6ba admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:31.680881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7edee-6f05-4dbd-b658-a42619a0f6ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:31.683780 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7edee-6f05-4dbd-b658-a42619a0f6ba admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:31.688549 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1361/2752] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:31.843568 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1392/2753] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:05:31 2022] POST /identity/v3/users => generated 288 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:31.845005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c50f16-e144-480b-9495-1e705df9bedd service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:31.857205 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c50f16-e144-480b-9495-1e705df9bedd service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:31.862021 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337adf14-de77-4f5a-854f-76d1d039af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:31.862690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337adf14-de77-4f5a-854f-76d1d039af3c admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:31.863105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337adf14-de77-4f5a-854f-76d1d039af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:31.863381 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337adf14-de77-4f5a-854f-76d1d039af3c admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:31.864713 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337adf14-de77-4f5a-854f-76d1d039af3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:31.866558 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337adf14-de77-4f5a-854f-76d1d039af3c admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:31.878859 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1362/2754] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:31.889324 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7edee-6f05-4dbd-b658-a42619a0f6ba admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:31.897289 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7edee-6f05-4dbd-b658-a42619a0f6ba admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:31.902429 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3495e-2eb9-4c95-b39b-8156a41abea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:31.903099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3495e-2eb9-4c95-b39b-8156a41abea9 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:31.903384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3495e-2eb9-4c95-b39b-8156a41abea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:31.903663 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3495e-2eb9-4c95-b39b-8156a41abea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:31.904390 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3495e-2eb9-4c95-b39b-8156a41abea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:31.906037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3495e-2eb9-4c95-b39b-8156a41abea9 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:31.919727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1393/2755] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:31.924140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337adf14-de77-4f5a-854f-76d1d039af3c admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:31.935574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337adf14-de77-4f5a-854f-76d1d039af3c admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:31.941776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe7ea7-1c22-4f5f-ad71-0b1685b8ca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:31.945040 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe7ea7-1c22-4f5f-ad71-0b1685b8ca1d admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:31.945246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe7ea7-1c22-4f5f-ad71-0b1685b8ca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:31.951595 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe7ea7-1c22-4f5f-ad71-0b1685b8ca1d admin admin] PATH_INFO: `/v3/projects/3cc3746c0e7c4255a50a9ebb95465d98/users/3d148fb1fa0e4891a96a80f094acda5b/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:31.971669 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe7ea7-1c22-4f5f-ad71-0b1685b8ca1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc3746c0e7c4255a50a9ebb95465d98, user_id=3d148fb1fa0e4891a96a80f094acda5b, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:31.975269 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe7ea7-1c22-4f5f-ad71-0b1685b8ca1d admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:32.089661 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1363/2756] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:05:31 2022] PUT /identity/v3/projects/3cc3746c0e7c4255a50a9ebb95465d98/users/3d148fb1fa0e4891a96a80f094acda5b/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:05:32.101363 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840f68e-21ee-4eb4-837b-7430920441c9 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:32.106662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840f68e-21ee-4eb4-837b-7430920441c9 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:32.106662 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840f68e-21ee-4eb4-837b-7430920441c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:32.134171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-c840f68e-21ee-4eb4-837b-7430920441c9 None None] MFA Rules not processed for user `3d148fb1fa0e4891a96a80f094acda5b`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:32.135413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c840f68e-21ee-4eb4-837b-7430920441c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:32.177646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe7ea7-1c22-4f5f-ad71-0b1685b8ca1d admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:32.180773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-7abe7ea7-1c22-4f5f-ad71-0b1685b8ca1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:32.237066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:32.248582 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1394/2757] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:32.252308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840f68e-21ee-4eb4-837b-7430920441c9 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:32.254034 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c840f68e-21ee-4eb4-837b-7430920441c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:32.285716 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe7ea7-1c22-4f5f-ad71-0b1685b8ca1d admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:32.291433 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:32.292332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:32.292666 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:32.292978 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] PATH_INFO: `/v3/projects/6812876596724fdeadc8687ccd947f31` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:32.294180 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6812876596724fdeadc8687ccd947f31)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:32.296505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:32.327175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840f68e-21ee-4eb4-837b-7430920441c9 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:32.331296 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512eeecb-0210-412b-96f5-a6c38851f517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:32.331963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eeecb-0210-412b-96f5-a6c38851f517 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:32.332249 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eeecb-0210-412b-96f5-a6c38851f517 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:32.332551 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eeecb-0210-412b-96f5-a6c38851f517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:32.343382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512eeecb-0210-412b-96f5-a6c38851f517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:32.345144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512eeecb-0210-412b-96f5-a6c38851f517 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:32.355827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1395/2758] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:05:32.442834 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6812876596724fdeadc8687ccd947f31', 'request_id': 'req-be12b775-52b1-4d39-9f2a-c1349d781582'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:32.449802 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6812876596724fdeadc8687ccd947f31', 'request_id': 'req-be12b775-52b1-4d39-9f2a-c1349d781582'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:32.532609 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6812876596724fdeadc8687ccd947f31', 'request_id': 'req-be12b775-52b1-4d39-9f2a-c1349d781582'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:32.548078 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] The token cache is being invalidate because project 6812876596724fdeadc8687ccd947f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:32.548593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:32.550005 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:32.552522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1364/2759] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:32 2022] DELETE /identity/v3/projects/6812876596724fdeadc8687ccd947f31 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:32.560131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b72c7f-3084-4c14-b33f-1fc3f5ad6bd3 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:32.560695 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b72c7f-3084-4c14-b33f-1fc3f5ad6bd3 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:32.561386 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b72c7f-3084-4c14-b33f-1fc3f5ad6bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:32.581561 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-64b72c7f-3084-4c14-b33f-1fc3f5ad6bd3 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:32.582705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-64b72c7f-3084-4c14-b33f-1fc3f5ad6bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:32.605069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:32.624009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:32.625568 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:32.678884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1396/2760] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:32.680529 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572824e3-4664-4c0d-b0c0-7972f4aebca0 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:32.680818 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572824e3-4664-4c0d-b0c0-7972f4aebca0 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:32.681098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572824e3-4664-4c0d-b0c0-7972f4aebca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:32.701921 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-572824e3-4664-4c0d-b0c0-7972f4aebca0 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:32.703300 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-572824e3-4664-4c0d-b0c0-7972f4aebca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:32.715991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1397/2761] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:32.717101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572824e3-4664-4c0d-b0c0-7972f4aebca0 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:32.727492 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572824e3-4664-4c0d-b0c0-7972f4aebca0 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:32.732450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c9478-e649-4556-9a86-a972327b1d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:32.743971 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12b775-52b1-4d39-9f2a-c1349d781582 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:32.744150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9478-e649-4556-9a86-a972327b1d9b admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:32.744150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9478-e649-4556-9a86-a972327b1d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:32.744150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9478-e649-4556-9a86-a972327b1d9b admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:32.744150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c9478-e649-4556-9a86-a972327b1d9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:05:32.744150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c9478-e649-4556-9a86-a972327b1d9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:32.744150 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c9478-e649-4556-9a86-a972327b1d9b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:32.744727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:32.744727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:32.744727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:32.744727 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] PATH_INFO: `/v3/users/f1d5e5f7ad994b8481b8c5e885db1739` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:32.748198 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d5e5f7ad994b8481b8c5e885db1739)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:32.750217 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:32.752451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1398/2762] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:05:32.757948 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c9478-e649-4556-9a86-a972327b1d9b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:32.772728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c9478-e649-4556-9a86-a972327b1d9b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:32.784204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02cb0d-ed2b-4a22-a594-8b8be25dd2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:32.785009 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02cb0d-ed2b-4a22-a594-8b8be25dd2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:32.785324 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02cb0d-ed2b-4a22-a594-8b8be25dd2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:32.785634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02cb0d-ed2b-4a22-a594-8b8be25dd2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:32.786342 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02cb0d-ed2b-4a22-a594-8b8be25dd2f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:32.789762 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02cb0d-ed2b-4a22-a594-8b8be25dd2f4 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:32.965847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1399/2763] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:05:32 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:32.970085 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02cb0d-ed2b-4a22-a594-8b8be25dd2f4 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:32.997351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d5e5f7ad994b8481b8c5e885db1739'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:33.026420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d5e5f7ad994b8481b8c5e885db1739'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:33.038537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d5e5f7ad994b8481b8c5e885db1739'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:33.083279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02cb0d-ed2b-4a22-a594-8b8be25dd2f4 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:33.088641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9d345-e1a2-4f85-8e24-7a68251fdb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:33.089254 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9d345-e1a2-4f85-8e24-7a68251fdb8f admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:33.089547 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9d345-e1a2-4f85-8e24-7a68251fdb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:33.089960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9d345-e1a2-4f85-8e24-7a68251fdb8f admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:33.090729 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9d345-e1a2-4f85-8e24-7a68251fdb8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:33.092680 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9d345-e1a2-4f85-8e24-7a68251fdb8f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:33.141295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d5e5f7ad994b8481b8c5e885db1739'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:33.142028 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d5e5f7ad994b8481b8c5e885db1739'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:33.149546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1365/2764] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:32 2022] DELETE /identity/v3/users/f1d5e5f7ad994b8481b8c5e885db1739 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:33.214119 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1400/2765] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:05:32 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 18:05:33.218283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:33.220095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:33.333261 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529510d-9d33-47bc-843b-60fd7792cef5 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:33.344918 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:33.348185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2420e45-24a8-4793-807f-07b13a3f8a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:33.349137 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2420e45-24a8-4793-807f-07b13a3f8a13 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:33.349590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2420e45-24a8-4793-807f-07b13a3f8a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:33.350896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2420e45-24a8-4793-807f-07b13a3f8a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:33.351844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2420e45-24a8-4793-807f-07b13a3f8a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:33.353857 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2420e45-24a8-4793-807f-07b13a3f8a13 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:33.374813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9d345-e1a2-4f85-8e24-7a68251fdb8f admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:33.387397 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9d345-e1a2-4f85-8e24-7a68251fdb8f admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:33.390663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1366/2766] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:33.401581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66e8cf-ef24-4184-a86e-55f6a07e0f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:33.402280 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66e8cf-ef24-4184-a86e-55f6a07e0f5f admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:33.402577 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66e8cf-ef24-4184-a86e-55f6a07e0f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:33.402847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66e8cf-ef24-4184-a86e-55f6a07e0f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:33.403623 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66e8cf-ef24-4184-a86e-55f6a07e0f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:33.407179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66e8cf-ef24-4184-a86e-55f6a07e0f5f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:33.439131 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2420e45-24a8-4793-807f-07b13a3f8a13 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:33.440344 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1401/2767] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:33.458213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2420e45-24a8-4793-807f-07b13a3f8a13 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:33.467096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca5e0d-1bb7-44aa-b1a9-626e6c313d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:33.468003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca5e0d-1bb7-44aa-b1a9-626e6c313d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:33.468779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca5e0d-1bb7-44aa-b1a9-626e6c313d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:33.468779 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca5e0d-1bb7-44aa-b1a9-626e6c313d29 admin admin] PATH_INFO: `/v3/projects/446aa9029e88444899a6e5613f8ee2df/users/79e673a8c7824f508ccf52c8e491c881/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:33.496722 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca5e0d-1bb7-44aa-b1a9-626e6c313d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446aa9029e88444899a6e5613f8ee2df, user_id=79e673a8c7824f508ccf52c8e491c881, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:33.511124 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca5e0d-1bb7-44aa-b1a9-626e6c313d29 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:33.596636 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1367/2768] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:05:33 2022] PUT /identity/v3/projects/446aa9029e88444899a6e5613f8ee2df/users/79e673a8c7824f508ccf52c8e491c881/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:33.607753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d86ad-fa35-46d9-945c-1d4035b98ece None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:33.608046 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d86ad-fa35-46d9-945c-1d4035b98ece None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:33.608328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d86ad-fa35-46d9-945c-1d4035b98ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:33.636825 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-e75d86ad-fa35-46d9-945c-1d4035b98ece None None] MFA Rules not processed for user `79e673a8c7824f508ccf52c8e491c881`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:33.638062 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e75d86ad-fa35-46d9-945c-1d4035b98ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:33.685740 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca5e0d-1bb7-44aa-b1a9-626e6c313d29 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:33.687783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-42ca5e0d-1bb7-44aa-b1a9-626e6c313d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:33.701398 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:33.724439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1402/2769] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:05:33.746999 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d86ad-fa35-46d9-945c-1d4035b98ece None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:33.751851 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e75d86ad-fa35-46d9-945c-1d4035b98ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:33.799449 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca5e0d-1bb7-44aa-b1a9-626e6c313d29 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:33.802170 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d320c1-495f-468d-bf05-83fb5d404cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:33.803833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d320c1-495f-468d-bf05-83fb5d404cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:33.804284 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d320c1-495f-468d-bf05-83fb5d404cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:33.804663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d320c1-495f-468d-bf05-83fb5d404cf9 admin admin] PATH_INFO: `/v3/projects/4f09278bfb3248eab00d7061b248f6c3` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:33.806373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d320c1-495f-468d-bf05-83fb5d404cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f09278bfb3248eab00d7061b248f6c3)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:33.808709 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d320c1-495f-468d-bf05-83fb5d404cf9 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:33.837133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d86ad-fa35-46d9-945c-1d4035b98ece None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:33.847054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809e079-7457-4318-9317-8ee588210a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:33.847635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809e079-7457-4318-9317-8ee588210a51 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:33.847929 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809e079-7457-4318-9317-8ee588210a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:33.848209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809e079-7457-4318-9317-8ee588210a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:33.863015 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809e079-7457-4318-9317-8ee588210a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:33.864554 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809e079-7457-4318-9317-8ee588210a51 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:33.875492 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1403/2770] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:34.025839 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-25d320c1-495f-468d-bf05-83fb5d404cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f09278bfb3248eab00d7061b248f6c3', 'request_id': 'req-25d320c1-495f-468d-bf05-83fb5d404cf9'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:34.031396 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-25d320c1-495f-468d-bf05-83fb5d404cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f09278bfb3248eab00d7061b248f6c3', 'request_id': 'req-25d320c1-495f-468d-bf05-83fb5d404cf9'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:34.158034 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-25d320c1-495f-468d-bf05-83fb5d404cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f09278bfb3248eab00d7061b248f6c3', 'request_id': 'req-25d320c1-495f-468d-bf05-83fb5d404cf9'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:34.176682 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-25d320c1-495f-468d-bf05-83fb5d404cf9 admin admin] The token cache is being invalidate because project 4f09278bfb3248eab00d7061b248f6c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:34.177335 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-25d320c1-495f-468d-bf05-83fb5d404cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:34.178954 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-25d320c1-495f-468d-bf05-83fb5d404cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:34.181535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1368/2771] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:33 2022] DELETE /identity/v3/projects/4f09278bfb3248eab00d7061b248f6c3 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:05:34.186757 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48ed0e-fcdf-4e23-8f08-2bd2343cbb39 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:34.194243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48ed0e-fcdf-4e23-8f08-2bd2343cbb39 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:34.194243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48ed0e-fcdf-4e23-8f08-2bd2343cbb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:34.207193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-2e48ed0e-fcdf-4e23-8f08-2bd2343cbb39 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:34.208500 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2e48ed0e-fcdf-4e23-8f08-2bd2343cbb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:34.282221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1404/2772] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:34.289964 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace1f5e-762b-423b-b755-3e9fd82f6a8a None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:34.290544 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace1f5e-762b-423b-b755-3e9fd82f6a8a None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:34.290823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace1f5e-762b-423b-b755-3e9fd82f6a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:34.312579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-5ace1f5e-762b-423b-b755-3e9fd82f6a8a None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:34.316574 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5ace1f5e-762b-423b-b755-3e9fd82f6a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:34.323960 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1369/2773] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:34.328348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48ed0e-fcdf-4e23-8f08-2bd2343cbb39 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:34.341822 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48ed0e-fcdf-4e23-8f08-2bd2343cbb39 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:34.347347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde6cfa-b504-4e2f-8f6f-f882fbcef58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:34.348123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde6cfa-b504-4e2f-8f6f-f882fbcef58e admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:34.348508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde6cfa-b504-4e2f-8f6f-f882fbcef58e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:34.348848 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde6cfa-b504-4e2f-8f6f-f882fbcef58e admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:34.350114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde6cfa-b504-4e2f-8f6f-f882fbcef58e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:05:34.351022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde6cfa-b504-4e2f-8f6f-f882fbcef58e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:34.353041 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde6cfa-b504-4e2f-8f6f-f882fbcef58e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:34.374462 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1405/2774] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:05:34.375743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace1f5e-762b-423b-b755-3e9fd82f6a8a None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:34.386768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace1f5e-762b-423b-b755-3e9fd82f6a8a None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:34.392768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1498b-c89f-4bba-a0c3-8b8f406084ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:34.393504 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1498b-c89f-4bba-a0c3-8b8f406084ff admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:34.393787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1498b-c89f-4bba-a0c3-8b8f406084ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:34.394065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1498b-c89f-4bba-a0c3-8b8f406084ff admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:34.394930 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1498b-c89f-4bba-a0c3-8b8f406084ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:34.397688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1498b-c89f-4bba-a0c3-8b8f406084ff admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:34.525315 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1370/2775] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:05:34 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:34.527598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde6cfa-b504-4e2f-8f6f-f882fbcef58e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:34.540122 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde6cfa-b504-4e2f-8f6f-f882fbcef58e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:34.586757 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:34.648242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ad4f2-f921-4e5f-84ab-d9f9d6d66abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:34.648242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ad4f2-f921-4e5f-84ab-d9f9d6d66abb admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:34.648242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ad4f2-f921-4e5f-84ab-d9f9d6d66abb admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:34.648242 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ad4f2-f921-4e5f-84ab-d9f9d6d66abb admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:34.648687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ad4f2-f921-4e5f-84ab-d9f9d6d66abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:34.648687 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ad4f2-f921-4e5f-84ab-d9f9d6d66abb admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:34.852819 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1406/2776] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:05:34 2022] POST /identity/v3/users => generated 289 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:34.854039 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1498b-c89f-4bba-a0c3-8b8f406084ff admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:34.861027 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1498b-c89f-4bba-a0c3-8b8f406084ff admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:34.872175 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d11d3f-8081-4765-90cd-ca9b0c254f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:34.873046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11d3f-8081-4765-90cd-ca9b0c254f45 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:34.873328 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11d3f-8081-4765-90cd-ca9b0c254f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:34.873601 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d11d3f-8081-4765-90cd-ca9b0c254f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:34.874399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d11d3f-8081-4765-90cd-ca9b0c254f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:34.876176 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d11d3f-8081-4765-90cd-ca9b0c254f45 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:34.915306 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ad4f2-f921-4e5f-84ab-d9f9d6d66abb admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:34.928536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1371/2777] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:34.930156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ad4f2-f921-4e5f-84ab-d9f9d6d66abb admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:34.947076 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef10637-8827-4442-a1a1-d7355f6af34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:34.947660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef10637-8827-4442-a1a1-d7355f6af34d admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:34.948163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef10637-8827-4442-a1a1-d7355f6af34d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:34.948646 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef10637-8827-4442-a1a1-d7355f6af34d admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:34.949693 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef10637-8827-4442-a1a1-d7355f6af34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:34.951382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef10637-8827-4442-a1a1-d7355f6af34d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:34.979550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:34.988459 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1407/2778] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:34.998211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d11d3f-8081-4765-90cd-ca9b0c254f45 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:35.018850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d11d3f-8081-4765-90cd-ca9b0c254f45 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:35.025074 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b6de1-a19b-48d0-ae40-4201683e5e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:35.028527 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b6de1-a19b-48d0-ae40-4201683e5e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:35.028527 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b6de1-a19b-48d0-ae40-4201683e5e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:35.028527 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b6de1-a19b-48d0-ae40-4201683e5e26 admin admin] PATH_INFO: `/v3/projects/6c7630b166da4a50a09645b24e72dc2c/users/9e3662f2df2c4e52b0e96ce8d57a7e6e/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:35.051627 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b6de1-a19b-48d0-ae40-4201683e5e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7630b166da4a50a09645b24e72dc2c, user_id=9e3662f2df2c4e52b0e96ce8d57a7e6e, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:35.067446 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b6de1-a19b-48d0-ae40-4201683e5e26 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:35.285094 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1372/2779] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:05:34 2022] PUT /identity/v3/projects/6c7630b166da4a50a09645b24e72dc2c/users/9e3662f2df2c4e52b0e96ce8d57a7e6e/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:35.289221 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ac8c2-f35a-4671-a168-2c9b07c972f7 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:35.290048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ac8c2-f35a-4671-a168-2c9b07c972f7 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:35.290580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ac8c2-f35a-4671-a168-2c9b07c972f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:35.318607 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-c54ac8c2-f35a-4671-a168-2c9b07c972f7 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:35.320980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c54ac8c2-f35a-4671-a168-2c9b07c972f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:35.412350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1408/2780] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:35.423265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b6de1-a19b-48d0-ae40-4201683e5e26 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:35.425271 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-657b6de1-a19b-48d0-ae40-4201683e5e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:35.519945 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b6de1-a19b-48d0-ae40-4201683e5e26 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:35.525832 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de88fe-998d-4dc6-b242-4b2fb9927a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:35.526933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de88fe-998d-4dc6-b242-4b2fb9927a03 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:35.526933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de88fe-998d-4dc6-b242-4b2fb9927a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:35.527406 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de88fe-998d-4dc6-b242-4b2fb9927a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:35.543906 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de88fe-998d-4dc6-b242-4b2fb9927a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:35.545637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de88fe-998d-4dc6-b242-4b2fb9927a03 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:35.576815 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1373/2781] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:36.077058 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ac8c2-f35a-4671-a168-2c9b07c972f7 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:36.078389 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c54ac8c2-f35a-4671-a168-2c9b07c972f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:36.090991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ac8c2-f35a-4671-a168-2c9b07c972f7 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:36.099123 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:36.100267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:36.100790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:36.103675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] PATH_INFO: `/v3/users/29a8fcba54e345f197b129dbdb7a3fef` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:36.103675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a8fcba54e345f197b129dbdb7a3fef)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:36.104681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:36.376847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a8fcba54e345f197b129dbdb7a3fef'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:36.399957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a8fcba54e345f197b129dbdb7a3fef'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:36.408543 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a8fcba54e345f197b129dbdb7a3fef'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:36.500860 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a8fcba54e345f197b129dbdb7a3fef'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:36.505595 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a8fcba54e345f197b129dbdb7a3fef'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:36.513182 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1409/2782] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:36 2022] DELETE /identity/v3/users/29a8fcba54e345f197b129dbdb7a3fef => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:36.884095 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564b189-74dc-4b2a-ac92-c43949dfa9a7 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:36.884579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564b189-74dc-4b2a-ac92-c43949dfa9a7 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:36.884981 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564b189-74dc-4b2a-ac92-c43949dfa9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:36.903594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-4564b189-74dc-4b2a-ac92-c43949dfa9a7 None None] MFA Rules not processed for user `79e673a8c7824f508ccf52c8e491c881`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:36.904909 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4564b189-74dc-4b2a-ac92-c43949dfa9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:36.917163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:36.918786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:36.997462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1374/2783] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:37.017675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc24797-95b8-47cc-8623-a71ed989933b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:37.023301 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:37.024201 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:37.024605 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:37.024790 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] PATH_INFO: `/v3/projects/deb33eae0aa34330888eee1fbf9bdd96` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:37.026998 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb33eae0aa34330888eee1fbf9bdd96)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:37.029121 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:37.056243 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:37.420247 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb33eae0aa34330888eee1fbf9bdd96', 'request_id': 'req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:37.426786 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb33eae0aa34330888eee1fbf9bdd96', 'request_id': 'req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:37.434474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb33eae0aa34330888eee1fbf9bdd96', 'request_id': 'req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:37.595794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] The token cache is being invalidate because project deb33eae0aa34330888eee1fbf9bdd96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:37.595794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:37.595794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:37.597074 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1410/2784] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:36 2022] DELETE /identity/v3/projects/deb33eae0aa34330888eee1fbf9bdd96 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:37.600997 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564b189-74dc-4b2a-ac92-c43949dfa9a7 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:37.617894 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564b189-74dc-4b2a-ac92-c43949dfa9a7 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:37.650081 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:37.712372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:37.717697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:37.717697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:37.717697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] PATH_INFO: `/v3/users/18b745270c324cc48bbe1b4b68bad566` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:37.717697 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b745270c324cc48bbe1b4b68bad566)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:37.718841 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:38.043234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b745270c324cc48bbe1b4b68bad566'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:38.089295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b745270c324cc48bbe1b4b68bad566'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:38.098140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b745270c324cc48bbe1b4b68bad566'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:38.225700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b745270c324cc48bbe1b4b68bad566'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:38.226640 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b745270c324cc48bbe1b4b68bad566'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:38.249353 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1375/2785] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:37 2022] DELETE /identity/v3/users/18b745270c324cc48bbe1b4b68bad566 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:38.688971 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:38.690742 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:38.716596 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977dd7d-5cd9-4ed2-b956-17eddd40a10d admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:38.833161 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a2887-8179-4575-bca3-0e8d1822bed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:38.852144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a2887-8179-4575-bca3-0e8d1822bed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:38.852144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a2887-8179-4575-bca3-0e8d1822bed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:38.852144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a2887-8179-4575-bca3-0e8d1822bed4 admin admin] PATH_INFO: `/v3/projects/93bf2155672641dfa2fb7366b4fb2b68` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:38.852144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a2887-8179-4575-bca3-0e8d1822bed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93bf2155672641dfa2fb7366b4fb2b68)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:38.852144 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a2887-8179-4575-bca3-0e8d1822bed4 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:39.062556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7d2a2887-8179-4575-bca3-0e8d1822bed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93bf2155672641dfa2fb7366b4fb2b68', 'request_id': 'req-7d2a2887-8179-4575-bca3-0e8d1822bed4'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:39.073330 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7d2a2887-8179-4575-bca3-0e8d1822bed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93bf2155672641dfa2fb7366b4fb2b68', 'request_id': 'req-7d2a2887-8179-4575-bca3-0e8d1822bed4'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:39.094873 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7d2a2887-8179-4575-bca3-0e8d1822bed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93bf2155672641dfa2fb7366b4fb2b68', 'request_id': 'req-7d2a2887-8179-4575-bca3-0e8d1822bed4'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:39.260834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7d2a2887-8179-4575-bca3-0e8d1822bed4 admin admin] The token cache is being invalidate because project 93bf2155672641dfa2fb7366b4fb2b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:39.260834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7d2a2887-8179-4575-bca3-0e8d1822bed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:39.260834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-7d2a2887-8179-4575-bca3-0e8d1822bed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:39.266442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1411/2786] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:38 2022] DELETE /identity/v3/projects/93bf2155672641dfa2fb7366b4fb2b68 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:40.097721 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:40.099323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:40.216648 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc094d-8cde-4abd-9d93-5b41009f8067 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:40.276765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:40.306733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899518a9-2306-48bd-b19e-478890e619e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b218402abe6540d8b81295676199f6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:40.307399 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899518a9-2306-48bd-b19e-478890e619e5 service placement] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:40.307692 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899518a9-2306-48bd-b19e-478890e619e5 service placement] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:40.307963 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899518a9-2306-48bd-b19e-478890e619e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:40.309829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-899518a9-2306-48bd-b19e-478890e619e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:40.327874 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899518a9-2306-48bd-b19e-478890e619e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:40.330361 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899518a9-2306-48bd-b19e-478890e619e5 service placement] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:40.345578 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1376/2787] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:44.332199 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c23569-d4bf-4be0-9cf9-272093195ff3 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:44.332751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c23569-d4bf-4be0-9cf9-272093195ff3 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:44.332890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c23569-d4bf-4be0-9cf9-272093195ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:44.362317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-88c23569-d4bf-4be0-9cf9-272093195ff3 None None] MFA Rules not processed for user `9e3662f2df2c4e52b0e96ce8d57a7e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:44.363597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-88c23569-d4bf-4be0-9cf9-272093195ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:44.387166 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:44.439474 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1412/2788] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:44.455522 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899518a9-2306-48bd-b19e-478890e619e5 service placement] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:44.457307 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-899518a9-2306-48bd-b19e-478890e619e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:44.574533 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899518a9-2306-48bd-b19e-478890e619e5 service placement] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:44.580768 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177603a-9770-4eb9-a729-f5657f33bb6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:44.581440 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177603a-9770-4eb9-a729-f5657f33bb6d service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:44.581725 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177603a-9770-4eb9-a729-f5657f33bb6d service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:44.582002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177603a-9770-4eb9-a729-f5657f33bb6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:44.591106 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177603a-9770-4eb9-a729-f5657f33bb6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:44.592776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177603a-9770-4eb9-a729-f5657f33bb6d service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:44.608991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1377/2789] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:46.315434 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c23569-d4bf-4be0-9cf9-272093195ff3 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:46.317466 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-88c23569-d4bf-4be0-9cf9-272093195ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:46.420827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c23569-d4bf-4be0-9cf9-272093195ff3 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:46.426926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:46.431540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:46.431540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:46.431540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] PATH_INFO: `/v3/users/3d148fb1fa0e4891a96a80f094acda5b` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:46.434736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d148fb1fa0e4891a96a80f094acda5b)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:46.437310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:46.724132 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d148fb1fa0e4891a96a80f094acda5b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:46.743550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d148fb1fa0e4891a96a80f094acda5b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:46.754975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d148fb1fa0e4891a96a80f094acda5b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:46.869520 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d148fb1fa0e4891a96a80f094acda5b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:46.870284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d148fb1fa0e4891a96a80f094acda5b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:46.880022 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1413/2790] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:05:46 2022] DELETE /identity/v3/users/3d148fb1fa0e4891a96a80f094acda5b => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:46.885539 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f883c1-9d90-48a7-9deb-88592cefb23b None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:46.886018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f883c1-9d90-48a7-9deb-88592cefb23b None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:46.886146 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f883c1-9d90-48a7-9deb-88592cefb23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:46.908375 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-61f883c1-9d90-48a7-9deb-88592cefb23b None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:46.909619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-61f883c1-9d90-48a7-9deb-88592cefb23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:47.025479 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1378/2791] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:47.035519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:47.040747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:47.130508 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:47.146706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb88fc-7eed-4ccd-b4bf-888b2bcd8945 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:47.152614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3a8dd-ea74-4577-b5aa-53eb121a9c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:47.153789 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a8dd-ea74-4577-b5aa-53eb121a9c49 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:47.154222 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a8dd-ea74-4577-b5aa-53eb121a9c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:47.154620 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a8dd-ea74-4577-b5aa-53eb121a9c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:47.172664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3a8dd-ea74-4577-b5aa-53eb121a9c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:47.175310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3a8dd-ea74-4577-b5aa-53eb121a9c49 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:47.187964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1414/2792] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:05:47.734274 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8280a-cd94-47a5-939b-406a1efdd088 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:47.734602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8280a-cd94-47a5-939b-406a1efdd088 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:47.734842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8280a-cd94-47a5-939b-406a1efdd088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:47.768423 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:47.782008 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-a2f8280a-cd94-47a5-939b-406a1efdd088 None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:47.783271 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a2f8280a-cd94-47a5-939b-406a1efdd088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:47.877220 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1379/2793] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jul 20 18:05:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:47.958759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8b334-6680-4b65-9a13-074e92c9daaa None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:47.959726 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8b334-6680-4b65-9a13-074e92c9daaa None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:47.960285 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8b334-6680-4b65-9a13-074e92c9daaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:47.981286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-32c8b334-6680-4b65-9a13-074e92c9daaa None None] MFA Rules not processed for user `9e3662f2df2c4e52b0e96ce8d57a7e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:47.982705 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-32c8b334-6680-4b65-9a13-074e92c9daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:48.058376 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1415/2794] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:48.112069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8280a-cd94-47a5-939b-406a1efdd088 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:48.114407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-a2f8280a-cd94-47a5-939b-406a1efdd088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:48.121437 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8b334-6680-4b65-9a13-074e92c9daaa None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:48.124136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-32c8b334-6680-4b65-9a13-074e92c9daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:48.151035 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8280a-cd94-47a5-939b-406a1efdd088 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:48.177842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b916c46-a246-444d-907d-2255d7d3f77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:48.180407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b916c46-a246-444d-907d-2255d7d3f77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:48.181044 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b916c46-a246-444d-907d-2255d7d3f77e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:48.181594 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b916c46-a246-444d-907d-2255d7d3f77e admin admin] PATH_INFO: `/v3/projects/3cc3746c0e7c4255a50a9ebb95465d98` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:48.183342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b916c46-a246-444d-907d-2255d7d3f77e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc3746c0e7c4255a50a9ebb95465d98)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:48.186372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b916c46-a246-444d-907d-2255d7d3f77e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:48.292656 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8b334-6680-4b65-9a13-074e92c9daaa None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:48.303974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d52487-7bb3-463e-b935-6928401a4eb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:48.305563 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d52487-7bb3-463e-b935-6928401a4eb6 service swift] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:48.306219 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d52487-7bb3-463e-b935-6928401a4eb6 service swift] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:48.306940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d52487-7bb3-463e-b935-6928401a4eb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:48.324534 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d52487-7bb3-463e-b935-6928401a4eb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:48.328746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d52487-7bb3-463e-b935-6928401a4eb6 service swift] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:48.352014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1416/2795] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:05:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 18:05:48.382491 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9b916c46-a246-444d-907d-2255d7d3f77e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc3746c0e7c4255a50a9ebb95465d98', 'request_id': 'req-9b916c46-a246-444d-907d-2255d7d3f77e'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:48.404258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9b916c46-a246-444d-907d-2255d7d3f77e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc3746c0e7c4255a50a9ebb95465d98', 'request_id': 'req-9b916c46-a246-444d-907d-2255d7d3f77e'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:48.478677 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9b916c46-a246-444d-907d-2255d7d3f77e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc3746c0e7c4255a50a9ebb95465d98', 'request_id': 'req-9b916c46-a246-444d-907d-2255d7d3f77e'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:48.499787 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9b916c46-a246-444d-907d-2255d7d3f77e admin admin] The token cache is being invalidate because project 3cc3746c0e7c4255a50a9ebb95465d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:05:48.500862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9b916c46-a246-444d-907d-2255d7d3f77e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:48.503272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-9b916c46-a246-444d-907d-2255d7d3f77e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:05:48.506262 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1380/2796] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:05:48 2022] DELETE /identity/v3/projects/3cc3746c0e7c4255a50a9ebb95465d98 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:05:48.512069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc12da-f16d-4df0-a3e6-fabf8038dab4 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:48.513545 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc12da-f16d-4df0-a3e6-fabf8038dab4 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:48.522819 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc12da-f16d-4df0-a3e6-fabf8038dab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:48.544820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-9fdc12da-f16d-4df0-a3e6-fabf8038dab4 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:48.546366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-9fdc12da-f16d-4df0-a3e6-fabf8038dab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:48.628636 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1417/2797] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:05:48.637902 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3198c-256d-4b78-b819-ebd521eb6daa None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:48.638188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3198c-256d-4b78-b819-ebd521eb6daa None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:48.639416 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3198c-256d-4b78-b819-ebd521eb6daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:48.663686 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-0db3198c-256d-4b78-b819-ebd521eb6daa None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:48.664986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-0db3198c-256d-4b78-b819-ebd521eb6daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:48.674929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1381/2798] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:48.679966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc12da-f16d-4df0-a3e6-fabf8038dab4 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:48.690014 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc12da-f16d-4df0-a3e6-fabf8038dab4 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:48.694654 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e26084-dca2-4ceb-aa35-53f2aa49b5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:48.695329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e26084-dca2-4ceb-aa35-53f2aa49b5fa admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:48.695612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e26084-dca2-4ceb-aa35-53f2aa49b5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:48.695889 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e26084-dca2-4ceb-aa35-53f2aa49b5fa admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:48.696689 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e26084-dca2-4ceb-aa35-53f2aa49b5fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:05:48.696978 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e26084-dca2-4ceb-aa35-53f2aa49b5fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:48.698591 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e26084-dca2-4ceb-aa35-53f2aa49b5fa admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:48.712564 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1418/2799] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 18:05:48.717625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3198c-256d-4b78-b819-ebd521eb6daa None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:48.730351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3198c-256d-4b78-b819-ebd521eb6daa None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:48.736336 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8c0a8-7517-4493-9eed-4832328f4b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:48.737134 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8c0a8-7517-4493-9eed-4832328f4b55 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:48.737543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8c0a8-7517-4493-9eed-4832328f4b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:48.737927 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8c0a8-7517-4493-9eed-4832328f4b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:48.738759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8c0a8-7517-4493-9eed-4832328f4b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:48.741514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8c0a8-7517-4493-9eed-4832328f4b55 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:48.829760 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1382/2800] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:05:48 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:48.833236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e26084-dca2-4ceb-aa35-53f2aa49b5fa admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:48.847833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e26084-dca2-4ceb-aa35-53f2aa49b5fa admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:48.923373 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018a239-b336-4b96-aaae-8960b42ba728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:48.924103 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018a239-b336-4b96-aaae-8960b42ba728 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:48.924384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018a239-b336-4b96-aaae-8960b42ba728 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:48.924384 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018a239-b336-4b96-aaae-8960b42ba728 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:48.925431 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018a239-b336-4b96-aaae-8960b42ba728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:48.928158 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018a239-b336-4b96-aaae-8960b42ba728 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:49.123472 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1419/2801] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:05:48 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:05:49.127958 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8c0a8-7517-4493-9eed-4832328f4b55 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:49.141219 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8c0a8-7517-4493-9eed-4832328f4b55 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:49.169402 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101e7c3-3be5-452b-b608-805270d4d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:49.170198 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101e7c3-3be5-452b-b608-805270d4d497 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:49.170401 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101e7c3-3be5-452b-b608-805270d4d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:49.170688 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101e7c3-3be5-452b-b608-805270d4d497 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:49.171439 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101e7c3-3be5-452b-b608-805270d4d497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:49.173135 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101e7c3-3be5-452b-b608-805270d4d497 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:49.186388 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1383/2802] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:05:49.190190 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018a239-b336-4b96-aaae-8960b42ba728 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:49.201163 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018a239-b336-4b96-aaae-8960b42ba728 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:49.206031 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095922b7-3dab-4a1d-94fa-3a91f725b1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:49.206808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095922b7-3dab-4a1d-94fa-3a91f725b1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:49.207016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095922b7-3dab-4a1d-94fa-3a91f725b1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:49.207370 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095922b7-3dab-4a1d-94fa-3a91f725b1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:49.208028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095922b7-3dab-4a1d-94fa-3a91f725b1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:49.210328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095922b7-3dab-4a1d-94fa-3a91f725b1f0 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:49.221703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1420/2803] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 18:05:49.226407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101e7c3-3be5-452b-b608-805270d4d497 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:49.233770 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=100 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:49.240108 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101e7c3-3be5-452b-b608-805270d4d497 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:49.245663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89549f83-f486-47e0-860c-81dd6182d034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:49.246660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89549f83-f486-47e0-860c-81dd6182d034 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:49.247006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89549f83-f486-47e0-860c-81dd6182d034 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:49.247283 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89549f83-f486-47e0-860c-81dd6182d034 admin admin] PATH_INFO: `/v3/projects/29f18ac9e8be45e58dadb73960e7430a/users/5c05ab79c30949e2ba3a761212066152/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:49.268002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89549f83-f486-47e0-860c-81dd6182d034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f18ac9e8be45e58dadb73960e7430a, user_id=5c05ab79c30949e2ba3a761212066152, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:49.273429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89549f83-f486-47e0-860c-81dd6182d034 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:49.402116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1384/2804] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:05:49 2022] PUT /identity/v3/projects/29f18ac9e8be45e58dadb73960e7430a/users/5c05ab79c30949e2ba3a761212066152/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:05:49.412660 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae517caa-1b67-42bf-9635-c5e7331fe67f None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:49.412952 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae517caa-1b67-42bf-9635-c5e7331fe67f None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:49.413235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae517caa-1b67-42bf-9635-c5e7331fe67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:49.440909 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ae517caa-1b67-42bf-9635-c5e7331fe67f None None] MFA Rules not processed for user `5c05ab79c30949e2ba3a761212066152`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:05:49.442143 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ae517caa-1b67-42bf-9635-c5e7331fe67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:49.511626 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1421/2805] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:05:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:05:49.523474 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89549f83-f486-47e0-860c-81dd6182d034 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:05:49.525398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-89549f83-f486-47e0-860c-81dd6182d034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:05:49.579314 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:05:49.632895 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89549f83-f486-47e0-860c-81dd6182d034 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:05:49.636723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efe797-73ac-406e-80e2-019cd3602807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:05:49.637372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efe797-73ac-406e-80e2-019cd3602807 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:05:49.637650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efe797-73ac-406e-80e2-019cd3602807 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:05:49.637923 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efe797-73ac-406e-80e2-019cd3602807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:05:49.649070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efe797-73ac-406e-80e2-019cd3602807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:05:49.649244 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efe797-73ac-406e-80e2-019cd3602807 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:05:49.658046 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1385/2806] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:05:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:06:00.021524 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:06:00.382556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae517caa-1b67-42bf-9635-c5e7331fe67f None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:00.384052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ae517caa-1b67-42bf-9635-c5e7331fe67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:00.454993 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae517caa-1b67-42bf-9635-c5e7331fe67f None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:00.460494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:00.465908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:00.465908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:00.465908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] PATH_INFO: `/v3/users/ca4a2cc237bd4637bb2b03ae692a401d` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:00.465908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4a2cc237bd4637bb2b03ae692a401d)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:00.465908 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:00.731744 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4a2cc237bd4637bb2b03ae692a401d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:00.744713 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4a2cc237bd4637bb2b03ae692a401d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:00.751634 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4a2cc237bd4637bb2b03ae692a401d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:00.913799 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4a2cc237bd4637bb2b03ae692a401d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:00.924409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4a2cc237bd4637bb2b03ae692a401d'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:00.924409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1422/2807] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:06:00 2022] DELETE /identity/v3/users/ca4a2cc237bd4637bb2b03ae692a401d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:06:01.058720 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb8cc2-ee6f-4ddc-8226-9a611e7d6ffa None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:01.059190 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb8cc2-ee6f-4ddc-8226-9a611e7d6ffa None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:01.059425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb8cc2-ee6f-4ddc-8226-9a611e7d6ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:01.080123 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-e9bb8cc2-ee6f-4ddc-8226-9a611e7d6ffa None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:06:01.081361 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e9bb8cc2-ee6f-4ddc-8226-9a611e7d6ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:01.141673 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1386/2808] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 18:06:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:06:01.153903 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:01.155440 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:01.228023 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94398215-a127-4ffe-a0c8-2643ae879775 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:01.233070 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a9894-aee6-4349-aa91-fdf1b77733eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:01.233719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a9894-aee6-4349-aa91-fdf1b77733eb service swift] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:01.234006 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a9894-aee6-4349-aa91-fdf1b77733eb service swift] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:01.234283 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a9894-aee6-4349-aa91-fdf1b77733eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:01.243314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a9894-aee6-4349-aa91-fdf1b77733eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:01.244957 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a9894-aee6-4349-aa91-fdf1b77733eb service swift] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:01.253506 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1423/2809] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:06:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 18:06:01.304348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb8cc2-ee6f-4ddc-8226-9a611e7d6ffa None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:01.304348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-e9bb8cc2-ee6f-4ddc-8226-9a611e7d6ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:01.373794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb8cc2-ee6f-4ddc-8226-9a611e7d6ffa None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:01.378392 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:01.379240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:01.379529 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:01.379797 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] PATH_INFO: `/v3/projects/1d7075d41e2349eebee32600a5c57a68` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:01.381125 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7075d41e2349eebee32600a5c57a68)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:01.383165 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:01.517279 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7075d41e2349eebee32600a5c57a68', 'request_id': 'req-8c35b514-9f18-429f-bbed-3d6090055856'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:01.523774 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7075d41e2349eebee32600a5c57a68', 'request_id': 'req-8c35b514-9f18-429f-bbed-3d6090055856'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:01.526313 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:06:01.643624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7075d41e2349eebee32600a5c57a68', 'request_id': 'req-8c35b514-9f18-429f-bbed-3d6090055856'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:01.655755 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] The token cache is being invalidate because project 1d7075d41e2349eebee32600a5c57a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:06:01.656042 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:01.656795 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:01.658340 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1387/2810] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:06:01 2022] DELETE /identity/v3/projects/1d7075d41e2349eebee32600a5c57a68 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:06:01.663635 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a9894-aee6-4349-aa91-fdf1b77733eb service swift] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:01.674151 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a9894-aee6-4349-aa91-fdf1b77733eb service swift] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:01.679631 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:06:01.736142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f974a0-9a6c-4682-be14-f18f9fcf89c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:01.737048 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f974a0-9a6c-4682-be14-f18f9fcf89c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:01.737328 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f974a0-9a6c-4682-be14-f18f9fcf89c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:01.737602 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f974a0-9a6c-4682-be14-f18f9fcf89c3 admin admin] PATH_INFO: `/v3/users/f0edb936daaf4ee996212baf348b462b` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:01.738791 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f974a0-9a6c-4682-be14-f18f9fcf89c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0edb936daaf4ee996212baf348b462b)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:01.740834 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f974a0-9a6c-4682-be14-f18f9fcf89c3 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:01.946630 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f5f974a0-9a6c-4682-be14-f18f9fcf89c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0edb936daaf4ee996212baf348b462b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:01.963621 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f5f974a0-9a6c-4682-be14-f18f9fcf89c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0edb936daaf4ee996212baf348b462b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:01.970774 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f5f974a0-9a6c-4682-be14-f18f9fcf89c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0edb936daaf4ee996212baf348b462b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:02.078409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f5f974a0-9a6c-4682-be14-f18f9fcf89c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0edb936daaf4ee996212baf348b462b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:02.079049 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f5f974a0-9a6c-4682-be14-f18f9fcf89c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0edb936daaf4ee996212baf348b462b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:02.087226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1424/2811] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:06:01 2022] DELETE /identity/v3/users/f0edb936daaf4ee996212baf348b462b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:06:02.467654 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:02.469376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:02.487833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35b514-9f18-429f-bbed-3d6090055856 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:02.489488 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740040e-a764-4cbe-8d08-56406a6307fb None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:02.493353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740040e-a764-4cbe-8d08-56406a6307fb None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:02.493353 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740040e-a764-4cbe-8d08-56406a6307fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:02.509679 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-6740040e-a764-4cbe-8d08-56406a6307fb None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:06:02.511089 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6740040e-a764-4cbe-8d08-56406a6307fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:02.552676 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb32500-4183-409d-9d54-dc144f59bac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:02.554164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb32500-4183-409d-9d54-dc144f59bac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:02.554451 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb32500-4183-409d-9d54-dc144f59bac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:02.554732 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb32500-4183-409d-9d54-dc144f59bac8 admin admin] PATH_INFO: `/v3/projects/9d1248b10237426986a001602d6f2eb8` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:02.555982 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb32500-4183-409d-9d54-dc144f59bac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1248b10237426986a001602d6f2eb8)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:02.558548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb32500-4183-409d-9d54-dc144f59bac8 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:02.579245 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1425/2812] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jul 20 18:06:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:06:02.592090 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740040e-a764-4cbe-8d08-56406a6307fb None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:02.593502 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6740040e-a764-4cbe-8d08-56406a6307fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:02.664131 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740040e-a764-4cbe-8d08-56406a6307fb None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:02.673472 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-efb32500-4183-409d-9d54-dc144f59bac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1248b10237426986a001602d6f2eb8', 'request_id': 'req-efb32500-4183-409d-9d54-dc144f59bac8'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:02.679491 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-efb32500-4183-409d-9d54-dc144f59bac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1248b10237426986a001602d6f2eb8', 'request_id': 'req-efb32500-4183-409d-9d54-dc144f59bac8'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:02.723688 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b4add-2cf8-4522-b326-c4252f403ced service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:02.724336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b4add-2cf8-4522-b326-c4252f403ced service swift] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:02.724650 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b4add-2cf8-4522-b326-c4252f403ced service swift] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:02.725142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b4add-2cf8-4522-b326-c4252f403ced service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:02.782477 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b4add-2cf8-4522-b326-c4252f403ced service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:02.784162 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b4add-2cf8-4522-b326-c4252f403ced service swift] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:02.793087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1426/2813] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:06:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 18:06:02.837631 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-efb32500-4183-409d-9d54-dc144f59bac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1248b10237426986a001602d6f2eb8', 'request_id': 'req-efb32500-4183-409d-9d54-dc144f59bac8'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:02.848275 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-efb32500-4183-409d-9d54-dc144f59bac8 admin admin] The token cache is being invalidate because project 9d1248b10237426986a001602d6f2eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:06:02.848602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-efb32500-4183-409d-9d54-dc144f59bac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:02.849293 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-efb32500-4183-409d-9d54-dc144f59bac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:02.851024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1388/2814] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:06:02 2022] DELETE /identity/v3/projects/9d1248b10237426986a001602d6f2eb8 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:06:02.997550 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b4add-2cf8-4522-b326-c4252f403ced service swift] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:02.998979 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-555b4add-2cf8-4522-b326-c4252f403ced service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:03.070882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b4add-2cf8-4522-b326-c4252f403ced service swift] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:03.075562 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:03.076456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:03.076967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:03.077231 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] PATH_INFO: `/v3/users/5c05ab79c30949e2ba3a761212066152` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:03.078510 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c05ab79c30949e2ba3a761212066152)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:03.080497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:03.437236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c05ab79c30949e2ba3a761212066152'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:03.450097 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c05ab79c30949e2ba3a761212066152'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:03.456913 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c05ab79c30949e2ba3a761212066152'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:03.578065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c05ab79c30949e2ba3a761212066152'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:03.578690 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c05ab79c30949e2ba3a761212066152'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:03.585552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1427/2815] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:06:02 2022] DELETE /identity/v3/users/5c05ab79c30949e2ba3a761212066152 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:06:03.590624 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14da8c-d115-4500-b58f-7357c1ef6b07 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:03.591114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14da8c-d115-4500-b58f-7357c1ef6b07 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:03.591462 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14da8c-d115-4500-b58f-7357c1ef6b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:03.610465 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-4e14da8c-d115-4500-b58f-7357c1ef6b07 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:06:03.611692 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-4e14da8c-d115-4500-b58f-7357c1ef6b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:03.671829 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1389/2816] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:06:03.682719 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:03.684136 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:03.727136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbf151-a755-46cc-b4a9-b2150313877d None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:03.727437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbf151-a755-46cc-b4a9-b2150313877d None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:03.727723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbf151-a755-46cc-b4a9-b2150313877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:03.747113 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d5bbf151-a755-46cc-b4a9-b2150313877d None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:06:03.748332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d5bbf151-a755-46cc-b4a9-b2150313877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:03.751315 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc39541-526f-416c-86fa-230a90290afe admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:03.755603 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52339f0f-a5a2-475f-b6a0-f0b55b12d296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:03.756362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52339f0f-a5a2-475f-b6a0-f0b55b12d296 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:03.756938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52339f0f-a5a2-475f-b6a0-f0b55b12d296 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:03.756938 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52339f0f-a5a2-475f-b6a0-f0b55b12d296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:03.765660 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:06:03.766571 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52339f0f-a5a2-475f-b6a0-f0b55b12d296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:03.768003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52339f0f-a5a2-475f-b6a0-f0b55b12d296 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:03.779707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1428/2817] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 18:06:03.787457 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:06:03.811356 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1390/2818] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Jul 20 18:06:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:06:03.825339 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52339f0f-a5a2-475f-b6a0-f0b55b12d296 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:03.825966 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-52339f0f-a5a2-475f-b6a0-f0b55b12d296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:03.899884 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52339f0f-a5a2-475f-b6a0-f0b55b12d296 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:03.905018 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a413f-2775-48d5-81da-0a55659f9158 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:03.905675 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a413f-2775-48d5-81da-0a55659f9158 service swift] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:03.905958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a413f-2775-48d5-81da-0a55659f9158 service swift] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:03.906248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a413f-2775-48d5-81da-0a55659f9158 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:03.916627 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a413f-2775-48d5-81da-0a55659f9158 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:03.918204 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a413f-2775-48d5-81da-0a55659f9158 service swift] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:03.926965 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1429/2819] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:06:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 18:06:04.235041 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbf151-a755-46cc-b4a9-b2150313877d None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:04.236885 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d5bbf151-a755-46cc-b4a9-b2150313877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:04.252184 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbf151-a755-46cc-b4a9-b2150313877d None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:04.258444 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:04.259726 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:04.260646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:04.260646 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] PATH_INFO: `/v3/projects/29f18ac9e8be45e58dadb73960e7430a` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:04.261925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f18ac9e8be45e58dadb73960e7430a)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:04.263917 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:04.609415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f18ac9e8be45e58dadb73960e7430a', 'request_id': 'req-96e84aa1-005c-4076-a473-6ac3e63ba4ce'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:04.609415 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f18ac9e8be45e58dadb73960e7430a', 'request_id': 'req-96e84aa1-005c-4076-a473-6ac3e63ba4ce'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:04.841256 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e255485-8fa1-4d36-854b-9689bf7fe729 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:04.841754 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e255485-8fa1-4d36-854b-9689bf7fe729 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:04.841870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e255485-8fa1-4d36-854b-9689bf7fe729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:04.860212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-0e255485-8fa1-4d36-854b-9689bf7fe729 None None] MFA Rules not processed for user `f518137b54ee4e668f41c0f660a54d90`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:06:04.861452 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0e255485-8fa1-4d36-854b-9689bf7fe729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:04.921953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1430/2820] 10.222.0.27 () {58 vars in 967 bytes} [Wed Jul 20 18:06:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:06:04.937200 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e255485-8fa1-4d36-854b-9689bf7fe729 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:04.961455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f18ac9e8be45e58dadb73960e7430a', 'request_id': 'req-96e84aa1-005c-4076-a473-6ac3e63ba4ce'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:04.975882 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] The token cache is being invalidate because project 29f18ac9e8be45e58dadb73960e7430a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:06:04.977079 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:04.978112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:04.980849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1391/2821] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:06:04 2022] DELETE /identity/v3/projects/29f18ac9e8be45e58dadb73960e7430a => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:06:05.024879 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e255485-8fa1-4d36-854b-9689bf7fe729 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:05.030336 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f5074-3ac2-430d-a313-deaa2741cb26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566befd16fc4b0c84d2bed34c4a5d28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:05.034648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f5074-3ac2-430d-a313-deaa2741cb26 service swift] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:05.034648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f5074-3ac2-430d-a313-deaa2741cb26 service swift] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:05.034648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f5074-3ac2-430d-a313-deaa2741cb26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:05.034648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-6e2f5074-3ac2-430d-a313-deaa2741cb26 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:05.046308 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f5074-3ac2-430d-a313-deaa2741cb26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:05.048707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f5074-3ac2-430d-a313-deaa2741cb26 service swift] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:05.060703 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1431/2822] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Jul 20 18:06:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 18:06:05.896736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:06:06.627888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:06:08.522916 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:08.525759 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:08.601824 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84aa1-005c-4076-a473-6ac3e63ba4ce admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:08.608213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:08.609448 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:08.609817 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:08.610161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] PATH_INFO: `/v3/users/79e673a8c7824f508ccf52c8e491c881` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:08.611458 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e673a8c7824f508ccf52c8e491c881)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:08.613537 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:08.858742 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e673a8c7824f508ccf52c8e491c881'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:08.862985 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:06:08.882360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e673a8c7824f508ccf52c8e491c881'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:08.891118 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e673a8c7824f508ccf52c8e491c881'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:08.995587 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e673a8c7824f508ccf52c8e491c881'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:08.996280 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e673a8c7824f508ccf52c8e491c881'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:09.003542 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1392/2823] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:06:08 2022] DELETE /identity/v3/users/79e673a8c7824f508ccf52c8e491c881 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:06:09.010066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f640e-ed69-4b4d-8361-5fbabb4d5a46 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:09.021976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f640e-ed69-4b4d-8361-5fbabb4d5a46 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:09.021976 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f640e-ed69-4b4d-8361-5fbabb4d5a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:09.032815 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-ad8f640e-ed69-4b4d-8361-5fbabb4d5a46 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:06:09.034112 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ad8f640e-ed69-4b4d-8361-5fbabb4d5a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:09.112987 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1432/2824] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:06:09.124219 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:09.125793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:09.187514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7587a82-71bd-4645-8626-a29c8c768b4f admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:09.191220 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647c749-dccc-4c13-a90a-fc8614526732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:09.191873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647c749-dccc-4c13-a90a-fc8614526732 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:09.192158 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647c749-dccc-4c13-a90a-fc8614526732 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:09.192437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647c749-dccc-4c13-a90a-fc8614526732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:09.202702 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647c749-dccc-4c13-a90a-fc8614526732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:09.204136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647c749-dccc-4c13-a90a-fc8614526732 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:09.215061 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1393/2825] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:06:09.540079 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f640e-ed69-4b4d-8361-5fbabb4d5a46 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:06:09.541588 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ad8f640e-ed69-4b4d-8361-5fbabb4d5a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:06:09.553869 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f640e-ed69-4b4d-8361-5fbabb4d5a46 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:06:09.558758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:06:09.559645 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:06:09.559927 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:06:09.560202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] PATH_INFO: `/v3/projects/446aa9029e88444899a6e5613f8ee2df` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:06:09.561446 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=446aa9029e88444899a6e5613f8ee2df)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:06:09.563355 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:06:09.747733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446aa9029e88444899a6e5613f8ee2df', 'request_id': 'req-ceb2fc45-f428-4706-aab3-bcc23261ec9e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:09.754649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446aa9029e88444899a6e5613f8ee2df', 'request_id': 'req-ceb2fc45-f428-4706-aab3-bcc23261ec9e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:09.759557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:06:09.761669 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446aa9029e88444899a6e5613f8ee2df', 'request_id': 'req-ceb2fc45-f428-4706-aab3-bcc23261ec9e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:09.902651 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] The token cache is being invalidate because project 446aa9029e88444899a6e5613f8ee2df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87027) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:06:09.902881 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:09.903471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:06:09.905066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1433/2826] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:06:09 2022] DELETE /identity/v3/projects/446aa9029e88444899a6e5613f8ee2df => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:06:19.209566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=37,keystone:DELETE=3,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:06:19.935877 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:DELETE=2,keystone:SELECT=3,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:07:37.933428 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647c749-dccc-4c13-a90a-fc8614526732 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:07:37.935011 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2647c749-dccc-4c13-a90a-fc8614526732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:07:37.993442 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647c749-dccc-4c13-a90a-fc8614526732 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:07:38.041306 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fde5aa-d93a-47b4-86f7-623d899d6bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:07:38.041997 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fde5aa-d93a-47b4-86f7-623d899d6bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:07:38.042296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fde5aa-d93a-47b4-86f7-623d899d6bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:07:38.042569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fde5aa-d93a-47b4-86f7-623d899d6bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:07:38.045645 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-36fde5aa-d93a-47b4-86f7-623d899d6bf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:07:38.117453 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fde5aa-d93a-47b4-86f7-623d899d6bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:07:38.118898 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fde5aa-d93a-47b4-86f7-623d899d6bf3 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:07:38.131505 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1394/2827] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:07:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:07:41.099026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:07:41.100598 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:07:41.157177 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2fc45-f428-4706-aab3-bcc23261ec9e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:07:41.160745 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7e22f-39a9-43a2-943d-68e8e25e5724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:07:41.161385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7e22f-39a9-43a2-943d-68e8e25e5724 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:07:41.161664 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7e22f-39a9-43a2-943d-68e8e25e5724 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:07:41.161940 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7e22f-39a9-43a2-943d-68e8e25e5724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:07:41.163667 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0de7e22f-39a9-43a2-943d-68e8e25e5724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:07:41.177399 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7e22f-39a9-43a2-943d-68e8e25e5724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:07:41.178813 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7e22f-39a9-43a2-943d-68e8e25e5724 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:07:41.190171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1434/2828] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:07:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:07:48.126426 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=74 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:07:51.185209 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=26 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:08:29.717493 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fde5aa-d93a-47b4-86f7-623d899d6bf3 service cinder] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:08:29.718951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-36fde5aa-d93a-47b4-86f7-623d899d6bf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:08:29.733077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fde5aa-d93a-47b4-86f7-623d899d6bf3 service cinder] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:08:29.738637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d245cc7-cd24-4c5f-a9e5-df2a277a5de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:08:29.739289 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d245cc7-cd24-4c5f-a9e5-df2a277a5de3 service nova] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:08:29.739565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d245cc7-cd24-4c5f-a9e5-df2a277a5de3 service nova] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:08:29.739907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d245cc7-cd24-4c5f-a9e5-df2a277a5de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:08:29.741933 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6d245cc7-cd24-4c5f-a9e5-df2a277a5de3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:08:29.755107 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d245cc7-cd24-4c5f-a9e5-df2a277a5de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:08:29.757210 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d245cc7-cd24-4c5f-a9e5-df2a277a5de3 service nova] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:08:29.770254 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1395/2829] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:08:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:08:35.110372 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac2786-b717-43c4-8186-705d2e9f3629 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:08:35.110926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac2786-b717-43c4-8186-705d2e9f3629 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:08:35.111035 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac2786-b717-43c4-8186-705d2e9f3629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:08:35.129137 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-21ac2786-b717-43c4-8186-705d2e9f3629 None None] MFA Rules not processed for user `9e3662f2df2c4e52b0e96ce8d57a7e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:08:35.130343 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-21ac2786-b717-43c4-8186-705d2e9f3629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:08:35.189054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1435/2830] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:08:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:08:35.505794 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d245cc7-cd24-4c5f-a9e5-df2a277a5de3 service nova] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:08:35.516153 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d245cc7-cd24-4c5f-a9e5-df2a277a5de3 service nova] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:08:35.519931 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda99d8-c3e1-472f-b6af-75020081a1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:08:35.520765 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda99d8-c3e1-472f-b6af-75020081a1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:08:35.521024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda99d8-c3e1-472f-b6af-75020081a1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:08:35.521308 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda99d8-c3e1-472f-b6af-75020081a1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:08:35.523174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5cda99d8-c3e1-472f-b6af-75020081a1f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:08:35.533873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda99d8-c3e1-472f-b6af-75020081a1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:08:35.535351 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda99d8-c3e1-472f-b6af-75020081a1f6 service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:08:35.545167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1396/2831] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:08:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:08:35.983584 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac2786-b717-43c4-8186-705d2e9f3629 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:08:35.985032 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-21ac2786-b717-43c4-8186-705d2e9f3629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:08:36.061723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac2786-b717-43c4-8186-705d2e9f3629 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:08:36.066706 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712da89-682e-43dc-ab42-570b88727d86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b218402abe6540d8b81295676199f6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:08:36.067357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712da89-682e-43dc-ab42-570b88727d86 service placement] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:08:36.067637 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712da89-682e-43dc-ab42-570b88727d86 service placement] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:08:36.068268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712da89-682e-43dc-ab42-570b88727d86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:08:36.069934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f712da89-682e-43dc-ab42-570b88727d86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:08:36.088239 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712da89-682e-43dc-ab42-570b88727d86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:08:36.092037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712da89-682e-43dc-ab42-570b88727d86 service placement] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:08:36.112241 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1436/2832] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:08:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:08:39.716593 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda99d8-c3e1-472f-b6af-75020081a1f6 service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:08:39.718062 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-5cda99d8-c3e1-472f-b6af-75020081a1f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:08:39.728490 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda99d8-c3e1-472f-b6af-75020081a1f6 service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:08:39.732576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196ae3c-dc33-4835-8822-e03507a8563e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:08:39.733208 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196ae3c-dc33-4835-8822-e03507a8563e service neutron] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:08:39.733488 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196ae3c-dc33-4835-8822-e03507a8563e service neutron] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:08:39.733762 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196ae3c-dc33-4835-8822-e03507a8563e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:08:39.735468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-2196ae3c-dc33-4835-8822-e03507a8563e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:08:39.744833 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196ae3c-dc33-4835-8822-e03507a8563e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:08:39.747138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196ae3c-dc33-4835-8822-e03507a8563e service neutron] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:08:39.755157 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1397/2833] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:08:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:08:46.103220 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=57 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:08:47.049701 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712da89-682e-43dc-ab42-570b88727d86 service placement] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:08:47.063286 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712da89-682e-43dc-ab42-570b88727d86 service placement] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:08:47.069232 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920a52a-40ab-41c3-8ce5-50bdd84bcaa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b52e88df44d49b186d54a8d045595ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:08:47.069934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920a52a-40ab-41c3-8ce5-50bdd84bcaa3 service nova] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:08:47.070226 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920a52a-40ab-41c3-8ce5-50bdd84bcaa3 service nova] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:08:47.070501 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920a52a-40ab-41c3-8ce5-50bdd84bcaa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:08:47.072319 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3920a52a-40ab-41c3-8ce5-50bdd84bcaa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:08:47.086991 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920a52a-40ab-41c3-8ce5-50bdd84bcaa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:08:47.088586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920a52a-40ab-41c3-8ce5-50bdd84bcaa3 service nova] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:08:47.103955 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1437/2834] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:08:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:08:49.751516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=18 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:08:57.095129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=6 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:09:55.845178 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196ae3c-dc33-4835-8822-e03507a8563e service neutron] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:55.859070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196ae3c-dc33-4835-8822-e03507a8563e service neutron] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:55.864422 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a357a1-866d-41ed-8ef7-c8c61d88bf3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b218402abe6540d8b81295676199f6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:55.866166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a357a1-866d-41ed-8ef7-c8c61d88bf3f service placement] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:55.866166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a357a1-866d-41ed-8ef7-c8c61d88bf3f service placement] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:55.866166 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a357a1-866d-41ed-8ef7-c8c61d88bf3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:55.867491 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-96a357a1-866d-41ed-8ef7-c8c61d88bf3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:09:55.880546 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a357a1-866d-41ed-8ef7-c8c61d88bf3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:55.882288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a357a1-866d-41ed-8ef7-c8c61d88bf3f service placement] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:55.893892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1398/2835] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:09:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:09:56.021428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920a52a-40ab-41c3-8ce5-50bdd84bcaa3 service nova] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:56.021428 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3920a52a-40ab-41c3-8ce5-50bdd84bcaa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:09:56.084893 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920a52a-40ab-41c3-8ce5-50bdd84bcaa3 service nova] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:56.090133 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7c9ae-b7ff-4ac4-97ed-f113127fac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:56.091003 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7c9ae-b7ff-4ac4-97ed-f113127fac4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:56.091284 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7c9ae-b7ff-4ac4-97ed-f113127fac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:56.091560 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7c9ae-b7ff-4ac4-97ed-f113127fac4e admin admin] PATH_INFO: `/v3/users/9e3662f2df2c4e52b0e96ce8d57a7e6e` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:56.092827 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7c9ae-b7ff-4ac4-97ed-f113127fac4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3662f2df2c4e52b0e96ce8d57a7e6e)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:56.094727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7c9ae-b7ff-4ac4-97ed-f113127fac4e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:56.304586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-29b7c9ae-b7ff-4ac4-97ed-f113127fac4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3662f2df2c4e52b0e96ce8d57a7e6e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:09:56.317576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-29b7c9ae-b7ff-4ac4-97ed-f113127fac4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3662f2df2c4e52b0e96ce8d57a7e6e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:09:56.325747 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-29b7c9ae-b7ff-4ac4-97ed-f113127fac4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3662f2df2c4e52b0e96ce8d57a7e6e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:09:56.398678 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-29b7c9ae-b7ff-4ac4-97ed-f113127fac4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3662f2df2c4e52b0e96ce8d57a7e6e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:09:56.401867 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-29b7c9ae-b7ff-4ac4-97ed-f113127fac4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3662f2df2c4e52b0e96ce8d57a7e6e'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:09:56.406066 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1438/2836] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:09:56 2022] DELETE /identity/v3/users/9e3662f2df2c4e52b0e96ce8d57a7e6e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:09:56.663698 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a357a1-866d-41ed-8ef7-c8c61d88bf3f service placement] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:56.676096 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a357a1-866d-41ed-8ef7-c8c61d88bf3f service placement] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:56.742938 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b582abd-5e4f-47e5-a361-633387afa857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:56.744503 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b582abd-5e4f-47e5-a361-633387afa857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:56.744805 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b582abd-5e4f-47e5-a361-633387afa857 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:56.745074 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b582abd-5e4f-47e5-a361-633387afa857 admin admin] PATH_INFO: `/v3/projects/6c7630b166da4a50a09645b24e72dc2c` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:56.747136 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b582abd-5e4f-47e5-a361-633387afa857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7630b166da4a50a09645b24e72dc2c)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:56.749084 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b582abd-5e4f-47e5-a361-633387afa857 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:56.885843 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-7b582abd-5e4f-47e5-a361-633387afa857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7630b166da4a50a09645b24e72dc2c', 'request_id': 'req-7b582abd-5e4f-47e5-a361-633387afa857'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:09:56.891398 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-7b582abd-5e4f-47e5-a361-633387afa857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7630b166da4a50a09645b24e72dc2c', 'request_id': 'req-7b582abd-5e4f-47e5-a361-633387afa857'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:09:57.033414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-7b582abd-5e4f-47e5-a361-633387afa857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7630b166da4a50a09645b24e72dc2c', 'request_id': 'req-7b582abd-5e4f-47e5-a361-633387afa857'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:09:57.050938 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-7b582abd-5e4f-47e5-a361-633387afa857 admin admin] The token cache is being invalidate because project 6c7630b166da4a50a09645b24e72dc2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:09:57.051566 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-7b582abd-5e4f-47e5-a361-633387afa857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:09:57.052846 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-7b582abd-5e4f-47e5-a361-633387afa857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:09:57.055944 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1399/2837] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:09:56 2022] DELETE /identity/v3/projects/6c7630b166da4a50a09645b24e72dc2c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:09:57.064036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbbef3-782e-4c79-9c9d-08459176ae49 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:57.064604 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbbef3-782e-4c79-9c9d-08459176ae49 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:57.064721 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbbef3-782e-4c79-9c9d-08459176ae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:57.084230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-4ffbbef3-782e-4c79-9c9d-08459176ae49 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:09:57.085530 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-4ffbbef3-782e-4c79-9c9d-08459176ae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:09:57.148960 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1439/2838] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:09:57.157642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331479d9-4a51-49ca-86e1-2f919e27de92 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:57.157929 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331479d9-4a51-49ca-86e1-2f919e27de92 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:57.158211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331479d9-4a51-49ca-86e1-2f919e27de92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:57.178309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-331479d9-4a51-49ca-86e1-2f919e27de92 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:09:57.179534 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-331479d9-4a51-49ca-86e1-2f919e27de92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:09:57.188803 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1400/2839] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:09:57.193224 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbbef3-782e-4c79-9c9d-08459176ae49 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:57.203677 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbbef3-782e-4c79-9c9d-08459176ae49 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:57.208334 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cba82-d4f3-4e9e-b136-a8c1f2328510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:57.209077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cba82-d4f3-4e9e-b136-a8c1f2328510 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:57.209354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cba82-d4f3-4e9e-b136-a8c1f2328510 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:57.209629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cba82-d4f3-4e9e-b136-a8c1f2328510 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:57.210356 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cba82-d4f3-4e9e-b136-a8c1f2328510 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:09:57.210658 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cba82-d4f3-4e9e-b136-a8c1f2328510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:57.212809 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cba82-d4f3-4e9e-b136-a8c1f2328510 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:57.225919 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1440/2840] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:09:57.231699 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331479d9-4a51-49ca-86e1-2f919e27de92 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:57.241114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331479d9-4a51-49ca-86e1-2f919e27de92 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:57.246323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ef8c2-cc59-4912-ae65-8671b197222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:57.246975 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ef8c2-cc59-4912-ae65-8671b197222d admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:57.247255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ef8c2-cc59-4912-ae65-8671b197222d admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:57.247532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ef8c2-cc59-4912-ae65-8671b197222d admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:57.248240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ef8c2-cc59-4912-ae65-8671b197222d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:57.250164 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ef8c2-cc59-4912-ae65-8671b197222d admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:57.350002 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1401/2841] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:09:57 2022] POST /identity/v3/projects => generated 355 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:09:57.354036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cba82-d4f3-4e9e-b136-a8c1f2328510 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:57.365808 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cba82-d4f3-4e9e-b136-a8c1f2328510 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:57.369794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:09:57.424894 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a307-48e5-4857-be41-bd1ab2fc728e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:57.425614 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a307-48e5-4857-be41-bd1ab2fc728e admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:57.425887 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a307-48e5-4857-be41-bd1ab2fc728e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:57.426156 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a307-48e5-4857-be41-bd1ab2fc728e admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:57.426842 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507a307-48e5-4857-be41-bd1ab2fc728e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:57.428762 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507a307-48e5-4857-be41-bd1ab2fc728e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:57.553536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1441/2842] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:09:57 2022] POST /identity/v3/users => generated 278 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:09:57.558418 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ef8c2-cc59-4912-ae65-8671b197222d admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:57.568907 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ef8c2-cc59-4912-ae65-8671b197222d admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:57.574405 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf45b8-41ee-4161-9216-1a4709405a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:57.575083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf45b8-41ee-4161-9216-1a4709405a4e admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:57.575362 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf45b8-41ee-4161-9216-1a4709405a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:57.575756 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf45b8-41ee-4161-9216-1a4709405a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:57.576642 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf45b8-41ee-4161-9216-1a4709405a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:57.578242 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf45b8-41ee-4161-9216-1a4709405a4e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:57.589117 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1402/2843] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:09:57.593442 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a307-48e5-4857-be41-bd1ab2fc728e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:57.607212 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a307-48e5-4857-be41-bd1ab2fc728e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:57.609557 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82251d8b-2929-4030-95fe-b8f1cfa55836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:57.610230 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82251d8b-2929-4030-95fe-b8f1cfa55836 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:57.610541 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82251d8b-2929-4030-95fe-b8f1cfa55836 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:57.610818 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82251d8b-2929-4030-95fe-b8f1cfa55836 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:57.611606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82251d8b-2929-4030-95fe-b8f1cfa55836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:57.613337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82251d8b-2929-4030-95fe-b8f1cfa55836 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:57.624438 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1442/2844] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:09:57.628862 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf45b8-41ee-4161-9216-1a4709405a4e admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:57.639900 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf45b8-41ee-4161-9216-1a4709405a4e admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:57.645331 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf233b-ddd0-4e68-97d5-356660562503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:57.646214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf233b-ddd0-4e68-97d5-356660562503 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:57.646494 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf233b-ddd0-4e68-97d5-356660562503 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:57.646771 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf233b-ddd0-4e68-97d5-356660562503 admin admin] PATH_INFO: `/v3/projects/9a28d674c3144171bbb99dd180c8c6b0/users/ef8600bda6e04d85a55f1dcf39ee4320/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:57.661951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf233b-ddd0-4e68-97d5-356660562503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a28d674c3144171bbb99dd180c8c6b0, user_id=ef8600bda6e04d85a55f1dcf39ee4320, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:57.670253 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf233b-ddd0-4e68-97d5-356660562503 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:57.816565 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1403/2845] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:09:57 2022] PUT /identity/v3/projects/9a28d674c3144171bbb99dd180c8c6b0/users/ef8600bda6e04d85a55f1dcf39ee4320/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:09:57.829077 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409ff14-68ad-4530-b8f1-b2ba1b92c679 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:57.829366 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409ff14-68ad-4530-b8f1-b2ba1b92c679 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:57.829644 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409ff14-68ad-4530-b8f1-b2ba1b92c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:57.856303 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-3409ff14-68ad-4530-b8f1-b2ba1b92c679 None None] MFA Rules not processed for user `ef8600bda6e04d85a55f1dcf39ee4320`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:09:57.857632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-3409ff14-68ad-4530-b8f1-b2ba1b92c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:09:57.922367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1443/2846] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:09:57 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:09:57.927057 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf233b-ddd0-4e68-97d5-356660562503 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:57.934723 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:09:57.992239 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf233b-ddd0-4e68-97d5-356660562503 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:57.997859 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaf195-722f-4d80-8240-ddcdb5850a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:57.998536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaf195-722f-4d80-8240-ddcdb5850a98 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:57.998812 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaf195-722f-4d80-8240-ddcdb5850a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:57.999099 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaf195-722f-4d80-8240-ddcdb5850a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:57.999783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eaf195-722f-4d80-8240-ddcdb5850a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:58.001891 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eaf195-722f-4d80-8240-ddcdb5850a98 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:58.161447 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1404/2847] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:09:57 2022] POST /identity/v3/projects => generated 355 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:09:58.165423 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409ff14-68ad-4530-b8f1-b2ba1b92c679 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:58.176888 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409ff14-68ad-4530-b8f1-b2ba1b92c679 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:58.237649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0206b-eb80-4950-91e9-81f9c521e87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:58.240882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0206b-eb80-4950-91e9-81f9c521e87f admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:58.240882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0206b-eb80-4950-91e9-81f9c521e87f admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:58.240882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0206b-eb80-4950-91e9-81f9c521e87f admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:58.240882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0206b-eb80-4950-91e9-81f9c521e87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:58.241892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0206b-eb80-4950-91e9-81f9c521e87f admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:58.336317 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1444/2848] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:09:58 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:09:58.341530 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaf195-722f-4d80-8240-ddcdb5850a98 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:58.352297 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaf195-722f-4d80-8240-ddcdb5850a98 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:58.357019 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72144704-eb86-473e-adba-f50398f6767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:58.357718 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72144704-eb86-473e-adba-f50398f6767b admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:58.358003 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72144704-eb86-473e-adba-f50398f6767b admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:58.358278 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72144704-eb86-473e-adba-f50398f6767b admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:58.359006 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72144704-eb86-473e-adba-f50398f6767b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:58.360644 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72144704-eb86-473e-adba-f50398f6767b admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:58.372437 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1405/2849] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:09:58.376803 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0206b-eb80-4950-91e9-81f9c521e87f admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:58.385040 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:09:58.389367 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0206b-eb80-4950-91e9-81f9c521e87f admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:58.403337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0a1e7-4a74-4021-9ee7-c50fc8660801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:58.403337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0a1e7-4a74-4021-9ee7-c50fc8660801 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:58.403337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0a1e7-4a74-4021-9ee7-c50fc8660801 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:58.403337 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0a1e7-4a74-4021-9ee7-c50fc8660801 admin admin] PATH_INFO: `/v3/projects/292f9da9afc64a2a88d6049ba9c2859f/users/d83989fcd3a14e14aa9e9bbce352e698/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:58.413720 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0a1e7-4a74-4021-9ee7-c50fc8660801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292f9da9afc64a2a88d6049ba9c2859f, user_id=d83989fcd3a14e14aa9e9bbce352e698, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:58.416412 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0a1e7-4a74-4021-9ee7-c50fc8660801 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:58.542540 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1445/2850] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:09:58 2022] PUT /identity/v3/projects/292f9da9afc64a2a88d6049ba9c2859f/users/d83989fcd3a14e14aa9e9bbce352e698/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:09:58.546842 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72144704-eb86-473e-adba-f50398f6767b admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:58.558239 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72144704-eb86-473e-adba-f50398f6767b admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:58.617455 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dd6a7-1252-4cd9-9715-ef085e5aaf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:58.618161 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dd6a7-1252-4cd9-9715-ef085e5aaf4d admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:58.618407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dd6a7-1252-4cd9-9715-ef085e5aaf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:58.619193 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dd6a7-1252-4cd9-9715-ef085e5aaf4d admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:58.620056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dd6a7-1252-4cd9-9715-ef085e5aaf4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:58.621701 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dd6a7-1252-4cd9-9715-ef085e5aaf4d admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:58.631532 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1406/2851] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:09:58.636467 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0a1e7-4a74-4021-9ee7-c50fc8660801 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:58.646764 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0a1e7-4a74-4021-9ee7-c50fc8660801 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:58.651387 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38427c5-9013-4f7f-b520-52d4b3c4b79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:58.652270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38427c5-9013-4f7f-b520-52d4b3c4b79e admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:58.652586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38427c5-9013-4f7f-b520-52d4b3c4b79e admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:58.652864 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38427c5-9013-4f7f-b520-52d4b3c4b79e admin admin] PATH_INFO: `/v3/projects/292f9da9afc64a2a88d6049ba9c2859f/users/d83989fcd3a14e14aa9e9bbce352e698/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:58.654831 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38427c5-9013-4f7f-b520-52d4b3c4b79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=292f9da9afc64a2a88d6049ba9c2859f, user_id=d83989fcd3a14e14aa9e9bbce352e698, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:58.657498 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38427c5-9013-4f7f-b520-52d4b3c4b79e admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:58.668129 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1446/2852] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:09:58 2022] PUT /identity/v3/projects/292f9da9afc64a2a88d6049ba9c2859f/users/d83989fcd3a14e14aa9e9bbce352e698/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:09:58.678490 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4df2a-18ee-4f39-b08e-de76670c25ff None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:58.678793 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4df2a-18ee-4f39-b08e-de76670c25ff None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:58.679077 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4df2a-18ee-4f39-b08e-de76670c25ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:58.709556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-6cb4df2a-18ee-4f39-b08e-de76670c25ff None None] MFA Rules not processed for user `d83989fcd3a14e14aa9e9bbce352e698`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:09:58.710869 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-6cb4df2a-18ee-4f39-b08e-de76670c25ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:09:58.777998 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:09:58.781861 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1407/2853] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:09:58 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:09:58.794727 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38427c5-9013-4f7f-b520-52d4b3c4b79e admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:58.796468 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-c38427c5-9013-4f7f-b520-52d4b3c4b79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:09:58.854718 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38427c5-9013-4f7f-b520-52d4b3c4b79e admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:58.858385 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48771a47-92a1-4ff9-8c73-9ffc38258157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:58.859025 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48771a47-92a1-4ff9-8c73-9ffc38258157 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:58.859314 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48771a47-92a1-4ff9-8c73-9ffc38258157 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:58.859589 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48771a47-92a1-4ff9-8c73-9ffc38258157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:58.869537 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48771a47-92a1-4ff9-8c73-9ffc38258157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:58.871113 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48771a47-92a1-4ff9-8c73-9ffc38258157 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:58.880746 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1447/2854] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:09:58 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:09:59.191873 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4df2a-18ee-4f39-b08e-de76670c25ff None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:09:59.199584 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4df2a-18ee-4f39-b08e-de76670c25ff None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:09:59.203231 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bed94-01e2-4d58-9f86-94cba2f824f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:09:59.203865 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bed94-01e2-4d58-9f86-94cba2f824f6 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:09:59.204148 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bed94-01e2-4d58-9f86-94cba2f824f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:09:59.204425 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bed94-01e2-4d58-9f86-94cba2f824f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:09:59.262619 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bed94-01e2-4d58-9f86-94cba2f824f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:09:59.264086 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bed94-01e2-4d58-9f86-94cba2f824f6 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:09:59.273528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1408/2855] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:09:59 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:10:08.876322 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:09.269016 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=28 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:18.153333 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48771a47-92a1-4ff9-8c73-9ffc38258157 service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:18.215994 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48771a47-92a1-4ff9-8c73-9ffc38258157 service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:18.220536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:18.221413 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:18.221691 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:18.221963 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] PATH_INFO: `/v3/users/ef8600bda6e04d85a55f1dcf39ee4320` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:18.223148 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8600bda6e04d85a55f1dcf39ee4320)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:18.225098 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:18.396205 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8600bda6e04d85a55f1dcf39ee4320'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:18.409101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8600bda6e04d85a55f1dcf39ee4320'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:18.415911 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8600bda6e04d85a55f1dcf39ee4320'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:18.484368 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8600bda6e04d85a55f1dcf39ee4320'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:18.485026 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8600bda6e04d85a55f1dcf39ee4320'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:18.491358 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1448/2856] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:10:18 2022] DELETE /identity/v3/users/ef8600bda6e04d85a55f1dcf39ee4320 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:18.496255 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e34ab-7224-4240-befd-0e820238a2b5 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:18.497562 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e34ab-7224-4240-befd-0e820238a2b5 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:18.497562 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e34ab-7224-4240-befd-0e820238a2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:18.515103 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-489e34ab-7224-4240-befd-0e820238a2b5 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:18.516300 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-489e34ab-7224-4240-befd-0e820238a2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:18.579263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1409/2857] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 18:10:18.589227 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:18.591267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:18.648569 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d79c2e-bed9-4dee-95fa-caf6d29a3c88 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:18.656895 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b921c96-97ad-4c7c-9004-0648bb295d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:18.657579 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b921c96-97ad-4c7c-9004-0648bb295d07 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:18.657840 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b921c96-97ad-4c7c-9004-0648bb295d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:18.658357 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b921c96-97ad-4c7c-9004-0648bb295d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:18.667995 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b921c96-97ad-4c7c-9004-0648bb295d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:18.670124 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b921c96-97ad-4c7c-9004-0648bb295d07 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:18.680805 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1449/2858] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:10:19.160780 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e34ab-7224-4240-befd-0e820238a2b5 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:19.162229 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-489e34ab-7224-4240-befd-0e820238a2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:19.177112 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e34ab-7224-4240-befd-0e820238a2b5 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:19.182048 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:19.183234 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:19.183516 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:19.183789 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] PATH_INFO: `/v3/projects/9a28d674c3144171bbb99dd180c8c6b0` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:19.185045 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a28d674c3144171bbb99dd180c8c6b0)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:19.186979 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:19.290576 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a28d674c3144171bbb99dd180c8c6b0', 'request_id': 'req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:19.296225 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a28d674c3144171bbb99dd180c8c6b0', 'request_id': 'req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:19.364318 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a28d674c3144171bbb99dd180c8c6b0', 'request_id': 'req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:19.377174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] The token cache is being invalidate because project 9a28d674c3144171bbb99dd180c8c6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:10:19.377464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:19.378140 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:19.379736 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1410/2859] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:10:19 2022] DELETE /identity/v3/projects/9a28d674c3144171bbb99dd180c8c6b0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:19.383860 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b921c96-97ad-4c7c-9004-0648bb295d07 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:19.394606 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b921c96-97ad-4c7c-9004-0648bb295d07 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:19.414794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:19.454896 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5d161-2c3b-4fec-b362-c6003026d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:19.455684 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5d161-2c3b-4fec-b362-c6003026d3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:19.455964 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5d161-2c3b-4fec-b362-c6003026d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:19.456236 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5d161-2c3b-4fec-b362-c6003026d3dd admin admin] PATH_INFO: `/v3/users/d83989fcd3a14e14aa9e9bbce352e698` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:19.457477 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5d161-2c3b-4fec-b362-c6003026d3dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83989fcd3a14e14aa9e9bbce352e698)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:19.459435 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5d161-2c3b-4fec-b362-c6003026d3dd admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:19.594052 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3ba5d161-2c3b-4fec-b362-c6003026d3dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83989fcd3a14e14aa9e9bbce352e698'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:19.605641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3ba5d161-2c3b-4fec-b362-c6003026d3dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83989fcd3a14e14aa9e9bbce352e698'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:19.612758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3ba5d161-2c3b-4fec-b362-c6003026d3dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83989fcd3a14e14aa9e9bbce352e698'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:19.684758 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3ba5d161-2c3b-4fec-b362-c6003026d3dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83989fcd3a14e14aa9e9bbce352e698'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:19.685396 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-3ba5d161-2c3b-4fec-b362-c6003026d3dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83989fcd3a14e14aa9e9bbce352e698'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:19.691841 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1450/2860] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:10:19 2022] DELETE /identity/v3/users/d83989fcd3a14e14aa9e9bbce352e698 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:20.142717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:20.144194 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:20.158548 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98664ab7-f6a9-4f47-9a59-c2d74a2ddc96 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:20.218650 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429573af-06ae-4e18-90ea-f5c782e05ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:20.219543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429573af-06ae-4e18-90ea-f5c782e05ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:20.219831 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429573af-06ae-4e18-90ea-f5c782e05ece admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:20.220105 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429573af-06ae-4e18-90ea-f5c782e05ece admin admin] PATH_INFO: `/v3/projects/292f9da9afc64a2a88d6049ba9c2859f` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:20.221357 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429573af-06ae-4e18-90ea-f5c782e05ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=292f9da9afc64a2a88d6049ba9c2859f)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:20.223272 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429573af-06ae-4e18-90ea-f5c782e05ece admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:20.314823 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:20.332177 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-429573af-06ae-4e18-90ea-f5c782e05ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292f9da9afc64a2a88d6049ba9c2859f', 'request_id': 'req-429573af-06ae-4e18-90ea-f5c782e05ece'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:20.337580 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-429573af-06ae-4e18-90ea-f5c782e05ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292f9da9afc64a2a88d6049ba9c2859f', 'request_id': 'req-429573af-06ae-4e18-90ea-f5c782e05ece'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:20.404729 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-429573af-06ae-4e18-90ea-f5c782e05ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292f9da9afc64a2a88d6049ba9c2859f', 'request_id': 'req-429573af-06ae-4e18-90ea-f5c782e05ece'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:20.417376 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-429573af-06ae-4e18-90ea-f5c782e05ece admin admin] The token cache is being invalidate because project 292f9da9afc64a2a88d6049ba9c2859f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:10:20.417663 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-429573af-06ae-4e18-90ea-f5c782e05ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:20.419014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-429573af-06ae-4e18-90ea-f5c782e05ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:20.420690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1411/2861] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:10:20 2022] DELETE /identity/v3/projects/292f9da9afc64a2a88d6049ba9c2859f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:20.425839 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072dd23-df8f-4c05-b30b-b6accb8a5c6e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:20.426961 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072dd23-df8f-4c05-b30b-b6accb8a5c6e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:20.426961 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072dd23-df8f-4c05-b30b-b6accb8a5c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:20.446358 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-b072dd23-df8f-4c05-b30b-b6accb8a5c6e None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:20.449970 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-b072dd23-df8f-4c05-b30b-b6accb8a5c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:20.510932 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1451/2862] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:20.518949 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1492-278f-45ca-94cf-35b5d02bcdb3 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:20.519239 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1492-278f-45ca-94cf-35b5d02bcdb3 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:20.519524 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1492-278f-45ca-94cf-35b5d02bcdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:20.539069 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-3a7e1492-278f-45ca-94cf-35b5d02bcdb3 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:20.540302 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-3a7e1492-278f-45ca-94cf-35b5d02bcdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:20.549106 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1412/2863] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:20.553469 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072dd23-df8f-4c05-b30b-b6accb8a5c6e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:20.563849 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072dd23-df8f-4c05-b30b-b6accb8a5c6e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:20.568766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd90004-7cd6-4228-bf91-208575db19bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:20.569375 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd90004-7cd6-4228-bf91-208575db19bf admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:20.569659 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd90004-7cd6-4228-bf91-208575db19bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:20.569935 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd90004-7cd6-4228-bf91-208575db19bf admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:20.570690 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd90004-7cd6-4228-bf91-208575db19bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:10:20.570998 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd90004-7cd6-4228-bf91-208575db19bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:20.572670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd90004-7cd6-4228-bf91-208575db19bf admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:20.584692 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1452/2864] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:10:20.589018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e1492-278f-45ca-94cf-35b5d02bcdb3 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:20.599024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e1492-278f-45ca-94cf-35b5d02bcdb3 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:20.603733 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483371e4-b0fc-4ec9-ae47-885047b3359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:20.604357 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483371e4-b0fc-4ec9-ae47-885047b3359e admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:20.604743 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483371e4-b0fc-4ec9-ae47-885047b3359e admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:20.605017 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483371e4-b0fc-4ec9-ae47-885047b3359e admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:20.605696 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483371e4-b0fc-4ec9-ae47-885047b3359e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:20.608144 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483371e4-b0fc-4ec9-ae47-885047b3359e admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:20.697539 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1413/2865] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:10:20 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:10:20.701944 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd90004-7cd6-4228-bf91-208575db19bf admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:20.712398 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd90004-7cd6-4228-bf91-208575db19bf admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:20.740096 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:20.773202 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94164b6-2e4b-4039-89f0-d8184096ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:20.773931 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94164b6-2e4b-4039-89f0-d8184096ff9b admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:20.774194 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94164b6-2e4b-4039-89f0-d8184096ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:20.774456 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94164b6-2e4b-4039-89f0-d8184096ff9b admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:20.775201 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94164b6-2e4b-4039-89f0-d8184096ff9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:20.777229 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94164b6-2e4b-4039-89f0-d8184096ff9b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:20.874681 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1453/2866] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:10:20 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:10:20.878776 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483371e4-b0fc-4ec9-ae47-885047b3359e admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:20.890640 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483371e4-b0fc-4ec9-ae47-885047b3359e admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:20.895485 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed29f8-5abb-4551-ae9b-f26ad53e2ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:20.896154 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed29f8-5abb-4551-ae9b-f26ad53e2ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:20.896434 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed29f8-5abb-4551-ae9b-f26ad53e2ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:20.896739 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed29f8-5abb-4551-ae9b-f26ad53e2ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:20.897475 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed29f8-5abb-4551-ae9b-f26ad53e2ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:20.899075 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed29f8-5abb-4551-ae9b-f26ad53e2ba4 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:20.913197 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1414/2867] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:10:20.917536 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94164b6-2e4b-4039-89f0-d8184096ff9b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:20.928552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94164b6-2e4b-4039-89f0-d8184096ff9b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:20.933670 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ae257-03e0-4cee-b7f7-6b16d18abef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:20.935027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ae257-03e0-4cee-b7f7-6b16d18abef7 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:20.935305 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ae257-03e0-4cee-b7f7-6b16d18abef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:20.935580 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ae257-03e0-4cee-b7f7-6b16d18abef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:20.936311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ae257-03e0-4cee-b7f7-6b16d18abef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:20.938939 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ae257-03e0-4cee-b7f7-6b16d18abef7 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:20.950191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1454/2868] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:10:20.954357 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed29f8-5abb-4551-ae9b-f26ad53e2ba4 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:20.964837 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed29f8-5abb-4551-ae9b-f26ad53e2ba4 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:20.970083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11790da4-52cc-4502-b77a-a5b0bce8e90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:20.970960 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11790da4-52cc-4502-b77a-a5b0bce8e90a admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:20.971240 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11790da4-52cc-4502-b77a-a5b0bce8e90a admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:20.971514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11790da4-52cc-4502-b77a-a5b0bce8e90a admin admin] PATH_INFO: `/v3/projects/170bb4297e1c4473a6b5d770e9cd3b1e/users/eb3a7186f3894324b9861cd52662519b/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:20.986368 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11790da4-52cc-4502-b77a-a5b0bce8e90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=170bb4297e1c4473a6b5d770e9cd3b1e, user_id=eb3a7186f3894324b9861cd52662519b, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:20.989055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11790da4-52cc-4502-b77a-a5b0bce8e90a admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:21.091037 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1415/2869] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:10:20 2022] PUT /identity/v3/projects/170bb4297e1c4473a6b5d770e9cd3b1e/users/eb3a7186f3894324b9861cd52662519b/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:21.102897 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023395f5-93e1-48c7-8cc8-17506acaf6c5 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:21.103188 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023395f5-93e1-48c7-8cc8-17506acaf6c5 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:21.103471 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023395f5-93e1-48c7-8cc8-17506acaf6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:21.129640 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-023395f5-93e1-48c7-8cc8-17506acaf6c5 None None] MFA Rules not processed for user `eb3a7186f3894324b9861cd52662519b`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:21.130739 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-023395f5-93e1-48c7-8cc8-17506acaf6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:21.198091 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1455/2870] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:21.203927 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11790da4-52cc-4502-b77a-a5b0bce8e90a admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:21.274668 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11790da4-52cc-4502-b77a-a5b0bce8e90a admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:21.280296 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b8206-d795-4d02-8440-faa51b2e51fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:21.281009 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b8206-d795-4d02-8440-faa51b2e51fb admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:21.281295 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b8206-d795-4d02-8440-faa51b2e51fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:21.281573 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b8206-d795-4d02-8440-faa51b2e51fb admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:21.282290 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b8206-d795-4d02-8440-faa51b2e51fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:21.284258 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b8206-d795-4d02-8440-faa51b2e51fb admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:21.383332 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1416/2871] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:10:21 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:10:21.388521 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023395f5-93e1-48c7-8cc8-17506acaf6c5 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:21.400027 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023395f5-93e1-48c7-8cc8-17506acaf6c5 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:21.463733 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c3bcb-67e0-4922-b3d8-6ace2ad0860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:21.464436 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c3bcb-67e0-4922-b3d8-6ace2ad0860b admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:21.464749 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c3bcb-67e0-4922-b3d8-6ace2ad0860b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:21.465054 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c3bcb-67e0-4922-b3d8-6ace2ad0860b admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:21.465779 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c3bcb-67e0-4922-b3d8-6ace2ad0860b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:21.467759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c3bcb-67e0-4922-b3d8-6ace2ad0860b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:21.622968 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1456/2872] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:10:21 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:10:21.627066 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b8206-d795-4d02-8440-faa51b2e51fb admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:21.638898 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b8206-d795-4d02-8440-faa51b2e51fb admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:21.643755 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4462e4-65c9-403d-8d48-62bdbaf5aa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:21.655952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4462e4-65c9-403d-8d48-62bdbaf5aa74 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:21.655952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4462e4-65c9-403d-8d48-62bdbaf5aa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:21.655952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4462e4-65c9-403d-8d48-62bdbaf5aa74 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:21.655952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4462e4-65c9-403d-8d48-62bdbaf5aa74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:21.655952 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4462e4-65c9-403d-8d48-62bdbaf5aa74 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:21.658850 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1417/2873] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:10:21.663141 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c3bcb-67e0-4922-b3d8-6ace2ad0860b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:21.674766 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c3bcb-67e0-4922-b3d8-6ace2ad0860b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:21.679641 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cdf33-ac40-415a-b7c3-063d7b65f621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:21.680570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cdf33-ac40-415a-b7c3-063d7b65f621 admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:21.680860 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cdf33-ac40-415a-b7c3-063d7b65f621 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:21.681142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cdf33-ac40-415a-b7c3-063d7b65f621 admin admin] PATH_INFO: `/v3/projects/9a58ca1e68b74ab18267d98f896c7898/users/671858a416864e0ea65f5c105ddb6f1c/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:21.697175 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cdf33-ac40-415a-b7c3-063d7b65f621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a58ca1e68b74ab18267d98f896c7898, user_id=671858a416864e0ea65f5c105ddb6f1c, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:21.699837 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cdf33-ac40-415a-b7c3-063d7b65f621 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:21.787817 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1457/2874] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:10:21 2022] PUT /identity/v3/projects/9a58ca1e68b74ab18267d98f896c7898/users/671858a416864e0ea65f5c105ddb6f1c/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 18:10:21.791896 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4462e4-65c9-403d-8d48-62bdbaf5aa74 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:21.802943 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4462e4-65c9-403d-8d48-62bdbaf5aa74 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:21.824674 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:21.860513 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cdbf5-acc7-4387-af20-bff637164244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:21.861092 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cdbf5-acc7-4387-af20-bff637164244 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:21.861372 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cdbf5-acc7-4387-af20-bff637164244 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:21.861649 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cdbf5-acc7-4387-af20-bff637164244 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:21.862377 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915cdbf5-acc7-4387-af20-bff637164244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:21.863966 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915cdbf5-acc7-4387-af20-bff637164244 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:21.874724 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1418/2875] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:10:21.879407 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cdf33-ac40-415a-b7c3-063d7b65f621 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:21.885036 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:21.893345 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cdf33-ac40-415a-b7c3-063d7b65f621 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:21.895784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8078a7b-ae0d-46ab-a79c-c00c2396008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:21.896723 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8078a7b-ae0d-46ab-a79c-c00c2396008c admin admin] REQUEST_METHOD: `PUT` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:21.897004 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8078a7b-ae0d-46ab-a79c-c00c2396008c admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:21.897279 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8078a7b-ae0d-46ab-a79c-c00c2396008c admin admin] PATH_INFO: `/v3/projects/9a58ca1e68b74ab18267d98f896c7898/users/671858a416864e0ea65f5c105ddb6f1c/roles/521b4306dc4a467ebe7f9b80ec988a28` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:21.899270 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8078a7b-ae0d-46ab-a79c-c00c2396008c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a58ca1e68b74ab18267d98f896c7898, user_id=671858a416864e0ea65f5c105ddb6f1c, role_id=521b4306dc4a467ebe7f9b80ec988a28)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:21.901934 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8078a7b-ae0d-46ab-a79c-c00c2396008c admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:21.913402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1458/2876] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:10:21 2022] PUT /identity/v3/projects/9a58ca1e68b74ab18267d98f896c7898/users/671858a416864e0ea65f5c105ddb6f1c/roles/521b4306dc4a467ebe7f9b80ec988a28 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:21.924626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc55f0-bb5d-4b0a-8889-da5c570d92e5 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:21.924922 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc55f0-bb5d-4b0a-8889-da5c570d92e5 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:21.928055 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc55f0-bb5d-4b0a-8889-da5c570d92e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:21.953773 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-d3cc55f0-bb5d-4b0a-8889-da5c570d92e5 None None] MFA Rules not processed for user `671858a416864e0ea65f5c105ddb6f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:21.955093 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d3cc55f0-bb5d-4b0a-8889-da5c570d92e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:22.024775 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1419/2877] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:22.036632 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8078a7b-ae0d-46ab-a79c-c00c2396008c admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:22.038416 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-e8078a7b-ae0d-46ab-a79c-c00c2396008c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:22.099419 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8078a7b-ae0d-46ab-a79c-c00c2396008c admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:22.103157 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488c0dc-7f85-4ba5-b401-1bc32fd007c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:22.103833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488c0dc-7f85-4ba5-b401-1bc32fd007c9 service cinder] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:22.104120 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488c0dc-7f85-4ba5-b401-1bc32fd007c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:22.104402 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488c0dc-7f85-4ba5-b401-1bc32fd007c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:22.114761 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488c0dc-7f85-4ba5-b401-1bc32fd007c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:22.116183 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488c0dc-7f85-4ba5-b401-1bc32fd007c9 service cinder] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:22.125983 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1459/2878] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:10:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:10:22.356955 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc55f0-bb5d-4b0a-8889-da5c570d92e5 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:22.367174 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc55f0-bb5d-4b0a-8889-da5c570d92e5 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:22.370912 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b189b64-5a37-41ff-a4de-b45d3c1691fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:22.371783 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b189b64-5a37-41ff-a4de-b45d3c1691fe service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:22.372072 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b189b64-5a37-41ff-a4de-b45d3c1691fe service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:22.372348 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b189b64-5a37-41ff-a4de-b45d3c1691fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:22.433901 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b189b64-5a37-41ff-a4de-b45d3c1691fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:22.435359 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b189b64-5a37-41ff-a4de-b45d3c1691fe service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:22.444728 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1420/2879] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:10:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:10:28.940467 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488c0dc-7f85-4ba5-b401-1bc32fd007c9 service cinder] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:29.007203 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488c0dc-7f85-4ba5-b401-1bc32fd007c9 service cinder] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:29.011764 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:29.012753 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:29.013033 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:29.013307 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] PATH_INFO: `/v3/users/eb3a7186f3894324b9861cd52662519b` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:29.014551 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3a7186f3894324b9861cd52662519b)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:29.016408 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:29.189142 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3a7186f3894324b9861cd52662519b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:29.201710 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3a7186f3894324b9861cd52662519b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:29.209863 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3a7186f3894324b9861cd52662519b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:29.290043 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3a7186f3894324b9861cd52662519b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:29.290583 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3a7186f3894324b9861cd52662519b'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:29.297268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1460/2880] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:10:28 2022] DELETE /identity/v3/users/eb3a7186f3894324b9861cd52662519b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:29.301925 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e84b1-9c0e-42f7-8091-f645fc6f1cce None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:29.302413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e84b1-9c0e-42f7-8091-f645fc6f1cce None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:29.302579 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e84b1-9c0e-42f7-8091-f645fc6f1cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:29.320360 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-af2e84b1-9c0e-42f7-8091-f645fc6f1cce None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:29.321618 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-af2e84b1-9c0e-42f7-8091-f645fc6f1cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:29.363285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=100 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:29.381986 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1421/2881] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:29.392975 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:29.394420 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:29.409087 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:29.454020 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941df6cd-5c9e-4ec4-94e6-cbdbce5a3708 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:29.457824 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa433755-e612-4323-9123-7a751775c6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:29.458464 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433755-e612-4323-9123-7a751775c6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:29.458743 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433755-e612-4323-9123-7a751775c6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:29.459017 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433755-e612-4323-9123-7a751775c6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:29.468272 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa433755-e612-4323-9123-7a751775c6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:29.469751 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa433755-e612-4323-9123-7a751775c6a5 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:29.479479 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1461/2882] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:10:29.880513 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e84b1-9c0e-42f7-8091-f645fc6f1cce None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:29.881988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-af2e84b1-9c0e-42f7-8091-f645fc6f1cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:29.895514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e84b1-9c0e-42f7-8091-f645fc6f1cce None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:29.900167 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:29.901065 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:29.901350 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:29.901636 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] PATH_INFO: `/v3/projects/170bb4297e1c4473a6b5d770e9cd3b1e` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:29.903188 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170bb4297e1c4473a6b5d770e9cd3b1e)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:29.905285 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:30.045606 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170bb4297e1c4473a6b5d770e9cd3b1e', 'request_id': 'req-b15606b8-200d-43e8-b4de-f20b21578af0'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:30.051373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170bb4297e1c4473a6b5d770e9cd3b1e', 'request_id': 'req-b15606b8-200d-43e8-b4de-f20b21578af0'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:30.129403 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170bb4297e1c4473a6b5d770e9cd3b1e', 'request_id': 'req-b15606b8-200d-43e8-b4de-f20b21578af0'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:30.140716 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] The token cache is being invalidate because project 170bb4297e1c4473a6b5d770e9cd3b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:10:30.141001 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:30.141625 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:30.143211 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1422/2883] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:10:29 2022] DELETE /identity/v3/projects/170bb4297e1c4473a6b5d770e9cd3b1e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:30.147387 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa433755-e612-4323-9123-7a751775c6a5 service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:30.157451 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa433755-e612-4323-9123-7a751775c6a5 service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:30.215728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d66842-f2d4-4485-ba6b-cbbd0350ec91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:30.217268 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d66842-f2d4-4485-ba6b-cbbd0350ec91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:30.217556 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d66842-f2d4-4485-ba6b-cbbd0350ec91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:30.217833 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d66842-f2d4-4485-ba6b-cbbd0350ec91 admin admin] PATH_INFO: `/v3/users/671858a416864e0ea65f5c105ddb6f1c` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:30.219347 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d66842-f2d4-4485-ba6b-cbbd0350ec91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=671858a416864e0ea65f5c105ddb6f1c)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:30.221311 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d66842-f2d4-4485-ba6b-cbbd0350ec91 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:30.481759 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a8d66842-f2d4-4485-ba6b-cbbd0350ec91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671858a416864e0ea65f5c105ddb6f1c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:30.493629 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a8d66842-f2d4-4485-ba6b-cbbd0350ec91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671858a416864e0ea65f5c105ddb6f1c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:30.500798 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a8d66842-f2d4-4485-ba6b-cbbd0350ec91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671858a416864e0ea65f5c105ddb6f1c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:30.592784 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a8d66842-f2d4-4485-ba6b-cbbd0350ec91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671858a416864e0ea65f5c105ddb6f1c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:30.593522 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-a8d66842-f2d4-4485-ba6b-cbbd0350ec91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671858a416864e0ea65f5c105ddb6f1c'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:30.600117 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1462/2884] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:10:30 2022] DELETE /identity/v3/users/671858a416864e0ea65f5c105ddb6f1c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:31.028551 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:31.029995 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:31.044247 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15606b8-200d-43e8-b4de-f20b21578af0 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:31.105420 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:31.106408 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:31.106693 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:31.106991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97 admin admin] PATH_INFO: `/v3/projects/9a58ca1e68b74ab18267d98f896c7898` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:31.108179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a58ca1e68b74ab18267d98f896c7898)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:31.110138 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:31.227543 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a58ca1e68b74ab18267d98f896c7898', 'request_id': 'req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:31.233213 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a58ca1e68b74ab18267d98f896c7898', 'request_id': 'req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:31.295569 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a58ca1e68b74ab18267d98f896c7898', 'request_id': 'req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:31.302953 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:31.307556 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97 admin admin] The token cache is being invalidate because project 9a58ca1e68b74ab18267d98f896c7898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:10:31.307830 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:31.309010 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-8fc9aba4-212e-4f3b-b464-6e7317b2cd97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:31.310892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1423/2885] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:10:31 2022] DELETE /identity/v3/projects/9a58ca1e68b74ab18267d98f896c7898 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:31.316958 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892df2a1-e4c6-4ec4-bdc3-07c5dd45593c None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:31.317460 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892df2a1-e4c6-4ec4-bdc3-07c5dd45593c None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:31.317576 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892df2a1-e4c6-4ec4-bdc3-07c5dd45593c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:31.336310 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-892df2a1-e4c6-4ec4-bdc3-07c5dd45593c None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:31.337574 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-892df2a1-e4c6-4ec4-bdc3-07c5dd45593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:31.368099 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:31.399844 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1463/2886] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:31.409068 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7cbbc-125b-49e4-8eec-3f4a24097aa3 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:31.409352 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7cbbc-125b-49e4-8eec-3f4a24097aa3 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:31.409626 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7cbbc-125b-49e4-8eec-3f4a24097aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:31.429073 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-9fc7cbbc-125b-49e4-8eec-3f4a24097aa3 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:31.430288 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-9fc7cbbc-125b-49e4-8eec-3f4a24097aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:31.439276 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1424/2887] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:31.443586 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892df2a1-e4c6-4ec4-bdc3-07c5dd45593c None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:31.454181 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892df2a1-e4c6-4ec4-bdc3-07c5dd45593c None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:31.458728 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209f8fb-35bb-4872-941e-3531cfa72d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:31.459409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209f8fb-35bb-4872-941e-3531cfa72d67 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:31.459724 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209f8fb-35bb-4872-941e-3531cfa72d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:31.460013 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209f8fb-35bb-4872-941e-3531cfa72d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:31.460757 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209f8fb-35bb-4872-941e-3531cfa72d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:10:31.461063 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209f8fb-35bb-4872-941e-3531cfa72d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:31.462653 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209f8fb-35bb-4872-941e-3531cfa72d67 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:31.475426 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1464/2888] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:10:31.479792 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7cbbc-125b-49e4-8eec-3f4a24097aa3 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:31.490101 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7cbbc-125b-49e4-8eec-3f4a24097aa3 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:31.494881 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9a11a-54ae-4c0f-9c32-fadc55e9bff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:31.495528 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9a11a-54ae-4c0f-9c32-fadc55e9bff1 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:31.495810 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9a11a-54ae-4c0f-9c32-fadc55e9bff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:31.496085 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9a11a-54ae-4c0f-9c32-fadc55e9bff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:31.497413 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9a11a-54ae-4c0f-9c32-fadc55e9bff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:31.499342 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9a11a-54ae-4c0f-9c32-fadc55e9bff1 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:31.588246 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1425/2889] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:10:31 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:10:31.592389 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209f8fb-35bb-4872-941e-3531cfa72d67 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:31.602304 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209f8fb-35bb-4872-941e-3531cfa72d67 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:31.658892 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b22c84-27e1-4cd1-a74d-4d30d66a4913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:31.659552 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b22c84-27e1-4cd1-a74d-4d30d66a4913 admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:31.659870 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b22c84-27e1-4cd1-a74d-4d30d66a4913 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:31.660350 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b22c84-27e1-4cd1-a74d-4d30d66a4913 admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:31.661836 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b22c84-27e1-4cd1-a74d-4d30d66a4913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:31.663736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b22c84-27e1-4cd1-a74d-4d30d66a4913 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:31.775648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1465/2890] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:10:31 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:10:31.780517 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9a11a-54ae-4c0f-9c32-fadc55e9bff1 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:31.790835 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9a11a-54ae-4c0f-9c32-fadc55e9bff1 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:31.796717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d0f08-de36-4109-b186-216d6463ad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:31.797397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d0f08-de36-4109-b186-216d6463ad4a admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:31.797676 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d0f08-de36-4109-b186-216d6463ad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:31.797951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d0f08-de36-4109-b186-216d6463ad4a admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:31.798690 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d0f08-de36-4109-b186-216d6463ad4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:31.800265 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d0f08-de36-4109-b186-216d6463ad4a admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:31.812306 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1426/2891] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:10:31.816244 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b22c84-27e1-4cd1-a74d-4d30d66a4913 admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:31.826546 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b22c84-27e1-4cd1-a74d-4d30d66a4913 admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:31.831167 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cf522-04b3-4823-95e3-135522008e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:31.831828 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cf522-04b3-4823-95e3-135522008e16 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:31.832114 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cf522-04b3-4823-95e3-135522008e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:31.832389 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cf522-04b3-4823-95e3-135522008e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:31.833179 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cf522-04b3-4823-95e3-135522008e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:31.834760 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cf522-04b3-4823-95e3-135522008e16 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:31.845990 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1466/2892] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:10:31.850018 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d0f08-de36-4109-b186-216d6463ad4a admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:31.860769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d0f08-de36-4109-b186-216d6463ad4a admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:31.865263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a5f86-3aac-44f2-8294-1936fe9a74f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:31.866129 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a5f86-3aac-44f2-8294-1936fe9a74f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:31.866409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a5f86-3aac-44f2-8294-1936fe9a74f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:31.866684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a5f86-3aac-44f2-8294-1936fe9a74f5 admin admin] PATH_INFO: `/v3/projects/aa836879c00a4a9c8329900ebccd9fd4/users/fbc1022c5d364e119dd8cef39c02fa54/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:31.881179 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a5f86-3aac-44f2-8294-1936fe9a74f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa836879c00a4a9c8329900ebccd9fd4, user_id=fbc1022c5d364e119dd8cef39c02fa54, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:31.883827 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a5f86-3aac-44f2-8294-1936fe9a74f5 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:31.941409 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1427/2893] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:10:31 2022] PUT /identity/v3/projects/aa836879c00a4a9c8329900ebccd9fd4/users/fbc1022c5d364e119dd8cef39c02fa54/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:31.951900 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c267c-fa75-494f-a531-c122d35f8d9e None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:31.952193 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c267c-fa75-494f-a531-c122d35f8d9e None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:31.952558 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c267c-fa75-494f-a531-c122d35f8d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:31.979648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-a44c267c-fa75-494f-a531-c122d35f8d9e None None] MFA Rules not processed for user `fbc1022c5d364e119dd8cef39c02fa54`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:31.981953 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-a44c267c-fa75-494f-a531-c122d35f8d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:32.046639 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1467/2894] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:32.058540 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a5f86-3aac-44f2-8294-1936fe9a74f5 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:32.060371 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-ec6a5f86-3aac-44f2-8294-1936fe9a74f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:32.141163 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a5f86-3aac-44f2-8294-1936fe9a74f5 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:32.144836 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6e309-ed02-47ce-a6da-3f0767a3936d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '259d506eb54e4766a8fe3fa5bb514e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:32.145471 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6e309-ed02-47ce-a6da-3f0767a3936d service glance] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:32.145749 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6e309-ed02-47ce-a6da-3f0767a3936d service glance] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:32.146024 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6e309-ed02-47ce-a6da-3f0767a3936d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:32.155468 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6e309-ed02-47ce-a6da-3f0767a3936d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:32.156951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6e309-ed02-47ce-a6da-3f0767a3936d service glance] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:32.165844 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1428/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:10:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:10:42.043882 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:42.161801 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=63,keystone:INSERT=2 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:48.549615 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c267c-fa75-494f-a531-c122d35f8d9e None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:48.613115 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c267c-fa75-494f-a531-c122d35f8d9e None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:48.617638 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:48.618513 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:48.618794 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:48.619065 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] PATH_INFO: `/v3/users/fbc1022c5d364e119dd8cef39c02fa54` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:48.620248 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc1022c5d364e119dd8cef39c02fa54)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:48.622777 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:48.829657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc1022c5d364e119dd8cef39c02fa54'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:48.841778 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc1022c5d364e119dd8cef39c02fa54'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:48.848858 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc1022c5d364e119dd8cef39c02fa54'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:48.952354 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc1022c5d364e119dd8cef39c02fa54'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:48.953028 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc1022c5d364e119dd8cef39c02fa54'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:48.959515 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1468/2896] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:10:48 2022] DELETE /identity/v3/users/fbc1022c5d364e119dd8cef39c02fa54 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:48.964070 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf26a-e76d-457f-9d8d-b83301e08a32 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:48.964561 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf26a-e76d-457f-9d8d-b83301e08a32 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:48.965263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf26a-e76d-457f-9d8d-b83301e08a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:48.984083 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-867bf26a-e76d-457f-9d8d-b83301e08a32 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:48.985338 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-867bf26a-e76d-457f-9d8d-b83301e08a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:49.046056 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1429/2897] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:49.055967 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:49.057410 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:49.117665 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9987fc1-7380-41a4-99b3-e4b62de338bf admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:49.121252 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b52b-2e92-4f16-b373-57e74aa8dbc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:49.121926 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b52b-2e92-4f16-b373-57e74aa8dbc5 service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:49.122213 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b52b-2e92-4f16-b373-57e74aa8dbc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:49.122494 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b52b-2e92-4f16-b373-57e74aa8dbc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:49.132171 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383b52b-2e92-4f16-b373-57e74aa8dbc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:49.133649 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383b52b-2e92-4f16-b373-57e74aa8dbc5 service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:49.149837 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1469/2898] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:10:49.591535 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf26a-e76d-457f-9d8d-b83301e08a32 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:49.593429 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-867bf26a-e76d-457f-9d8d-b83301e08a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:49.614092 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf26a-e76d-457f-9d8d-b83301e08a32 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:49.621808 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:49.623730 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:49.624227 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:49.625400 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f admin admin] PATH_INFO: `/v3/projects/aa836879c00a4a9c8329900ebccd9fd4` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:49.628951 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa836879c00a4a9c8329900ebccd9fd4)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:49.630114 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:49.758717 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa836879c00a4a9c8329900ebccd9fd4', 'request_id': 'req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:49.764602 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa836879c00a4a9c8329900ebccd9fd4', 'request_id': 'req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:49.826848 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa836879c00a4a9c8329900ebccd9fd4', 'request_id': 'req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:49.838487 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f admin admin] The token cache is being invalidate because project aa836879c00a4a9c8329900ebccd9fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:10:49.840226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:49.840226 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-63b6f709-98a1-4b7e-bde5-2370bcde6e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:49.841536 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1430/2899] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:10:49 2022] DELETE /identity/v3/projects/aa836879c00a4a9c8329900ebccd9fd4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:49.846482 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb995ee-938b-4409-8bc3-f4ecc3b3dc83 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:49.846974 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb995ee-938b-4409-8bc3-f4ecc3b3dc83 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:49.847093 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb995ee-938b-4409-8bc3-f4ecc3b3dc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:49.866450 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-2fb995ee-938b-4409-8bc3-f4ecc3b3dc83 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:49.867657 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-2fb995ee-938b-4409-8bc3-f4ecc3b3dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:49.884910 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:49.926961 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1470/2900] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:49.935309 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b659b6-fbee-40e4-80c3-2ebd5a4661f9 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:49.935600 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b659b6-fbee-40e4-80c3-2ebd5a4661f9 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:49.935892 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b659b6-fbee-40e4-80c3-2ebd5a4661f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:49.954864 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-48b659b6-fbee-40e4-80c3-2ebd5a4661f9 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:49.956080 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-48b659b6-fbee-40e4-80c3-2ebd5a4661f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:49.964185 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1431/2901] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:49.969197 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb995ee-938b-4409-8bc3-f4ecc3b3dc83 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:49.980165 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb995ee-938b-4409-8bc3-f4ecc3b3dc83 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:49.985667 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fb773-371e-46e2-b1aa-de9c3a048fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:49.986329 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fb773-371e-46e2-b1aa-de9c3a048fbd admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:49.986612 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fb773-371e-46e2-b1aa-de9c3a048fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:49.986886 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fb773-371e-46e2-b1aa-de9c3a048fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:49.987616 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fb773-371e-46e2-b1aa-de9c3a048fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87027) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 18:10:49.988267 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fb773-371e-46e2-b1aa-de9c3a048fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:49.989890 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fb773-371e-46e2-b1aa-de9c3a048fbd admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:50.003078 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1471/2902] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Jul 20 18:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 18:10:50.007495 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b659b6-fbee-40e4-80c3-2ebd5a4661f9 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:50.020379 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b659b6-fbee-40e4-80c3-2ebd5a4661f9 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:50.025464 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ceda-d1dc-465a-9ef0-ee529ea54f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:50.026115 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ceda-d1dc-465a-9ef0-ee529ea54f00 admin admin] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:50.026397 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ceda-d1dc-465a-9ef0-ee529ea54f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:50.026670 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ceda-d1dc-465a-9ef0-ee529ea54f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:50.028286 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194ceda-d1dc-465a-9ef0-ee529ea54f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:50.030323 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194ceda-d1dc-465a-9ef0-ee529ea54f00 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:50.108079 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1432/2903] 10.222.0.27 () {60 vars in 1152 bytes} [Wed Jul 20 18:10:50 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:10:50.112519 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fb773-371e-46e2-b1aa-de9c3a048fbd admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:50.122648 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fb773-371e-46e2-b1aa-de9c3a048fbd admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:50.181491 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226c189-e68b-4975-b702-9185b9fe9a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:50.182069 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226c189-e68b-4975-b702-9185b9fe9a4b admin admin] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:50.182348 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226c189-e68b-4975-b702-9185b9fe9a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:50.182647 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226c189-e68b-4975-b702-9185b9fe9a4b admin admin] PATH_INFO: `/v3/users` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:50.183352 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226c189-e68b-4975-b702-9185b9fe9a4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:50.185722 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226c189-e68b-4975-b702-9185b9fe9a4b admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:50.262945 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1472/2904] 10.222.0.27 () {60 vars in 1143 bytes} [Wed Jul 20 18:10:50 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 18:10:50.267744 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ceda-d1dc-465a-9ef0-ee529ea54f00 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:50.278893 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ceda-d1dc-465a-9ef0-ee529ea54f00 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:50.283714 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e17fff-009f-4f37-a98b-640354a05ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:50.284393 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e17fff-009f-4f37-a98b-640354a05ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:50.284711 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e17fff-009f-4f37-a98b-640354a05ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:50.284994 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e17fff-009f-4f37-a98b-640354a05ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:50.285722 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e17fff-009f-4f37-a98b-640354a05ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:50.287328 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e17fff-009f-4f37-a98b-640354a05ef8 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:50.298539 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1433/2905] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:10:50.302814 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226c189-e68b-4975-b702-9185b9fe9a4b admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:50.313797 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226c189-e68b-4975-b702-9185b9fe9a4b admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:50.318444 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e6fd-4acf-4c59-a9a6-883d4b5c69b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:50.319104 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e6fd-4acf-4c59-a9a6-883d4b5c69b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:50.319393 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e6fd-4acf-4c59-a9a6-883d4b5c69b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:50.319666 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e6fd-4acf-4c59-a9a6-883d4b5c69b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:50.320418 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78e6fd-4acf-4c59-a9a6-883d4b5c69b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:50.322037 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78e6fd-4acf-4c59-a9a6-883d4b5c69b6 admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:50.333074 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1473/2906] 10.222.0.27 () {58 vars in 1121 bytes} [Wed Jul 20 18:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 18:10:50.337263 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e17fff-009f-4f37-a98b-640354a05ef8 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:50.348329 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e17fff-009f-4f37-a98b-640354a05ef8 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:50.353160 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cbef3-a595-4f5b-b331-2311e910ba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:50.354126 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cbef3-a595-4f5b-b331-2311e910ba99 admin admin] REQUEST_METHOD: `PUT` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:50.354407 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cbef3-a595-4f5b-b331-2311e910ba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:50.354684 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cbef3-a595-4f5b-b331-2311e910ba99 admin admin] PATH_INFO: `/v3/projects/d66fafe0ff9b4c59a367484a6ef9d6b0/users/0a49c260ab444dc4b1eae27ede4385ea/roles/0f0e06be5d684398a453fa6312e57d41` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:50.371325 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cbef3-a595-4f5b-b331-2311e910ba99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66fafe0ff9b4c59a367484a6ef9d6b0, user_id=0a49c260ab444dc4b1eae27ede4385ea, role_id=0f0e06be5d684398a453fa6312e57d41)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:50.374214 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cbef3-a595-4f5b-b331-2311e910ba99 admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:50.444373 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1434/2907] 10.222.0.27 () {60 vars in 1482 bytes} [Wed Jul 20 18:10:50 2022] PUT /identity/v3/projects/d66fafe0ff9b4c59a367484a6ef9d6b0/users/0a49c260ab444dc4b1eae27ede4385ea/roles/0f0e06be5d684398a453fa6312e57d41 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:50.519235 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feee10-0f03-4e2f-bc69-1c5ba23c92d2 None None] REQUEST_METHOD: `POST` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:50.519542 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feee10-0f03-4e2f-bc69-1c5ba23c92d2 None None] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:50.519830 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feee10-0f03-4e2f-bc69-1c5ba23c92d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:50.546548 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.auth.core [None req-21feee10-0f03-4e2f-bc69-1c5ba23c92d2 None None] MFA Rules not processed for user `0a49c260ab444dc4b1eae27ede4385ea`. Rule list: `[]` (Enabled: `True`). {{(pid=87027) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:50.547765 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-21feee10-0f03-4e2f-bc69-1c5ba23c92d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:50.610458 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1474/2908] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:50.622354 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cbef3-a595-4f5b-b331-2311e910ba99 admin admin] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:50.624020 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-d77cbef3-a595-4f5b-b331-2311e910ba99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:50.647641 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:50.684087 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cbef3-a595-4f5b-b331-2311e910ba99 admin admin] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:50.688590 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa639ed9-1309-48e4-a21c-b3daedf9bcd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dfd634e889c4b53a1ed6b90cc1a25e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:50.689230 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa639ed9-1309-48e4-a21c-b3daedf9bcd1 service cinder] REQUEST_METHOD: `GET` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:50.689511 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa639ed9-1309-48e4-a21c-b3daedf9bcd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:50.689785 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa639ed9-1309-48e4-a21c-b3daedf9bcd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:50.698769 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa639ed9-1309-48e4-a21c-b3daedf9bcd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:50.700354 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa639ed9-1309-48e4-a21c-b3daedf9bcd1 service cinder] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:50.710700 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1435/2909] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:10:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:10:50.735707 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feee10-0f03-4e2f-bc69-1c5ba23c92d2 None None] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:50.755362 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:10:50.800208 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feee10-0f03-4e2f-bc69-1c5ba23c92d2 None None] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:50.804919 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:50.805796 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:50.806101 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:50.806382 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] PATH_INFO: `/v3/users/0a49c260ab444dc4b1eae27ede4385ea` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:50.807581 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a49c260ab444dc4b1eae27ede4385ea)` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:50.810597 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:50.995898 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a49c260ab444dc4b1eae27ede4385ea'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:51.011041 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a49c260ab444dc4b1eae27ede4385ea'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:51.020847 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a49c260ab444dc4b1eae27ede4385ea'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:51.100820 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a49c260ab444dc4b1eae27ede4385ea'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:51.101490 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.notifications [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a49c260ab444dc4b1eae27ede4385ea'} {{(pid=87027) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:51.108439 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1475/2910] 10.222.0.27 () {58 vars in 1223 bytes} [Wed Jul 20 18:10:50 2022] DELETE /identity/v3/users/0a49c260ab444dc4b1eae27ede4385ea => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:10:51.113076 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0023e6-507f-48a6-b343-2a8c71293a66 None None] REQUEST_METHOD: `POST` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:51.113545 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0023e6-507f-48a6-b343-2a8c71293a66 None None] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:51.113675 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0023e6-507f-48a6-b343-2a8c71293a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:51.131613 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.auth.core [None req-de0023e6-507f-48a6-b343-2a8c71293a66 None None] MFA Rules not processed for user `3bfdcdc4e8594f169e8c27a8c1db7913`. Rule list: `[]` (Enabled: `True`). {{(pid=87026) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 18:10:51.132852 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-de0023e6-507f-48a6-b343-2a8c71293a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:51.192591 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1436/2911] 10.222.0.27 () {58 vars in 957 bytes} [Wed Jul 20 18:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 18:10:51.202988 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:51.204409 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:51.262736 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e3675-b14b-4b50-9096-0987c5506f9d admin admin] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:51.266381 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6df536-c6cc-477f-a0ce-adc4a6ff70cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11930f08a1324902a083436649660130', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:51.267021 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6df536-c6cc-477f-a0ce-adc4a6ff70cb service neutron] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:51.267299 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6df536-c6cc-477f-a0ce-adc4a6ff70cb service neutron] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:51.267570 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6df536-c6cc-477f-a0ce-adc4a6ff70cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:51.276497 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6df536-c6cc-477f-a0ce-adc4a6ff70cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:51.278986 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6df536-c6cc-477f-a0ce-adc4a6ff70cb service neutron] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:51.288544 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1476/2912] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:10:51.742818 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0023e6-507f-48a6-b343-2a8c71293a66 None None] Authenticating user token {{(pid=87026) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:10:51.747637 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.fernet_utils [None req-de0023e6-507f-48a6-b343-2a8c71293a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87026) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:10:51.756363 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0023e6-507f-48a6-b343-2a8c71293a66 None None] Validating token access rules against request {{(pid=87026) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:10:51.761988 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52237d6a-319d-4fff-bfa2-1de9c836d3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bfdcdc4e8594f169e8c27a8c1db7913', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f637912c585421ea114b8fb6faea1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87026) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:10:51.762991 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237d6a-319d-4fff-bfa2-1de9c836d3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:10:51.763281 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237d6a-319d-4fff-bfa2-1de9c836d3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:10:51.763559 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237d6a-319d-4fff-bfa2-1de9c836d3cf admin admin] PATH_INFO: `/v3/projects/d66fafe0ff9b4c59a367484a6ef9d6b0` {{(pid=87026) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:10:51.764849 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52237d6a-319d-4fff-bfa2-1de9c836d3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66fafe0ff9b4c59a367484a6ef9d6b0)` {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:10:51.766836 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52237d6a-319d-4fff-bfa2-1de9c836d3cf admin admin] RBAC: Authorization granted {{(pid=87026) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:10:51.908116 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-52237d6a-319d-4fff-bfa2-1de9c836d3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66fafe0ff9b4c59a367484a6ef9d6b0', 'request_id': 'req-52237d6a-319d-4fff-bfa2-1de9c836d3cf'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:51.913514 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-52237d6a-319d-4fff-bfa2-1de9c836d3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66fafe0ff9b4c59a367484a6ef9d6b0', 'request_id': 'req-52237d6a-319d-4fff-bfa2-1de9c836d3cf'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:51.992432 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-52237d6a-319d-4fff-bfa2-1de9c836d3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66fafe0ff9b4c59a367484a6ef9d6b0', 'request_id': 'req-52237d6a-319d-4fff-bfa2-1de9c836d3cf'} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:52.004365 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-52237d6a-319d-4fff-bfa2-1de9c836d3cf admin admin] The token cache is being invalidate because project d66fafe0ff9b4c59a367484a6ef9d6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87026) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 18:10:52.004699 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-52237d6a-319d-4fff-bfa2-1de9c836d3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:52.005445 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG keystone.notifications [None req-52237d6a-319d-4fff-bfa2-1de9c836d3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87026) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 18:10:52.007014 dv-cinder-849846-3-smb devstack@keystone.service[87026]: [pid: 87026|app: 0|req: 1437/2913] 10.222.0.27 () {58 vars in 1232 bytes} [Wed Jul 20 18:10:51 2022] DELETE /identity/v3/projects/d66fafe0ff9b4c59a367484a6ef9d6b0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 18:11:01.284191 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:11:02.001414 dv-cinder-849846-3-smb devstack@keystone.service[87026]: DEBUG dbcounter [-] [87026] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87026) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 18:11:33.500070 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6df536-c6cc-477f-a0ce-adc4a6ff70cb service neutron] Authenticating user token {{(pid=87027) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 18:11:33.501486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-cc6df536-c6cc-477f-a0ce-adc4a6ff70cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:11:33.571486 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6df536-c6cc-477f-a0ce-adc4a6ff70cb service neutron] Validating token access rules against request {{(pid=87027) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 18:11:33.636016 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8a8f8-60e0-4f30-b2fe-512c5440c24e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b218402abe6540d8b81295676199f6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f0f8db3986541468c474b78a9b3740a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87027) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 18:11:33.636697 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8a8f8-60e0-4f30-b2fe-512c5440c24e service placement] REQUEST_METHOD: `GET` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 18:11:33.636980 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8a8f8-60e0-4f30-b2fe-512c5440c24e service placement] SCRIPT_NAME: `/identity` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 18:11:33.637767 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8a8f8-60e0-4f30-b2fe-512c5440c24e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87027) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 18:11:33.639555 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.fernet_utils [None req-70f8a8f8-60e0-4f30-b2fe-512c5440c24e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87027) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 18:11:33.650904 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8a8f8-60e0-4f30-b2fe-512c5440c24e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 18:11:33.652405 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8a8f8-60e0-4f30-b2fe-512c5440c24e service placement] RBAC: Authorization granted {{(pid=87027) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 18:11:33.662514 dv-cinder-849846-3-smb devstack@keystone.service[87027]: [pid: 87027|app: 0|req: 1477/2914] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Jul 20 18:11:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 18:11:43.658263 dv-cinder-849846-3-smb devstack@keystone.service[87027]: DEBUG dbcounter [-] [87027] Writing DB stats keystone:SELECT=58 {{(pid=87027) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}